All work

Social data

Multi-Platform Social Data Harvester

A workflow for collecting and processing public social data from multiple platforms for analysis and dashboards.

Public discourseData collectionNarrative analysis

Multi-source collection

src Asrc Bsrc Csrc D
process

~500K posts/day · CSV + BigQuery

The problem

Public discourse research needs repeatable collection and processing workflows across platforms with different formats and limits.

What I built

  • Collection scripts for multiple public platforms.
  • CSV and BigQuery outputs.
  • Processing workflows for analysis and dashboards.

My role

Builder of collection scripts and processing workflows for public social data.

Methods

API use where availableArchive-based collectionBatch processing

Why it matters

Shows the technical middle layer between platform data and research evidence.

What it demonstrates

  • Cross-platform data handling
  • Batch processing
  • Research preparation

Outcome

The workflows made cross-platform public data easier to inspect, clean, and use in downstream analysis.