Data pipelines and scraping
Every source breaks differently. A government API with documented rate limits is a different job from a site that renders through JavaScript and changes its markup monthly. These pages cover the sources I am asked about most, what makes each one awkward, and what a build actually costs.
Pull UK company filings, officers, and charges from Companies House on a schedule. Built on the official API, delivered to your database or CRM.
Track 10-K, 10-Q, 8-K, and Form 4 filings from SEC EDGAR as they land. Structured output, real-time alerts, delivered where your team works.
Track funding rounds, hiring, and expansion signals across news sources. Scored, deduplicated, and enriched into leads your team can act on.
Build local business datasets from Google Places. Licensed API access, deduplicated against your CRM, delivered on a schedule you control.
Track job postings across boards and company careers pages. Deduplicated, categorized, and turned into hiring signals your team can act on.
Track competitor pricing, promotions, and stock levels across retail sites. Matched to your catalogue, alerting on the changes that matter.
Turn bank statement PDFs into clean structured transactions. Per-bank parsers, no model guesswork, and nothing retained that does not need to be.
Track property listings, price changes, and time on market. Deduplicated across portals and agents, delivered as a dataset you can analyse.
Monitor regulator registers, sanctions lists, and enforcement notices. Deduplicated, matched to your entities, and alerting on real changes.
Stop downloading the same report every morning. Automated extraction from portals you already have logins for, delivered into your systems.
Most of the work I do is on sources that will never have a page here. Tell me where the data lives and I will tell you whether it can be pulled reliably, what it would take, and whether it is worth building.
Discuss your project