Data pipelines and scraping

Custom scrapers, built per source

Every source breaks differently. A government API with documented rate limits is a different job from a site that renders through JavaScript and changes its markup monthly. These pages cover the sources I am asked about most, what makes each one awkward, and what a build actually costs.

Companies House

from £1,200

Pull UK company filings, officers, and charges from Companies House on a schedule. Built on the official API, delivered to your database or CRM.

SEC EDGAR

from £1,200

Track 10-K, 10-Q, 8-K, and Form 4 filings from SEC EDGAR as they land. Structured output, real-time alerts, delivered where your team works.

News and press release sources

from £1,200

Track funding rounds, hiring, and expansion signals across news sources. Scored, deduplicated, and enriched into leads your team can act on.

Google Maps business listings

from £1,200

Build local business datasets from Google Places. Licensed API access, deduplicated against your CRM, delivered on a schedule you control.

Job boards and careers pages

from £1,200

Track job postings across boards and company careers pages. Deduplicated, categorized, and turned into hiring signals your team can act on.

Retailer and marketplace pricing

from £1,200

Track competitor pricing, promotions, and stock levels across retail sites. Matched to your catalogue, alerting on the changes that matter.

Bank statement PDFs

from £1,200

Turn bank statement PDFs into clean structured transactions. Per-bank parsers, no model guesswork, and nothing retained that does not need to be.

Property listing portals

from £1,200

Track property listings, price changes, and time on market. Deduplicated across portals and agents, delivered as a dataset you can analyse.

Regulatory registers and enforcement notices

from £1,200

Monitor regulator registers, sanctions lists, and enforcement notices. Deduplicated, matched to your entities, and alerting on real changes.

Supplier and partner portals

from £1,200

Stop downloading the same report every morning. Automated extraction from portals you already have logins for, delivered into your systems.

Your source is not listed

Most of the work I do is on sources that will never have a page here. Tell me where the data lives and I will tell you whether it can be pulled reliably, what it would take, and whether it is worth building.

Discuss your project