Tag

#scraping

3 posts

Dec 18, 2025·5 min read

Building OEM Hunter, Part 3: The Part Number Normalization Problem Nobody Warns You About

After getting 14 plugins returning data, I had a new problem: the same part appeared in four different formats across sources. Exact matching missed 60% of cross-source results. Here's how I fixed it.

scrapingpythonautomationtools

Dec 2, 2025·4 min read

Building OEM Hunter, Part 2: Beating Automotive WAF Protection with Camoufox

Standard scrapers get blocked immediately on most dealer sites. Here's the fingerprinting problem, why Playwright alone doesn't solve it, and how Camoufox changed everything.

scrapingpythonautomationcamoufoxtools

Nov 15, 2025·5 min read

Building OEM Hunter, Part 1: Why Automotive Parts Sites Are a Mess (and How I Architected Around It)

Finding OEM parts across 18+ supplier sources is entirely manual. I decided to build a scraper orchestrator. Here's the architecture I landed on and why the naive approach doesn't work.

scrapingpythonautomationtools