Scraping Engineer

remotefull timeRemoteentryH1B: no

Clera Scraping Engineer at Clera responsible for maintaining and building web scraping scripts to ensure reliable data extraction from millions of pages daily. Key duties include resolving broken scrapers, validating data accuracy, and creating dashboards for real-time monitoring.

Responsibilities

You'll be an embedded member of a fast-moving AI startup team, owning the reliability and quality of a web extraction infrastructure that processes millions of pages daily through hundreds of scripts. Reporting to a Forward Deployed Engineer, this role is critical to keeping a high-volume data pipeline running smoothly and accurately.
Maintain and monitor a triage queue, resolving broken scrapers and data quality alerts to keep operations running smoothly.
Build and deploy new web scraping scripts for websites requiring data extraction.
Validate scraped data for accuracy and investigate discrepancies.
Create dashboards to visualize and monitor scraped data in real time.
Collaborate with AI agents to fill capability gaps, fix issues, and improve existing scripts.

Qualification

1+ years of hands-onProficiency with TypeScript and NodeFamiliarity with message queues (eComfort with bash scripting

Required

1+ years of hands-on, professional experience building or maintaining web scraping solutions.
Proficiency with TypeScript and Node.js for building and debugging scraping scripts.
Proficiency with SQL for data querying and validation.
Experience with Puppeteer or similar browser automation libraries.
Experience debugging and fixing broken scraping scripts in production environments.