Web Scraping Engineer (Remote)

Quick Facts

• Role: Web Scraping Engineer (Remote)

Description

Build and deliver high-scale web crawlers and parsers, taking projects from client requirements through end-to-end delivery. Write functional, reusable Python or Go code and leverage AI-driven development tools to move quickly in a fast-paced environment. Collaborate on scraping infrastructure, code reviews, and internal tooling as priorities and client routes change.

Responsibilities

• Design and build high-scale crawlers, scrapers, and supporting infrastructure for thousands to millions of requests
• Own projects end-to-end and build custom solutions from scratch
• Develop reusable code in Python or Go, using AI-driven IDEs to maximize output and efficiency
• Work within the data platform to build and deliver large datasets
• Use internal scraping tools or build new ones as priorities and client routes evolve
• Justify technical decisions, perform code reviews, and collaborate closely with the team

Requirements

• Multiple years of backend development experience with Python or Go (or strong web scraping expertise driven by AI tools)
• Familiarity with web scraping fundamentals, parsing, headless browsers, and databases such as PostgreSQL or BigQuery
• High level of independence and ability to fully own delivery after aligning on an approach
• Business-first mindset prioritizing speed and delivery over perfection, with ability to handle direct feedback
• Hands-on experience and comfort level with AI-driven development tools (Cursor, Claude Code, Antigravity)

Benefits

• Opportunity to take immediate ownership of rapidly growing, project-based scraping requests
• Build large-scale, end-to-end datasets and contribute to scraping infrastructure and internal tooling