Web Scraping Engineer (Remote)

Quick Facts

• Role: Web Scraping Engineer (Remote)

Description

Build and deliver high-scale crawlers, scrapers, and parsers for end-to-end scraping solutions. You’ll own projects from client requirements to delivery, writing reusable Python or Go code (often with AI-driven IDE assistance) to support the team’s data platform. The environment prioritizes speed and delivery as client request volumes scale.

Responsibilities

• Design and build high-scale crawlers, scrapers, and infrastructure for thousands to millions of requests
• Own client-driven projects end-to-end and build custom solutions from scratch
• Write functional, reusable Python/Go code using AI-driven development tools
• Enable seamless building and delivery of large datasets within the data platform
• Use internal scraping tools or build new ones as priorities and client routes change
• Justify technical decisions and perform code reviews; collaborate to ensure solution quality

Requirements

• Multiple years of backend development experience with Python or Go (or strong web scraping expertise supported by AI tools)
• Knowledge of web scraping fundamentals, parsing, headless browsers, and databases such as PostgreSQL or BigQuery
• High independence: align on an approach and fully own delivery
• Business-first mindset focused on speed and delivery over perfection; can handle direct feedback
• Hands-on comfort with AI-driven development tools (e.g., Cursor, Claude Code, Antigravity)

Benefits

• Opportunity to take immediate ownership in a fast-paced, rapidly growing workload
• Build large-scale custom datasets and scraping infrastructure used by global clients