Team Lead, Actors (Web Scraping & Automation)

Quick Facts

• Hands-on Team Lead role for building and scaling web-crawling “Actors” that power AI use cases
• Focus on reliable website crawling, extraction, and turning pages into clean text/Markdown/structured data

Description

Lead a small team in the Universe group to build and scale core Actors—especially a Website Content Crawler—that reliably crawl websites at real-world load. You will stay hands-on with JavaScript/TypeScript, raise code quality through reviews and refactoring, design APIs, and integrate AI into both day-to-day development and tooling. You will also support cross-team work, including contributions to Crawlee (an open-source web scraping library).

Responsibilities

• Build and scale the Website Content Crawler and other core Actors for reliable deep crawling and noise removal
• Convert crawled content into clean text, Markdown, and structured data for AI models, vector databases, and RAG pipelines
• Take on increasing leadership responsibilities while staying actively involved in coding
• Contribute to Crawlee and join product engineering efforts when platform-level work is needed
• Perform code reviews independently and raise the technical bar through PRs
• Reverse-engineer website behavior and design developer-friendly APIs
• Use AI as part of the job (AI-assisted development with a Claude Code license)
• Lead team planning/priorities, unblock teammates, and represent the team across the platform

Requirements

• Experience leading a team or larger projects (formally or informally)
• Strong in JavaScript and TypeScript (Node.js) and solid understanding of web technologies
• At least 2 years of professional or open-source experience on a non-trivial team project
• Strong focus on code quality, readability, and frequent refactoring
• Experience using AI tools at work and understanding where they help or don’t
• Problem-solving mindset and appetite to keep learning (web scraping, leadership, and beyond)
• Systems thinking: design architecture, weigh trade-offs, and see how components fit together
• Clear English communication (writing and speaking)

Benefits

• Full-time role with flexible hours and option to work remotely
• Opportunities for personal growth with direct impact
• Unlimited Claude for every team member and AI-assisted development support
• Stock options and profit sharing; training and education budget; conference support
• Hardware budget and daily free lunches when working from the office