Engineering Manager, Big Data

Quick Facts

Hybrid work environment with remote options for most US-based positions (exceptions noted in Minimum Qualifications).

Description

You will lead a high-impact engineering team responsible for job ingestion pipelines and the data platforms that support job understanding and matching intelligence. The role focuses on modernizing core data pipelines, storage, and access methods while enhancing data quality and security systems, including fraud detection and blocking. You’ll ensure the system can act on job insights in scalable real-time workflows.

Responsibilities

• Lead, mentor, and unblock a senior team of 5 engineers working on core job ingestion pipelines and data stores.
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
• Prioritize initiatives to improve underlying input data quality and handle low-structure, user-generated content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner closely with other engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
• Scale data pipelines for both performance and maintainability to enable ambitious data collection and personalization.

Requirements

• 5+ years of professional software development experience.
• 2+ years of experience as a software engineering leader.
• Deep experience with modern big data frameworks (e.g., Spark, Hadoop, Hive).
• Experience with streaming technologies (Kafka, Flink, Beam).
• Strong CS fundamentals (data structures, algorithms) and coding skills.
• Experience with containerization technologies like Docker and Kubernetes.
• Experience working on a B2C or B2B Product.
• Experience dealing with messy/unreliable data (third-party datasets, data integrations, migrations).

Benefits

• Competitive compensation
• Exceptional benefits package
• Flexible Vacation & Paid Time Off
• Employer-matched 401(k) plan

Compensation

US base salary range for full-time position: $200,000 - $265,000. Equity, bonuses, commission, or other compensation may be included depending on the offer; total compensation also includes a full range of medical, financial, and other benefits.