Engineering Manager, Big Data

Quick Facts

• Role: Engineering Manager, Big Data

• Team: Job Understanding / Job ingestion and matching intelligence

• Work model: Hybrid (US-based roles may be eligible for remote)

Description

Lead an experienced engineering team building and modernizing the backend machine learning and data platforms for job understanding and matching intelligence. You will rebuild job ingestion pipelines, improve how job data is exposed to engineering teams, and enhance data quality, security, and fraud blocking. The role focuses on scaling real-time ingestion and making job insights actionable for personalization.

Responsibilities

• Lead, mentor, and unblock a senior team of 5 engineers

• Modernize core data pipelines, storage solutions, and access methods

• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed

• Improve input data quality for low-structure, user-generated content

• Own improvements to fraud detection and blocking mechanisms

• Partner with Engineering stakeholders, Data Scientists, and a Product Manager to balance requests and roadmap priorities

• Scale data pipelines for performance and maintainability to enable scalable real-time action on job insights

Requirements

• 5+ years of professional software development experience

• 2+ years of experience as a software engineering leader

• Deep experience with modern big data frameworks (Spark, Hadoop, Hive)

• Streaming technologies experience (Kafka, Flink, Beam)

• Strong CS fundamentals (data structures, algorithms) and coding skills

• Experience with containerization technologies (Docker, Kubernetes)

• Experience working on a B2C or B2B product

• Experience dealing with messy/unreliable data (third-party datasets, data integrations, migrations)

Benefits

• Competitive compensation

• Exceptional benefits package

• Flexible vacation and paid time off

• Employer-matched 401(k) plan

• Base salary range (US): $200,000 - $265,000