Engineering Manager, Big Data

Quick Facts

• Role: Engineering Manager (Big Data)

• Team: Recommendations Ecosystem / Job Understanding

• Focus: Job ingestion pipelines, job data storage/access, data quality & security, real-time scalability

Description

Lead and mentor a senior team of 5 engineers to modernize core data pipelines, storage solutions, and access methods for job understanding and matching intelligence. You will rebuild and refine the job ingestion pipeline, improve handling of low-structure user-generated content, and enhance fraud detection/blocking mechanisms. Partner with Engineering stakeholders, Data Scientists, and a Product Manager to deliver scalable real-time data pipelines that improve personalization.

Responsibilities

• Lead, mentor, and unblock a senior team of 5 engineers

• Rebuild and improve the job ingestion pipeline and how job data is exposed to consuming teams

• Prioritize initiatives that improve input data quality and support low-structure user-generated content

• Own improvements to fraud detection and blocking mechanisms

• Collaborate with Data Scientists and Product to balance requests and roadmap priorities

• Ensure scalable real-time actionability and maintainable, high-performance pipelines

Requirements

• 5+ years of professional software development experience

• 2+ years of experience as a software engineering leader

• Deep experience with modern big data frameworks (Spark, Hadoop, Hive)

• Experience with streaming technologies (Kafka, Flink, Beam)

• Strong CS fundamentals and coding skills

• Experience with containerization (Docker, Kubernetes)

• Experience working on a B2C or B2B Product

• Experience dealing with messy/unreliable data (third-party datasets, data integrations, migrations)

Benefits

• Competitive compensation

• Exceptional benefits package

• Flexible Vacation & Paid Time Off

• Employer-matched 401(k)

• Base salary range (US): $200,000 - $265,000