Engineering Manager, Big Data

Quick Facts

• Role: Engineering Manager (Big Data)

• Focus: Job understanding and matching intelligence data platforms

Description

You will lead and mentor a senior engineering team responsible for core job ingestion pipelines and data stores. The role involves modernizing data pipelines, storage, and access methods, rebuilding the job ingestion pipeline, improving data quality for low-structure/user-generated content, and enhancing fraud detection and blocking. You will scale real-time, scalable data processing so the organization can personalize job seeker experiences.

Responsibilities

• Lead, mentor, and unblock 5 engineers

• Drive modernization of job ingestion pipelines, storage solutions, and access methods

• Rebuild and refine how job data is exposed to consuming engineering teams

• Improve input data quality and handle low-structure/user-generated content

• Own improvements to fraud detection and blocking mechanisms

• Partner with Engineering stakeholders, Data Scientists, and a Product Manager to balance requests and roadmap priorities

• Scale streaming and batch data pipelines for performance and maintainability

Requirements

• 5+ years of professional software development experience

• 2+ years of experience as a software engineering leader

• Deep experience with modern big data frameworks (Spark, Hadoop, Hive)

• Experience with streaming technologies (Kafka, Flink, Beam)

• Strong CS fundamentals and coding skills

• Experience with Docker and Kubernetes

• Experience building for B2C or B2B products

• Experience with messy/unreliable data (third-party datasets, integrations, migrations)

Benefits

• Competitive compensation

• Exceptional benefits package

• Flexible Vacation & Paid Time Off

• Employer-matched 401(k)

• Equity/bonuses/commission may be included in total compensation