Reference Data Engineer

KKR

New York, NY • 16m ago • On-site

Senior

On-site

135,000 - 170,000 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Potential salary for Reference Data Engineer role

Improve your resume now

$135,000 – $170,000/year

Quick Facts

  • Role: Reference Data Engineer (Assistant Vice President – Software Engineering)
  • Focus: Backend services and reference data engineering, including ETL/ELT, distributed processing, and data distribution

Description

Own end-to-end workstreams for scalable backend services and data pipelines in Python, including robust ETL/ELT with strong data quality, lineage, and observability. Build and optimize large-scale batch and near-real-time workflows using Apache Spark, and lead data modeling and schema decisions for reliable analytics downstream. Drive engineering quality through design/code reviews and mentor junior engineers.

Responsibilities

  • Design, build, and own scalable backend services and data pipelines primarily in Python
  • Develop and optimize distributed data processing workflows with Apache Spark
  • Lead data modeling and schema design for analytics and downstream consumption
  • Architect and maintain ETL/ELT workflows with data quality, lineage, and observability
  • Design and implement data distribution patterns for internal systems and consumers
  • Provision and manage cloud infrastructure using Terraform
  • Deliver end-to-end workstreams through technical design, production, and operations
  • Improve engineering quality via design reviews, code reviews, and technical standards
  • Mentor junior engineers and support team growth
  • Partner with product, data, and platform leaders to translate requirements into scalable solutions
  • Perform root-cause analysis for production issues and improve reliability/performance

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent practical experience
  • 4–7 years of professional backend-focused software engineering experience
  • Expert-level proficiency in Python for production services and data pipelines
  • Strong hands-on experience with Apache Spark for distributed data processing at scale
  • Proficiency with Terraform for infrastructure-as-code and cloud resource management
  • Deep data engineering fundamentals (data modeling, ETL/ELT design, data distribution patterns)
  • Solid command of relational and non-relational data stores and SQL
  • Experience with Git and CI/CD pipelines
  • Demonstrated ability to own complex workstreams and mentor other engineers
  • Strong communication and collaboration skills across technical and business teams

Benefits

  • Collaborative, high-performance culture working on meaningful problems at scale
  • Competitive compensation and comprehensive benefits
  • Significant opportunities for professional growth and technical leadership

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report