
Reference Data Engineer
KKR
New York, NY • 16m ago • On-site
Senior
On-site
135,000 - 170,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Reference Data Engineer role
Improve your resume now
$135,000 – $170,000/year
Quick Facts
- Role: Reference Data Engineer (Assistant Vice President – Software Engineering)
- Focus: Backend services and reference data engineering, including ETL/ELT, distributed processing, and data distribution
Description
Own end-to-end workstreams for scalable backend services and data pipelines in Python, including robust ETL/ELT with strong data quality, lineage, and observability. Build and optimize large-scale batch and near-real-time workflows using Apache Spark, and lead data modeling and schema decisions for reliable analytics downstream. Drive engineering quality through design/code reviews and mentor junior engineers.
Responsibilities
- Design, build, and own scalable backend services and data pipelines primarily in Python
- Develop and optimize distributed data processing workflows with Apache Spark
- Lead data modeling and schema design for analytics and downstream consumption
- Architect and maintain ETL/ELT workflows with data quality, lineage, and observability
- Design and implement data distribution patterns for internal systems and consumers
- Provision and manage cloud infrastructure using Terraform
- Deliver end-to-end workstreams through technical design, production, and operations
- Improve engineering quality via design reviews, code reviews, and technical standards
- Mentor junior engineers and support team growth
- Partner with product, data, and platform leaders to translate requirements into scalable solutions
- Perform root-cause analysis for production issues and improve reliability/performance
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent practical experience
- 4–7 years of professional backend-focused software engineering experience
- Expert-level proficiency in Python for production services and data pipelines
- Strong hands-on experience with Apache Spark for distributed data processing at scale
- Proficiency with Terraform for infrastructure-as-code and cloud resource management
- Deep data engineering fundamentals (data modeling, ETL/ELT design, data distribution patterns)
- Solid command of relational and non-relational data stores and SQL
- Experience with Git and CI/CD pipelines
- Demonstrated ability to own complex workstreams and mentor other engineers
- Strong communication and collaboration skills across technical and business teams
Benefits
- Collaborative, high-performance culture working on meaningful problems at scale
- Competitive compensation and comprehensive benefits
- Significant opportunities for professional growth and technical leadership
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Reference Data Engineer
KKR
Senior
Technology
New York, NY · On-site
$135k - $170k/yr
2 days ago
Junior Data Engineer
ITELENCE
Junior
Technology
Warsaw, Poland · Remote
12k zł - 16k zł/yr
11 days ago

Data Engineer
B3 Consulting Poland
Senior
Technology
Prague, Czechia · On-site
N/A
11 days ago

Senior Data Engineer (Data Platform)
Link Group
Senior
Technology
Warsaw, Poland · On-site
31k zł - 40k zł/yr
2 days ago

AWS Data Engineer (Mid)
TQLO SP. Z O.O.
Mid
Technology
Warsaw, Poland · Remote
N/A
14h ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior Data Engineer (Back-End Systems)
First American Financial Corporation
Senior
Technology
SC · Remote
$122k - $131k/yr
9 days ago
Data Engineer
SCALO
Senior
Technology
Warsaw, MA, Poland · On-site
41933k zł - 57658k zł/yr
17 days ago
Staff Backend Software Developer (Data/ETL)
Leap Tools Inc.
Senior
Technology
Wrocław, Poland · Remote
N/A
1 days ago

Senior Data Engineer
ALTEN Polska
Senior
Technology
Rzeszów, Poland · On-site
N/A
9 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights