Lead Data Engineer (Databricks Platform)

Quick Facts

• Role: Lead Data Engineer (Databricks Platform)

Description

As a Lead Data Engineer, you define and drive the technical evolution of an enterprise data platform, ensuring scalability, reliability, maintainability, and cost efficiency. You lead Databricks modernization by migrating workloads toward Spark Declarative Pipelines, establishing reusable frameworks and best practices. You design and implement core platform capabilities, optimize Spark performance and Databricks costs, and act as a technical authority translating business requirements into robust designs.

Responsibilities

• Drive Databricks modernization and workload migration to Spark Declarative Pipelines

• Hands-on design and implementation of core platform capabilities

• Review critical code contributions and set engineering standards across the data ecosystem

• Optimize Spark performance, cluster utilization, workload efficiency, and overall Databricks cost

• Consult with engineering teams and stakeholders on complex data challenges and solution approaches

• Support delivery processes (sprint planning, backlog refinement, estimations, deployment practices)

• Evaluate new technologies, promote automation and DevOps practices, and reduce technical debt

Requirements

• Degree in computer science, data engineering, information systems, or comparable field

• Several years of data engineering experience with technical leadership ownership

• Deep knowledge of Databricks and Apache Spark, including performance tuning and workload management

• Experience with Delta Lake and modern data processing architectures

• Strong programming skills in Python and SQL

• Applying software engineering principles: testing, CI/CD, code quality, observability, automation

• Confident English communication

• Proactive, empathetic collaboration in an agile environment

Benefits

• Flexible work model with adjustable start times; hybrid work 70/30 and up to 30 days remote from abroad

• Private medical care, sports card subsidy, group insurance, ergonomic office spaces

• Additional paid time off and recreation subsidies

• Financial perks including discounts on products; commuting and eyewear support

• Growth opportunities via training, mentoring, eTutor language platform, and international projects

• Company events and family friendly activities