Senior Data Engineer

Quick Facts

• Role: (Senior) Data Engineer for an AI autonomy data platform
• Focus: lakehouse-based data products, ETL/ELT pipelines, governance, and observability
• Senior level: set standards and mentor engineers

Description

You will design and maintain a data platform that turns raw data into trusted data products for AI/ML models and analytics. The role includes building robust ETL/ELT pipelines, managing data lineage and quality, and enabling data access for analytics dashboards and queries. As a Senior Engineer, you will provide the architectural foundation and drive best practices within the data engineering culture.

Responsibilities

• Design and maintain Bronze/Silver/Gold lakehouse data structures; define standards for data modeling and architecture at Senior level
• Build and operate ETL/ELT pipelines using Apache Airflow, Spark, and Trino; provide reusable data products for ML and analytics teams
• Maintain a data metastore and ensure data lineage, data quality, data contracts, and traceability (e.g., with OpenMetadata)
• Manage table access and provide dashboards and data queries using Superset, SQL, and Python
• Proactively monitor transformation pipelines and handle alerts to ensure data quality and data availability
• Mentor engineers, establish data-engineering best practices, and lead the team technically on Senior level
• Own the data platform’s architectural foundation and connect strategic design with hands-on pipeline work

Requirements

• Degree in Computer Science, Data Engineering, or a related field (Master’s or PhD preferred for Senior level)
• Proven experience as a Data Engineer or comparable role (Senior: multiple years)
• Deep knowledge of data platform tools: Apache Airflow, Spark, Trino
• Experience with lakehouse architectures and technologies such as Delta Lake, Iceberg, Hive Metastore, or Polaris
• Strong SQL and Python; expert knowledge of data catalog/governance tools (OpenMetadata) and BI tools (Superset)
• Data-as-a-Product mindset with a strong focus on data quality, accessibility, and traceability
• Senior-level experience mentoring colleagues and establishing best practices
• Fluent German and English