Senior Data Engineer (Python / Azure)

Quick Facts

• Role: Senior Data Engineer (Python / Azure)

Description

Design and build data warehouses or lakehouses from scratch, including a medallion (bronze/silver/gold) architecture and dimensional modeling (star schema). Create production ETL/ELT pipelines in Python with integrations to REST API sources, and implement data validation, schema drift handling, logging, error handling, and data reprocessing. Translate the client’s business taxonomy into a data dictionary and data models, collaborate on technical requirements/decisions, and document the architecture for handover to the customer team.

Responsibilities

• Design and implement a data warehouse or lakehouse from scratch
• Implement bronze/silver/gold (medallion) layers
• Build a dimensional model (fact/dimension tables and relationships in star schema)
• Analyze client business taxonomy and identify areas needing clarification
• Convert taxonomy into a data dictionary, classification structure, and data model
• Develop production Python ETL/ELT pipelines with integrations to regulatory/parliamentary sources
• Implement validation, schema change handling, logging, error handling, and data reprocessing mechanisms
• Collaborate with the client to refine requirements and make technical decisions
• Prepare documentation (architecture, data model, pipelines) and hand over to the customer team

Requirements

• 5+ years of commercial data engineering experience
• Experience designing/building a data warehouse or lakehouse from scratch
• Practical knowledge of dimensional modeling, star schema, and medallion architecture
• Ability to map business taxonomy to data structures and assess completeness/consistency
• Strong Python for production ETL/ELT and good SQL skills
• REST API integration experience (authentication, pagination, request limits, retries, JSON/XML parsing)
• Knowledge of data quality assurance, schema drift handling, and reprocessing
• Experience with one or more: Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure SQL, Azure Databricks, Microsoft Fabric
• Git knowledge and CI/CD in Azure DevOps or GitHub Actions
• Ability to document solutions and transfer them for maintenance
• English B2+ and independence for direct client collaboration

Benefits

• Private medical care
• Sports card co-financing
• Ongoing support from a consultant
• Employee referral program