Data Engineer (Python / Azure)

Quick Facts

• Role: Data Engineer (Python / Azure)
• Focus: ETL/ELT pipelines, REST API integration, JSON/XML processing, data validation, Azure services

Description

Build and maintain production ETL/ELT data pipelines that integrate with external REST APIs, ingest JSON/XML data, and apply validated transformations. Ensure data quality through validation, schema-drift handling, error logging, and support for reprocessing when source schemas change. Implement pipeline logging/monitoring, work with Git and CI/CD, and collaborate with the client team to clarify requirements and report technical issues.

Role Description

• Integrate with external REST APIs: authorization, pagination, query limits, retry connections
• Fetch, parse, and process data in JSON and XML formats
• Implement data transformations and data structures according to the target architecture
• Ensure data quality via validation, schema-change handling, and ability to reprocess data
• Implement logging, pipeline monitoring, and error handling
• Work with Git repositories and client CI/CD processes
• Collaborate with the client team, clarify requirements independently, and report technical issues

Requirements

• Minimum 3 years of commercial experience as a Data Engineer
• Practical Python experience building and maintaining production ETL/ELT pipelines
• Experience integrating REST APIs and processing JSON/XML data
• Strong SQL knowledge
• Experience with data validation, schema drift, error logging, and reprocessing; knowledge of Pydantic, Pandera, or Great Expectations
• Practical experience with one or more Azure services: Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure SQL, Azure Databricks, or Microsoft Fabric
• Knowledge of Git and CI/CD using Azure DevOps or GitHub Actions
• English at least B2+ for interviews and daily client collaboration
• Independence and ability to work within an existing team and technical environment

Benefits

• Private medical care
• Sports card subsidy
• Ongoing support from a consultant
• Employee referral program