Senior Data Engineer (Azure Data Factory)

As a Senior Data Engineer, you will support and further develop an Azure-based data integration solution built primarily around Azure Data Factory (ADF). The environment includes Azure Functions and ingestion components, with daily delivery centered on ADF pipeline design, orchestration, monitoring, and continuous improvement.

The project focuses on expanding and stabilizing the existing data platform, including the warehouse layer in Azure SQL Database or Synapse, optional dbt-based transformations, and occasional Power BI reporting support. You will work closely with the client-side Product Owner and Architect to align business needs with technical implementation decisions and deliver high-quality, scalable solutions. You will also contribute to Azure DevOps CI/CD pipelines and release processes to support reliable deployments across environments.

Quick Facts

• Azure-based data integration platform
• Primary focus on Azure Data Factory pipeline design, orchestration, monitoring, and optimization
• Warehouse layer based on Azure SQL Database or Synapse
• Optional dbt transformations and occasional Power BI reporting
• Collaboration with a Product Owner and Architect

Responsibilities

• Design, develop, and maintain Azure Data Factory pipelines, including orchestration, parameterization, and trigger management.
• Configure and manage linked services and datasets within ADF.
• Monitor, troubleshoot, and optimize ADF pipelines for performance and reliability.
• Develop and maintain ETL/ELT processes and support evolution of the data warehouse layer in Azure SQL Database or Synapse.
• Translate business requirements into technical solutions in collaboration with the Product Owner and Architect.
• Develop and maintain Python-based components, including Azure Functions, API integrations, and automation scripts.
• Contribute to CI/CD processes in Azure DevOps, including pipelines, releases, and environment promotion.
• Support occasional Power BI reporting and dashboarding needs.
• Ensure proactive communication, stakeholder alignment, and visibility of risks and impacts.
• Take ownership of assigned tasks and contribute to continuous platform improvement.

Requirements

• Strong hands-on experience with Azure Data Factory and Databricks, including pipeline and orchestration design, linked services, datasets, triggers, parameterization, operational monitoring, troubleshooting, performance tuning, and deployment-aware ADF development in enterprise environments.
• Excellent Python knowledge, including Azure Functions, REST APIs, and automation.
• Strong SQL skills and a solid understanding of data modeling for ETL/ELT and warehouse workloads.
• Experience with Azure DevOps CI/CD processes, including pipelines, releases, and multi-environment deployments.
• Solid understanding of Azure services and cloud-based data solutions, such as Azure SQL Database and Azure Key Vault.
• Experience with Power BI for occasional dashboarding and reporting.
• Practical Databricks experience in data engineering environments.
• Experience with modern development practices and tools.
• Consulting mindset, proactive communication, and strong stakeholder alignment skills.
• Ability to collaborate effectively with a Product Owner and Architect during planning and delivery.
• Independent and responsible approach to delivering high-quality solutions.
• Excellent English at C1 level or higher.

Nice to Have

• Knowledge of dbt.
• Experience implementing data warehouses on Azure.

Benefits

• Flexible work arrangements, including remote work and modern offices or coworking spaces.
• Career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences.
• Access to Databricks and Anthropic training materials and certifications.
• Team-building events and an integration budget.
• Anniversary, birthday, and milestone celebrations.
• Medical and sports packages, eye care, and well-being support, including psychotherapy and coaching.
• Full work equipment, including a laptop and necessary devices.
• Opportunities to build a personal brand through conferences, blog writing, and meetups.
• Dedicated onboarding buddy.