Senior Data Engineer

Quick Facts

• Role: Senior Data Engineer

• Focus: Azure-based data platform, lakehouse architecture, scalable ETL/ELT pipelines

Description

Build and optimize scalable data solutions within the Azure ecosystem for digital transformation projects. You will implement ETL/ELT pipelines with Python, SQL, and Spark, create Databricks workflows and DLT pipelines, and support platform migrations and Unity Catalog adoption. The role emphasizes data quality, security, performance, reliability, and cost optimization in a governed lakehouse environment.

Responsibilities

• Design, develop, and optimize scalable data solutions on Azure

• Build and maintain ETL/ELT pipelines using Python, SQL, and Spark

• Develop Databricks workflows, DLT pipelines, and metadata-driven solutions

• Support data platform migrations, modernization, and Unity Catalog implementation

• Ensure data quality, security, performance, and reliability

• Contribute to CI/CD, infrastructure automation, monitoring, and troubleshooting

• Collaborate with data architects, analysts, and business stakeholders

• Optimize data processing and storage costs while following lakehouse and governance principles

Requirements

• Strong experience with Python, SQL, and Apache Spark

• Hands-on experience with Azure Data Platform: Azure Databricks, Data Factory, Data Lake, Synapse Analytics

• Experience designing and maintaining ETL/ELT pipelines

• Knowledge of Delta Live Tables (DLT), Unity Catalog, and lakehouse architecture

• Experience with Databricks workflows, CI/CD, and Azure DevOps

• Understanding of infrastructure automation, monitoring, logging, and data governance

• Familiarity with Power BI and Azure Data Explorer

Benefits

• Opportunity to work on projects supporting clients’ digital transformation using modern data and lakehouse technologies