Azure Data Engineer

Quick Facts

• Role: Azure Data Engineer

• Focus: scalable Azure data platforms, ETL/ELT pipelines, and data modeling for analytics

Description

Design, build, and improve scalable and high-performance data processing platforms in a Data Lake / Data Platform architecture using Microsoft Azure technologies such as Azure Databricks, Azure Data Factory, Synapse, and Fabric. Create and maintain ETL/ELT pipelines, implement batch and/or near real-time processing, and model data structures for analytical and business needs. Collaborate with data analysts, BI teams, and Data Science, while documenting solutions and mentoring junior engineers.

Responsibilities

• Design, build, and develop scalable, high-performance data processing platforms (Data Lake/Data Platform)
• Build and maintain ETL/ELT pipelines for integrating data from multiple sources and processing it in Azure Databricks
• Data modeling and preparation of data structures for analytics and business requirements
• Implement batch and/or near real-time data processing solutions
• Monitor, optimize, and develop existing pipelines and data processing workflows
• Collaborate with data analysts, BI teams, and Data Science on data preparation and availability
• Gather business requirements and propose optimal technical solutions
• Create and maintain technical documentation
• Support and mentor less experienced team members; share knowledge and best practices

Requirements

• Minimum 4 years of experience in projects involving processing and integration of large volumes of data
• Strong SQL and Python skills
• Experience with Apache Spark/PySpark or similar data processing frameworks
• Practical experience in designing and building Data Lake and Data Warehouse solutions
• Ability to build and maintain ETL/ELT pipelines and use data orchestration/integration tools
• Commercial experience with Azure cloud data processing solutions (Databricks, Azure Data Factory, Synapse, Fabric)
• Understanding of distributed data processing concepts and pipeline optimization
• Fluent English communication
• Fluent Polish language skills
• Must currently be located in Poland

Benefits

No benefits were specified in the provided posting.