Azure Data Engineer (Databricks)

Quick Facts

• Role: Azure Data Engineer (Databricks)

• Project: Long-term

• Work model: 100% remote + 1 monthly visit to the Warsaw office

Description

Join a long-term remote project for a Life Sciences client as an Azure Data Engineer with Databricks. You will design, develop, and maintain scalable data processing and transformation solutions on Microsoft Azure, with a strong focus on Databricks and Azure Data Factory. The work includes building efficient data pipelines integrating data from databases, APIs, and streaming platforms.

Responsibilities

• Design and implement scalable solutions for processing, transforming, and cleansing large structured and unstructured datasets

• Design, build, and maintain high-performance data pipelines integrating information from multiple sources (databases, APIs, streaming platforms)

• Develop solutions based on Azure Databricks and Azure Data Factory

• Collaborate with Data Engineering, Data Science, cloud architects, and other stakeholders to deliver end-to-end data solutions

• Participate in key project stages together with business analysts, source-system experts, data architects, engineers, and Product Owners

• Document technical solutions and consider performance, scalability, and cost in architectural decisions

• Support CI/CD and apply DevOps best practices in data processing

Requirements

• Experience in Azure Data Engineering with Databricks and Azure Data Factory

• Very good SQL, PySpark, Python, and ETL/ELT

• Data modeling knowledge (3NF, Star/Snowflake)

• Practical Databricks knowledge: Unity Catalog, MLflow, Jobs, and Pipelines

• Knowledge of Data Lakehouse architecture (Medallion) and API integrations

• CI/CD and DevOps experience (Git, Azure DevOps)

• Knowledge of integrations with analytics tools (e.g., Power BI)

• Good communication skills and experience working with clients and cross-functional teams

• Nice to have: AWS or GCP

Benefits

• Long-term project

• 100% remote work with 1 monthly office visit in Warsaw