Azure Data Engineer (Databricks)

Quick Facts

• Role: Azure Data Engineer (Databricks)

• Project: Long-term

• Location: 100% remote + 1 monthly visit to the Warsaw office

• Rate: 110–130 PLN/hour

Description

Join a long-term project for a Life Sciences client, designing, building, and maintaining scalable data processing solutions in Microsoft Azure with a focus on Azure Databricks and modern Data Lakehouse architectures. You will develop and maintain data pipelines for ingesting, transforming, and cleansing large datasets from multiple sources (databases, APIs, and streaming platforms), using Azure Databricks and Azure Data Factory. You’ll also document technical decisions with attention to performance, scalability, and cost, and support CI/CD and DevOps best practices for data processing.

Responsibilities

• Design and implement scalable solutions for processing, transforming, and cleansing large structured and unstructured datasets

• Build and maintain high-performance data integration pipelines from multiple sources (databases, APIs, streaming platforms)

• Develop solutions using Azure Databricks and Azure Data Factory

• Collaborate with Data Engineering, Data Science, cloud architects, and other stakeholders to deliver end-to-end data solutions

• Participate in key project stages together with business analysts, source-system experts, data architects, engineers, and Product Owners

• Document technical solutions and consider performance, scalability, and costs in architectural decisions

• Support CI/CD and apply DevOps best practices in the data processing area

Requirements

• Experience in Azure Data Engineering with Databricks and Azure Data Factory

• Very strong SQL

• Very strong PySpark and Python

• ETL/ELT experience

• Data modeling knowledge (3NF, Star/Snowflake)

• Practical Databricks knowledge: Unity Catalog, MLflow, Jobs, and Pipelines

• Knowledge of Data Lakehouse architecture (Medallion) and API integrations

• CI/CD and DevOps experience (Git, Azure DevOps)

• Knowledge of integrations with analytics tools (e.g., Power BI)

• Strong communication skills and experience working with clients and cross-functional teams

• Willingness to work remotely and visit the Warsaw office once per month

• Nice to have: AWS or GCP knowledge

Benefits

• Long-term project

• Remote work with one monthly office visit to Warsaw

• Hourly rate: 110–130 PLN/hour