Data Engineer (Azure)

Quick Facts

Data Engineer role focused on Data Intake in Azure and Databricks.

Description

You will develop and maintain reliable data ingestion and transformation pipelines, ensuring automation, monitoring, and error handling in a cloud environment. The work includes preparing data for downstream layers and enforcing data quality at each intake stage. You’ll collaborate with other specialists to establish technical direction and engineering best practices.

Responsibilities

• Provide technical guidance and develop engineering best practices with the project team
• Transform and prepare data for use by subsequent system layers
• Schedule and monitor pipelines with proper error handling and logging
• Build and maintain pipelines for acquiring data from various sources
• Ensure data quality throughout every step of the intake process
• Automate data intake processes in the cloud

Requirements

• Documented experience in data ingestion and designing reliable pipelines
• Knowledge of the Azure ecosystem for data processing and storage
• Practical knowledge of Python for building data pipelines
• Experience with Databricks in a production environment
• Fluent Polish and English

Benefits

• B2B collaboration with flexible engagement model
• 100% remote delivery and a fast remote process
• Project-based model with stage-based settlement and acceptance protocols for deliverables
• Administrative and billing support through Connectis
• Participation in industry events and technology meetups
• Referral bonus: 5,000 PLN for recommending friends