Data Engineer (DBX, dbt)

Quick Facts

• Role: Data Engineer (Regular level)
• Focus: Central Data Platform, ETL/ELT, training datasets for ML and decision support
• Environment: Azure Cloud, Databricks/DBT/dltHub, GitHub, Terraform

Description

Join a team building a Central Data Platform for a global insurance organization, focusing on end-to-end ETL/ELT pipelines and data readiness for analytics and machine learning. You will develop and maintain technically sound, high-quality pipelines on a modern Databricks-based cloud stack and contribute to training datasets for document processing and decision support. The role emphasizes data engineering best practices, testing, deployment, and continuous improvement of performance, reliability, and automation.

Role Description

You will ensure optimal and technically integral ETLs and build end-to-end data pipelines (ingestion, transformation, storage, and consumption). You will collaborate closely with data scientists, engineers, and business stakeholders.

Responsibilities

• Build end-to-end data pipelines (ingestion, transformation, storage, consumption)
• Ensure optimal, technically integral ETLs for integrated data insights
• Prepare and maintain high-quality training datasets for machine learning models
• Contribute to building a training dataset for document processing and decision support
• Work with large-scale data on Databricks
• Apply best practices in data engineering, testing, and deployment
• Continuously improve performance, reliability, and automation of data workflows

Requirements

• Proven Data Engineering experience at a Regular level
• Strong experience with Databricks (DBX)
• Advanced Python knowledge (Pydantic is a plus; PydanticAI is a strong advantage)
• Solid experience building and optimizing ETL/ELT pipelines
• Very good knowledge of SQL and relational databases
• Experience with PySpark
• Familiarity with dbt (preferred)
• CI/CD practices and tools (e.g., GitHub)
• General understanding of infrastructure, orchestration, and IT security principles
• Bachelor’s or Master’s degree in a technical field (or equivalent experience)
• Fluent English (written and spoken)
• DevOps mindset (“you build it, you run it”)
• Ability to translate complex requirements into actionable solutions
• Strong communication and cross-functional collaboration
• Attention to detail regarding data quality and business logic
• Proactive attitude and willingness to learn new technologies

Benefits

• Contract under Polish law: B2B or Umowa o Pracę
• Private medical care, group insurance, Multisport card
• English classes available
• Hybrid work (at least 1 day/2 months on-site) in Warsaw (Mokotów)
• Opportunity to work with excellent professionals and maintain high code quality standards
• Continuous learning and growth
• International team