Databricks Data Engineer

Quick Facts

• Role: Databricks Data Engineer (Data Engineer – Databricks)

• Project: Greenfield data platform integrating MES, SCADA, and ERP

• Work: Remote

• Team: 6–7 people working with partners from Canada

Description

You will help build a new data platform from scratch that unifies production (MES), machine (SCADA), and business (ERP) data. On this foundation, the team will create models for anomaly detection, loss analysis, and recommendations, with a future GenAI layer. This is a greenfield effort where you will influence architecture and best practices.

Responsibilities

• Design, build, and evolve ETL/ELT pipelines and Databricks jobs

• Integrate data from production and business systems

• Process large volumes of data using Spark

• Ensure data quality, monitoring, and reliability

• Work with Data Scientists and architects to build ML models

Requirements

• 2+ years of commercial experience with Databricks

• Python and Spark/PySpark

• Strong SQL knowledge

• Experience applying best practices for pipelines (modularity, error handling, monitoring)

• Git

• English at a level for free technical communication

Benefits

• Employment contract via Experis (umowa o pracę)

• 2-year project with extension possibility

• Remote work

• Medicover medical package

• Multisport card

• Group life insurance