Data Engineer (Databricks, PySpark, AML)

Quick Facts

• Role: Data Engineer (Databricks / PySpark / AML)

• Industry: Banking

• Work style: Remote

• Contract: B2B

• Rate: up to 155 PLN/hour + VAT

Description

Data Engineer needed to develop and migrate the AML data layer. You will build and enhance Databricks solutions using PySpark, integrate data from multiple sources, and develop ETL processes. The work includes transforming, cleansing, mapping data, optimizing SQL queries, and migrating existing ETL into a new data architecture.

Responsibilities

• Develop and maintain solutions in Databricks using PySpark

• Design, develop, and optimize ETL processes

• Integrate data from multiple sources (API, databases, files, batch)

• Migrate existing ETL processes to the new data architecture

• Transform, cleanse, and map data

• Create and optimize SQL queries

• Collaborate with analysts and business teams on solution design

Requirements

• Very strong knowledge of Databricks

• Very strong knowledge of PySpark

• Advanced Python knowledge

• Advanced SQL / PL/SQL knowledge

• Experience designing and developing ETL processes

• Experience integrating data from multiple sources (APIs, databases, batch)

Benefits

• Remote work

• B2B contract

• Rate up to 155 PLN/hour + VAT