Data Engineer

Quick Facts

• Role: Data Engineer

• Work style: Hybrid (2 days/week in the Warsaw office)

• Project: Long-term

• Rate: up to 175 PLN/hour net + VAT, B2B

Description

You will implement data models prepared by architects and data modelers, and build ETL/ELT pipelines in both batch and streaming modes. You will develop models, transformations, and tests using dbt Core and PySpark, orchestrating workflows with Airflow / Cloud Composer. You will also apply data validation and quality controls, maintain technical documentation, and support deployments to TEST, PREPROD, and PROD environments.

Responsibilities

• Implement data models prepared by architects and modelers

• Build ETL/ELT processes in batch and streaming mode

• Develop models, transformations, and tests in dbt Core and PySpark

• Build and maintain DAGs in Airflow / Cloud Composer

• Implement data validation and data quality control mechanisms

• Co-create generators and data supply frameworks

• Prepare unit, integration, and quality tests

• Maintain technical documentation

• Support deployments to TEST, PREPROD, and PROD environments

Requirements

• 3+ years of experience as a Data Engineer or GCP Developer

• Very good knowledge of Python, PySpark, and SQL

• Practical experience with BigQuery and dbt Core

• Experience with Cloud Composer / Airflow, Cloud Storage, and Pub/Sub

• Experience building ETL/ELT processes and processing large datasets

• Knowledge of GitHub, CI/CD, and software development best practices

• Experience creating unit, integration, or quality tests

• English enabling work with technical documentation

Benefits

• Long-term project