Data Engineer

Quick Facts

• Role: Data Engineer (Core Data Platform)

Description

Build and maintain a centralized data platform used across teams. You will create scalable data integration and data processing pipelines, ensuring data quality, reliability, and consistency while developing shared platform components and standards.

Responsibilities

• Implement, maintain, and support MS SQL Server warehouse and SSIS processes/jobs daily

• Design, build, and maintain scalable data processing pipelines using SQL, Python, and Apache Spark/PySpark

• Integrate raw data into the data platform

• Develop CI/CD pipelines for data engineering solutions

• Create and maintain Infrastructure as Code solutions

• Integrate the data platform with other systems and applications

• Participate in architectural decision-making and define engineering standards

• Conduct code reviews, document solutions, and share knowledge with the team

Requirements

• At least 3 years of experience as a Data Engineer or related software engineering role

• At least 1 year of experience with MS SQL Server, SSIS, and SQL Server Agent (including deploying new features)

• Analyze legacy code and migrate/improve it toward newer technologies

• Flexibility to join a Databricks-oriented project at some point

• Proficient in Python and able to write clean, testable production code

• Hands-on experience with Apache Spark

• Advanced SQL skills, including query optimization on large datasets

• Strong understanding of data warehouse design principles and data modeling

• Practical knowledge of ETL/ELT

• Familiarity with data quality, monitoring, and pipeline reliability

• Experience with relational databases, including data modeling and optimization

• Understanding of REST and gRPC for system integration

• Experience with workflow orchestration tools (Airflow, Dagster, or similar)

• Knowledge of CI/CD pipeline building and maintenance

• Strong analytical problem-solving and attention to detail

• Effective communication and ability to collaborate

• Openness to learning and exploring new technologies and methodologies

Benefits

• Training budget for courses and conferences

• Extra day off on your birthday

• Extra day off for parents

• Equipment tailored to your needs

• Private medical care and group insurance

• Access to an e-learning platform for English and a benefits platform

• Access to a wellbeing platform, with workshops and private therapy sessions

• Remote work option (from home or from the Warsaw office/coworking space)