Senior Data Engineer (Research)

Quick Facts

• Team focus: Data Science Engineering / Data Engineering
• Core focus: Scalable data processing, data integration, shared platform components, and data quality

Description

You will build scalable data integration mechanisms from multiple source systems, develop shared platform components and standards, and ensure high data quality, reliability, and consistency.

The role includes designing and maintaining data processing pipelines, integrating data into the platform, and contributing to CI/CD and Infrastructure as Code practices.

Responsibilities

• Design, build, and maintain scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark
• Work with raw data and design methods for integrating it into the data platform
• Develop CI/CD pipelines for data engineering solutions
• Create and maintain Infrastructure as Code solutions
• Integrate the data platform with other systems and applications
• Participate in architectural decision-making and define engineering standards
• Conduct code reviews, document solutions, and share knowledge with team members

Requirements

• At least 4 years of experience as a Data Engineer or in a related software engineering role
• Proficiency in Python and ability to write clean, testable production code
• Hands-on experience with Apache Spark
• Advanced SQL skills, including query optimization on large datasets
• Strong understanding of data warehouse design principles and data modeling
• Practical knowledge of ETL/ELT processes
• Familiarity with data quality, monitoring, and pipeline reliability
• Experience with relational databases, including data modeling and optimization
• Understanding of REST and gRPC standards for system integration
• Experience with workflow orchestration tools (e.g., Airflow, Dagster, or similar)
• Knowledge of CI/CD pipeline building and maintenance principles
• Strong analytical problem-solving skills and attention to detail
• Effective communication skills and ability to collaborate in a team
• Openness to learning and exploring new technologies and methodologies

Benefits

• Training budget for courses and conferences that interest you
• An extra day off on your birthday
• An extra day off for parents
• Equipment tailored to your needs
• Private medical care and group insurance
• Access to an e-learning platform for learning English and a benefits platform
• Access to a wellbeing platform, workshops, and private therapy sessions
• Remote work, or from the office in Warsaw / a coworking space in your city