Data Engineer

Quick Facts

• Role: Data Engineer

Description

You will build and optimize data pipelines that feed ML models powering an RTB (Real-Time Bidding) system making real-time advertising decisions. Focus areas include data quality monitoring, observability of incoming data, and monitoring production models (including detection of distribution shift). You will also improve storage/compute processes to handle very large volumes efficiently.

Responsibilities

• Build and optimize data ingestion processes for ML models

• Design and optimize the data storage layer (schemas and indexing) for analytical performance and real-time systems

• Create data observability for input data (dashboards and alerts for anomalies and data quality drops)

• Develop tools to monitor production models, including distribution shift detection

• Implement CI/CD practices supporting the creation, testing, and deployment of predictive models

Requirements

• Minimum 3 years of commercial experience in Data Engineering or a related data processing role

• Very good knowledge of Python and SQL

• Experience processing large data volumes with Spark and Polars

• Experience with columnar analytical databases

• Strong technical skills and programming ability with understanding of complex systems

• Experience working in domains dealing with large-scale data

• Experience designing and modeling data structures for advanced analytics and near-real-time systems

Benefits

• Work in a technology leader and preferred partner building products used daily

• Free access to selected products (e.g., Pilot WP, Audioteka)

• Worksmile and flexible benefits package

• Free, anonymous psychological consultations

• Hybrid work: 3 days in the office and 2 days from home

• Events and webinars (including health and neurodiversity topics)

• Growth opportunities through WP Akademia training program

• Possibility to take on new challenges within WP Holding companies via internal recruitment