Big Data Team Lead

Quick Facts

• Lead and coordinate a Big Data / Data Engineering team

Description

Lead and coordinate a Big Data / Data Engineering team by supervising project delivery, test data preparation and management, and data quality controls. Oversee CI/CD process development, incident response for data processing and integration, and optimization efforts with monitoring teams. Ensure complete, high-quality, up-to-date technical and project documentation while developing team competencies.

Responsibilities

• Coordinate and supervise project tasks assigned to the team
• Ensure solution quality through ongoing oversight
• Supervise preparation, acquisition, and management of test data
• Collaborate with testing teams on planning, execution, and improving test processes
• Oversee Data Quality processes and initiate improvement actions
• Coordinate with technology teams on building and evolving CI/CD processes
• Manage team activities during data processing and integration incidents
• Collaborate with monitoring teams and initiate optimization measures
• Own technical and project documentation completeness, quality, and currency
• Collaborate with analysts on system analysis and data source integration
• Collaborate with architects on designing and evolving data & integration solutions
• Manage team work organization in the supervised area
• Develop team skills, engagement, and maintain a positive collaboration atmosphere

Requirements

• Minimum 5 years of experience in Big Data, Data Engineering, or Data Platforms
• Minimum 2 years of experience managing a technical team
• Strong knowledge of the Hadoop ecosystem or cloud Big Data solutions
• Practical ability to design Data Lake, Data Lakehouse, and Data Warehouse architectures and make key architectural decisions
• Knowledge of data processing engines, especially Apache Spark and Databricks
• Knowledge of Hadoop and Hive
• Experience with event-driven system design using Apache Kafka
• Practical knowledge of Apache Airflow for complex dependent ETL/ELT workflows
• Practical knowledge of Kubernetes for deployment, scaling, and management of Big Data applications
• Knowledge of relational databases and SQL query optimization plus modern NoSQL databases
• Programming skills in Python and Scala
• Ability to communicate effectively, make decisions, and build team engagement

Benefits

• Stable employment under an employment contract
• Work on innovative projects with an experienced team
• Training and career development support
• Flexible home office
• Private medical care
• Life insurance
• Author’s costs reimbursement
• Day off on your birthday
• Cafeteria benefits system
• Subsidy for a sports club membership
• PPK with 3% contribution supplement
• Office in central Warsaw near major transit stations
• Bike commuting support (parking and showers)
• Paid vacation rest support
• Casual culture (no dress code, first-name basis)
• Dog-friendly office