Lead Data Engineer

Quick Facts

• Role: Lead Data Engineer

• Focus: Migrate a data platform from Hadoop to GCP (BigQuery)

Description

Lead the technical migration from Hadoop to GCP/BigQuery, ensuring the platform is modernized and aligned with a target Data Engineering architecture. You will analyze the current environment, organize and optimize ETL/ELT processes, and define the migration strategy and technical direction. The position requires end-to-end ownership, decision-making on architecture, and coordination of the Data Engineering team.

Responsibilities

• Lead the migration of the data platform from Hadoop to GCP/BigQuery

• Analyze the current environment and identify areas needing cleanup and modernization

• Design and develop the target data architecture in GCP

• Organize, optimize, and modernize existing ETL/ELT processes

• Prepare the data and process migration strategy

• Make technology and architecture decisions for Data Engineering

• Collaborate with technical teams and business stakeholders

• Coordinate the Data Engineering team and set its development direction

• Ensure scalability, performance, data quality, and reliability of data processes

• Identify migration risks and dependencies and propose solutions

Requirements

• 5–7+ years of experience in Data Engineering

• Very good knowledge of the Hadoop ecosystem

• Practical experience with GCP, especially BigQuery

• Very good knowledge of designing and developing ETL/ELT processes

• Experience in data platform migration or modernization projects

• Very good knowledge of SQL

• Knowledge of Python or another language used in Data Engineering

• Experience designing data solution architecture

• Experience in a Technical Lead/Data Engineering Lead role or leading a technical team

• Ability to make independent technical decisions and take end-to-end responsibility

• Good English proficiency

Benefits

• Technical leadership and ownership for an enterprise data migration from Hadoop to GCP

• Opportunity to shape the target Data Engineering architecture and future roadmap

• Role combining architecture decisions, ETL/ELT modernization, and team coordination