Senior GCP Data Engineer

Quick Facts

• Collaboration scope: development and maintenance of data processing solutions on Google Cloud Platform (GCP)

Description

Build and maintain data processing solutions in a Google Cloud Platform environment. Design and implement batch and streaming data pipelines using BigQuery, Dataflow, Dataproc, Composer (Airflow), and Cloud Storage, and develop components in Python and SQL to support analytics and reporting. Automate deployments with Terraform and GitHub, manage artifacts in Google Artifact Registry, and ensure solutions are tested, monitored, and maintained in collaboration with analytics and architecture teams.

Responsibilities

• Develop and maintain GCP-based data processing solutions
• Design and build batch and streaming data pipelines
• Build components and integration/application logic in Python and SQL
• Build and optimize data structures supporting analytics and reporting
• Automate deployment workflows using Terraform and GitHub
• Manage application artifacts with Google Artifact Registry
• Test, monitor, and maintain the developed solutions
• Collaborate with analysts, architects, and project teams on business requirements
• Participate in architecture discussions and long-term data platform development

Requirements

• Experience designing and building cloud solutions on GCP
• Practical experience designing and implementing data processing systems and system integrations
• Very good knowledge of BigQuery, Dataproc, Composer (Airflow), and Cloud Storage
• Very good knowledge of Python and SQL
• Experience working with data pipelines and processing workflows
• Knowledge of GitHub and working with code repositories
• Experience with Google Artifact Registry
• Ability to deliver tasks independently while collaborating with a team
• Ability to work according to established technical and architectural standards
• Communication skills and willingness to share knowledge; ability to consider business needs during solution design

Benefits

• Hybrid work model with service delivery from Warsaw