Data Engineer

Quick Facts

• Role: Data Engineer (GCP migration & data processing)

Description

We are looking for a Data Engineer for a project involving the migration and development of data processing processes in Google Cloud Platform. The role includes working with large data volumes, building and optimizing processing pipelines, and migrating solutions from Oracle to GCP.

Responsibilities

• Design and develop Data Engineering solutions in GCP
• Migrate and rebuild data processing processes from Oracle/on-premise to GCP
• Design and develop batch and streaming processing
• Design data structures and models in BigQuery
• Create and optimize SQL queries for large data volumes
• Analyze and modify ETL processes in Informatica PowerCenter
• Implement data transformations, validation, and integration
• Prepare unit and integration tests
• Diagnose data processing and data quality issues
• Create and update technical documentation

Requirements

• Minimum 2 years of commercial experience in the area of data integration or data processing
• Practical experience with Google Cloud Platform
• Very good knowledge of BigQuery
• Experience with Cloud Storage and Pub/Sub
• Practical experience with Oracle
• Very good knowledge of SQL, including query optimization and working with large data volumes
• Developer experience with Informatica PowerCenter, including independent analysis and modification of ETL processes
• Knowledge of Python for data transformation and integration

Benefits

Not specified in the provided posting.