Senior Python Engineer

Quick Facts

• Role: Senior Python Engineer (hybrid, 2x/week)

• Focus: Data quality solutions for a bank

• Tech stack: Python, SQL, Google Cloud Platform

Description

You will co-build solutions that detect and eliminate data quality problems at the point data enters banking systems. The role focuses on developing data processing and validation components in Python and SQL, and maintaining data pipelines on GCP. You’ll also analyze root causes of data quality issues and collaborate on data validation rules and monitoring.

Responsibilities

• Design and develop components for data processing and validation

• Build integration applications and processes in Python and SQL

• Implement mechanisms to control and monitor data quality

• Develop and maintain data pipelines on Google Cloud Platform

• Work with BigQuery, Dataproc, Dataplex, and Composer/Airflow

• Analyze data quality problems and identify their sources

• Collaborate with teams on defining and deploying validation rules

• Participate in designing and building the data validation process

• Develop and maintain code according to technical and architectural standards

• Use dbt in transformation and data quality control processes

Requirements

• Experience in roles such as Python Engineer / Data Engineer / Software Engineer on data-related projects

• Very good Python

• Very good SQL

• Practical experience with Google Cloud Platform

• Experience building and evolving data processing pipelines

• Knowledge of BigQuery

• Experience with Airflow / Composer

• Knowledge of at least part of the GCP services related to data processing and management

• Knowledge of dbt

• Knowledge of building, versioning, and managing application artifacts

• Strong analytical skills and ability to solve problems independently

Benefits

• Real impact on how data is processed, validated, and managed in a large organization