Senior Data Engineer

Quick Facts

• Role: Senior Data Engineer

Description

You will design, develop, and maintain data ingestion, integration, and processing solutions, including data products, data warehouse solutions, and ETL/ELT processes. You’ll make technical and architectural decisions with Product Owners and Architects and ensure data quality, security, performance, and stability.

Responsibilities

• Design, develop, and maintain data ingestion, integration, and processing solutions
• Build and maintain data products, data warehouse solutions, and ETL/ELT processes
• Develop scalable data solutions using Azure, Databricks, Apache Spark, Azure Data Factory, and Delta Lake
• Make technical and architectural decisions with Product Owners and Architects
• Ensure data quality, security, performance, and solution stability
• Collaborate with stakeholders, Data Stewards, architects, and IT teams
• Develop automated testing, CI/CD pipelines, and deployment processes
• Promote best practices and modern approaches to data engineering

Requirements

• Several years of experience in Data Engineering and designing data products or data warehouse solutions
• Strong expertise in Python and SQL
• Expert knowledge of Apache Spark, Databricks, and modern data processing architectures
• Strong experience with Azure data services, including Azure Data Factory and Delta Lake
• Good understanding of data modelling, ETL/ELT processes, and data architecture
• Strong understanding of Azure technology choices, costs, and trade-offs
• Experience with API development and integration (plus)
• Knowledge of Master Data Management (MDM) (plus)
• Strong communication and collaboration with technical and business stakeholders

Benefits

Not specified in the provided posting.