DataStage Data Engineer (ETL / Big Data)

Quick Facts

• Role: Senior Data Engineer focused on ETL and Big Data

• Domain: Market Abuse Surveillance and Compliance

Description

Design, develop, and maintain ETL processes that support Market Abuse Surveillance and regulatory compliance solutions. Build and test data transformation workflows using DataStage and Python, integrating multiple sources such as Kafka, XML files, and database links. Ensure data accuracy and compliance through validation, reconciliation, and production support.

Responsibilities

• Design, develop, and maintain ETL processes for compliance and surveillance use cases

• Create and test data transformation workflows using DataStage and Python

• Build data integration solutions that ingest from Kafka, XML, and databases

• Transform and prepare data to match required output file structures and business rules

• Deliver daily data feeds for a third-party SaaS platform used for market abuse surveillance

• Analyze, validate, and reconcile data for accuracy, completeness, and regulatory compliance

• Collaborate with Compliance, Surveillance, and IT teams to implement and enhance monitoring processes

• Perform ETL testing, troubleshooting, and defect resolution

• Participate in Agile ceremonies and delivery activities using Jira

• Support onboarding of new data sources and additional reporting/surveillance requirements

• Improve ETL processes, automation, and data quality controls

• Provide production support for data processing and integration issues

Requirements

• Hands-on experience with DataStage and Python for data transformation and ETL development

• Strong experience working with Oracle SQL

• Experience integrating and processing data from Kafka, XML, and other structured data sources

• Experience in Agile environments and using Jira for work management

• Strong IT background and knowledge of data integration, ETL, Python, DataStage, Kubernetes, and full-stack environments

• Strong analytical and problem-solving skills

• Ability to work effectively in a collaborative, cross-functional environment

• Fluent English (written and spoken)

Benefits

• Private medical care

• Co-financing for the sports card

• Ongoing support from a dedicated consultant

• Employee referral program