Senior Data Engineer (Databricks)

Quick Facts

• Role: Senior Data Engineer (Databricks)

• Domain: Financial applications (maintenance and new development)

Description

Work on maintaining and developing data solutions that support financial applications. The role focuses on hands-on work with Databricks, Python, Azure data services, and advanced SQL, covering both new developments and improvements to existing systems.

Responsibilities

• Develop, maintain, and optimize data solutions supporting financial applications

• Work extensively with Databricks to develop and maintain data processing and engineering solutions

• Develop data pipelines and integrations using Python

• Design, develop, and maintain Azure-based solutions using:

  • Azure Data Factory (ADF)
  • Azure Logic Apps
  • Azure Functions

• Write complex SQL queries and perform SQL optimization to ensure high performance and scalability

• Analyze, troubleshoot, and improve existing data processes by identifying performance bottlenecks

• Support the maintenance and continuous development of existing financial applications

• Collaborate with engineers, developers, analysts, and business stakeholders to deliver reliable data solutions

• Manage and maintain source code using Git repositories

• Contribute to technical documentation, code reviews, and development best practices

• Troubleshoot production issues and support the stability and reliability of data solutions

Requirements

• Strong commercial experience as a Data Engineer, preferably in a complex enterprise environment

• Strong hands-on experience with Databricks

• Very good Python programming skills

• Strong experience with Azure Data Factory (ADF)

• Experience with Azure Logic Apps and Azure Functions

• Advanced SQL skills, including query performance analysis and SQL optimization

• Experience working with and maintaining production data solutions

• Ability to troubleshoot complex technical issues and work independently

• Good communication and collaboration skills

Benefits

• Opportunity to work on maintenance and continuous development in the financial domain

• Hands-on work with Databricks and Azure data services to deliver reliable data solutions

• End-to-end involvement in data pipeline development, optimization, and production support