ACQA Big Data Engineer | Krakow / Wroclaw

About the role

We are looking for an experienced Big Data Engineer / Software Engineer to join the ACQA platform team.

This is primarily a software engineering role with a strong focus on Big Data and cloud technologies, rather than a traditional data engineering position. You will be responsible for developing and supporting production-grade solutions using Scala, Java, Apache Spark and Azure Databricks, as well as building the platform capabilities and automation that enable other engineering teams to work effectively.

Responsibilities

• Design, develop and maintain production-grade software using Scala, Java and Apache Spark
• Develop and support Big Data solutions running on Azure Databricks
• Build automation and tooling for managing Databricks environments
• Enable multiple engineering teams to develop and operate Big Data solutions on the ACQA platform
• Manage and enhance the Databricks platform, including monitoring and operational tooling
• Define and implement best practices for platform and runtime upgrades
• Develop and maintain CI/CD pipelines and automated deployment processes
• Work with containerised development, build and runtime environments, including Kubernetes
• Contribute to technical architecture and low-level design
• Implement effective testing, observability, monitoring and alerting practices
• Collaborate with globally distributed engineering teams and contribute to architectural and technical decisions

Requirements

• 6+ years of professional software engineering experience
• Strong commercial experience with Scala and/or Java
• Hands-on experience with Apache Spark and distributed data processing
• Experience with Azure Databricks or a comparable Spark-based platform
• Experience working with Microsoft Azure or another major public cloud provider
• Experience developing or operating CI/CD pipelines, preferably using GitLab
• Practical experience with containerisation and Kubernetes
• Strong understanding of software engineering principles and production systems
• Good communication and collaboration skills, with the ability to work effectively across multiple teams

Nice to have

• Production experience with Terraform, preferably in an Azure environment
• Python development experience
• Experience with observability, instrumentation, monitoring and alerting
• Knowledge of data structures, algorithms and information modelling
• Experience with technical architecture and low-level design
• Experience working in Agile development environments
• Experience working in large, globally distributed engineering teams

About the project

ACQA is a strategic platform built on Microsoft Azure, providing next-generation valuation and risk management services across Front Office, Finance and Risk.

The platform is designed around scalable and cost-efficient cloud infrastructure, open architecture, automated data lineage and transparent cost management. It provides a shared technology platform that enables multiple teams to build and operate their solutions in a consistent and efficient way.

As part of the team, you will contribute both to the development of Big Data solutions and to the underlying platform, tooling and automation used by other engineering teams.

The ideal candidate

We are looking for a software engineer with a strong Scala and Spark background who is comfortable working with production systems, distributed technologies and cloud platforms.

A traditional data engineering background is not required. The role is particularly suited to someone who enjoys software development, distributed systems, automation and platform engineering, with hands-on experience in Spark and ideally Azure Databricks.

Working model

Hybrid – 3 days per week from the office

Experience: 6+ years