Data Engineer (Spark, Azure)

Quick Facts

• Role: Data Engineer (Spark, Azure)

• Focus: Scalable enterprise search engine for internal data discovery

Description

You will design, build, and optimize an internal data search engine that helps stakeholders query and explore the firm’s data landscape in an intuitive, efficient, and reliable way. The role includes analyzing datasets and metadata to improve searchability, indexing, and relevance, and translating business search requirements into technical specifications. You will also ensure integration with the broader data ecosystem and monitor search performance and accuracy.

Responsibilities

• Design, build, and optimize an internal data search engine

• Analyze datasets and metadata to improve searchability, indexing, and relevance

• Gather and refine search and data discovery requirements with business and IT stakeholders

• Translate business needs into technical specifications and support Agile delivery

• Integrate with the broader data ecosystem (data, platform, analytics teams)

• Support testing and monitor search performance, accuracy, and usability

• Prepare analytical reports on data availability and search effectiveness

Requirements

• 3+ years of experience as a Data Engineer, including exposure to large-scale or Big Data environments

• Strong SQL and database systems knowledge (relational and NoSQL), including query optimization and schema design

• Strong programming skills in Python and Spark

• Experience with Azure cloud services, including Azure Databricks, Data Lake, and Azure Data Factory (beneficial)

• Strong communication and stakeholder management skills; ability to translate search-related needs into technical solutions

Benefits

• Engineering community, friendly team, flexible schedule, and opportunity to work remotely within Poland

• Chance to work abroad for up to 60 days annually and business-driven relocation opportunities

• Career roadmap, leadership development, career advising, soft skills, and well-being programs

• Certifications (GCP, Azure, AWS) and unlimited access to LinkedIn Learning, Get Abstract, and Cloud Guru

• English classes

• Stable income (Employment Contract or B2B) and participation in an Employee Stock Purchase Plan

• Benefits package including health insurance and Multisport; shopping vouchers

• Strategically located offices with entertainment/relaxation zones, sports tables, free snacks, and coffee

• Referral bonuses and corporate social/well-being events