Spark / Data Lakehouse Developer

Ideamotive

Wrocław, DS, Poland • 33m ago • On-site

Senior

On-site

125 - 145 PLN/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Potential salary for Spark / Data Lakehouse Developer role

Improve your resume now

PLN 125 – PLN 145/year

Quick Facts

  • Role: Spark / Data Lakehouse Developer

  • Focus: Data Lakehouse layers, ODS reconciliation with MongoDB, and Apache Iceberg operations

  • Work model: Remote, with an office visit in Wrocław 1 day per month

Description

You will build and maintain Data Lakehouse data layers in a financial data platform, covering the full processing pipeline from raw data to curated “silver” and “gold” layers. The stack includes Apache Iceberg and MongoDB (ODS/Operational Data Store), with work across reconciliation, synchronization, table versioning, and Spark automation. You will also monitor solutions using Prometheus and Grafana.

Responsibilities

  • Design and implement data reconciliation solutions in the ODS layer using MongoDB

  • Synchronize data with source systems

  • Build and maintain Data Lakehouse layers (Delta Lake, Apache Iceberg, Hudi)

  • Manage versioned tables and optimize Iceberg writes (upserts, merge)

  • Automate Spark application build, test, and deployment processes using Jenkins

  • Monitor solutions with Prometheus and Grafana

Requirements

  • Minimum 4 years of practical experience with Apache Spark in production

  • Strong knowledge of PySpark, Spark SQL, DataFrames, and Structured Streaming

  • Experience with MongoDB: reading/writing via Spark Connector, document modeling, and indexing

  • Practical knowledge of Data Lakehouse architecture and tools such as Apache Iceberg

  • Ability to create CI/CD processes with Jenkins

  • Proficiency in Python programming

  • Knowledge of system monitoring using Prometheus and Grafana

  • Experience working in Agile methodologies (Scrum or Kanban) and familiarity with Jira and Confluence

Benefits

  • Remote work with a monthly office visit to Wrocław

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report