Databricks Data Ingestion Lead

emagine Polska

Copenhagen, Denmark • 1h ago • On-site

Senior

On-site

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Quick Facts

  • Start: ASAP

  • Duration: 3–4 months

  • Location: Copenhagen

Description

This role leads the ingestion workstream that reliably transfers all source data—starting with Oracle—into the bronze layer and provides a functional ingestion framework.

Responsibilities

  • Own the ingestion inventory (sources, tables, volumes, load patterns, and priorities).

  • Select the ingestion pattern per source (Lakeflow Connect, Auto Loader, or Azure Data Factory) and document the rationale.

  • Design and build a metadata-driven ingestion framework to add new sources via configuration instead of code changes.

  • Implement CDC and incremental loads, handling schema changes, deletions, and late-arriving data.

  • Ensure idempotency and replay using checkpoints, watermarks, and controlled reprocessing.

  • Set up monitoring, alerting, bronze-layer load SLAs, and data-quality gates.

  • Plan and execute cut-over operations per source, including parallel runs, reconciliation, and sign-offs.

  • Lead and mentor 2–3 data engineers; ensure framework and runbook handover.

Requirements

  • Extensive experience with Databricks and data ingestion frameworks

  • Proficiency in Oracle and related data management

  • Strong understanding of CDC and data load strategies

  • Experience with metadata-driven architecture design

  • Ability to lead and mentor engineering teams

Benefits

Not specified in the posting.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report