Senior Software Engineer, Data Ingestion

Quick Facts

• Role: Senior Software Engineer, Data Ingestion

• Focus: Building scalable streaming and batch ingestion pipelines into a Lakehouse

Description

You will help design and operate a data ingestion platform that ingests structured and unstructured datasets using both streaming and batch approaches. The work includes building Lakehouse production use cases, automating dataset lifecycle management, and improving reliability and performance with AI-assisted or agentic tooling. You will also lead technical initiatives end to end and mentor other engineers.

Requirements

• U.S. citizenship and willingness to undergo a background check for GovSlack authorization (no visa sponsorship)

• U.S. citizen (U.S. born or naturalized), no dual citizenship, and agreement to complete a U.S. federal government MBI for Moderate Public Trust

• 7+ years of software/data engineering experience

• Experience with streaming and lakehouse technologies (Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalents)

• Hands-on experience with batch data pipelines using Spark, Airflow, EMR, S3 or equivalents

• Proficiency in SQL, Python, Java/Scala, Go or equivalent

• Experience building robust distributed microservices with Kubernetes and Docker; AWS ECS/EKS, Terraform, Grafana and related tooling

Benefits

• Time off programs, medical, dental, vision

• Mental health support and paid parental leave

• Life and disability insurance

• 401(k) and employee stock purchasing program