AI-Driven Data Engineer (L5)

Quick Facts

• Role: AI-Driven Data Engineer (L5)

Description

Build and scale production-grade data pipelines and data infrastructure that turn business processes into governed, reusable data models for analytics and LLM/RAG workflows. Own data quality and observability, monitor and optimize pipeline throughput, and collaborate across the full data lifecycle to deliver datasets usable by scientists, BI engineers, and analysts.

Responsibilities

• Design, build, and maintain production ETL/ELT pipelines and data infrastructure using SQL and AWS services (e.g., Glue, S3, Spark, Athena).
• Create and optimize data models, vector schemas, and feature stores for Retrieval-Augmented Generation (RAG) and analytical workloads.
• Implement automated data validation, freshness/anomaly monitoring, lineage tracking, and alerting for downstream AI consumption.
• Optimize storage and query performance via partitioning, indexing, and resource-efficient designs across databases and distributed systems.
• Partner with analysts, data scientists, and engineers to define requirements and deliver curated datasets and self-service data products.
• Automate manual data operations, strengthen code/design reviews, and improve engineering best practices for data quality and lineage.

Benefits

• Sign-on payments and restricted stock units (RSUs).
• Comprehensive health insurance (medical, dental, vision, prescription) and Basic Life & AD&D, with option for Supplemental life.
• EAP, mental health support, Medical Advice Line, Flexible Spending Accounts.
• 401(k) matching, paid time off, and parental leave.