Senior Data Engineer with AI

AIT Global, Inc.

Dallas, TX • 39m ago • On-site

Senior

On-site

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Quick Facts

  • Role: Senior Data Engineer with AI
  • Work style: Hybrid (Dallas, TX)

Description

You will design, build, and maintain scalable data ingestion, transformation, orchestration, and delivery pipelines with strong hands-on AI capability. The role emphasizes event-driven and real-time/near-real-time data flows, workflow reliability (monitoring, testing, and SLA awareness), and collaboration with backend, BI, and ML teams. You will actively use AI-assisted dev tools (e.g., Claude, Cursor) to improve code quality and accelerate delivery.

Responsibilities

  • Build scalable data ingestion and processing pipelines using SQL and Spark-based and orchestration tools (e.g., Spark, Hadoop, Airflow, SnapLogic)
  • Optimize ETL/ELT workflows and resolve production bottlenecks before SLA impact
  • Integrate structured and unstructured data sources from internal/external systems
  • Design and implement event-driven, event bus-based pipelines (e.g., Kafka, AWS EventBridge, SNS/SQS)
  • Develop and maintain event producers, consumers, and stream processors for real-time data flows
  • Manage event schema design, schema registry, and versioning for backward compatibility
  • Monitor event bus health (lag, throughput, reliability) and respond to failures before SLA breach
  • Implement CI/CD for data workflows using Git plus Jenkins or GitHub Actions
  • Ensure job scheduling, monitoring, logging, and end-to-end testing for data pipelines
  • Debug and resolve production issues and participate in on-call rotation
  • Collaborate with backend and BI teams for API and data integration
  • Design schema definitions and support data warehouse/mart integration for analytics
  • Support large data volumes and onboarding of new data sources
  • Contribute to data architecture design across the data landscape
  • Write clean, reusable, well-tested Python and Shell code across the software development lifecycle
  • Gather functional requirements, develop technical specifications, and own project/test planning
  • Work in Agile/Scrum and help align team priorities
  • Use AI-assisted development tools to accelerate delivery and improve code quality

Requirements

  • Strong Python and Advanced SQL
  • Hands-on experience with PySpark or Scala
  • Unix scripting experience
  • Data orchestration experience (Airflow, SnapLogic, dbt, or equivalent)
  • Event bus/streaming experience (Kafka, AWS EventBridge, SNS/SQS, Kinesis, or similar)
  • Event-driven architecture experience including producers/consumers, schema registry, and dead-letter queues
  • AWS experience: EC2, EMR, S3, Athena, Glue; Databricks experience is included
  • Data lake/warehouse experience: Snowflake, Delta Lake, Redshift, BigQuery
  • CI/CD tooling experience: Git plus Jenkins or GitHub Actions; Docker
  • Experience integrating via APIs
  • Data quality mindset with SLA awareness and ownership
  • Agile/Scrum development experience
  • Ability to debug production issues and participate in on-call rotation

Benefits

  • Hybrid work arrangement
  • Opportunity to build scalable data infrastructure end-to-end (ingestion to delivery) with real-time streaming and event-driven design
  • AI-assisted engineering to accelerate delivery and improve code quality

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report