Data Engineer (Mobile AdTech & Big Data, GenAI)

Quick Facts

• Role: Data Engineer for mobile monetization, mobile ad tech, and big data/GenAI systems

Description

Build scalable real-time and batch data platforms powering mobile programmatic advertising, RTB bidding systems, attribution, campaign optimization, fraud detection, and real-time analytics. Process billions of mobile advertising events daily (ad requests, impressions, clicks, installs, conversions, in-app events, and auction logs) with low latency and high availability using Kafka, Spark, Hadoop, and SQL. Design GenAI-powered agents for analytics, operations, and data enrichment.

Responsibilities

• Design and build distributed data platforms processing billions of mobile ad events with low latency and high availability

• Build ultra-low-latency pipelines for the mobile event funnel, including OpenRTB bid request/response logging and auction analytics

• Architect real-time campaign pacing and budget delivery reacting to live auction signals within seconds

• Implement streaming pipelines with event-time semantics, windowed aggregations, watermarking, late/out-of-order handling, deduplication, and exactly-once/idempotent delivery across Kafka and Spark Structured Streaming

• Develop and optimize ETL/ELT pipelines and scalable data models for attribution, audience segmentation, fraud detection, and revenue analytics

• Tune large-scale batch jobs on Spark and Hadoop (HDFS/YARN) for aggregations, backfills, reprocessing, and reconciliation with SLAs and data-quality checks

• Design and optimize IVT and ad fraud detection systems (e.g., click spam, install hijacking, SDK spoofing) using rules and ML

• Build high-performance backend services and data processors (Java, Go, Rust, REST APIs, JDBC) for bidding logic and reporting APIs

• Operate and scale Kafka/Spark/Hadoop clusters in an on-premise data center (capacity planning, performance tuning, storage/compute efficiency, cost optimization)

• Develop GenAI-powered agents using LangChain, LlamaIndex, LangGraph, or custom orchestration frameworks

• Ensure systems are highly available, fault tolerant, and optimized for low latency and high throughput

• Participate in agile ceremonies and contribute to architecture/design/code reviews

Requirements

• 1–5+ years of professional experience in Java backend development and data engineering

• Strong computer science fundamentals (data structures, algorithms, distributed systems, software design)

• Hands-on experience with Java backend services using REST APIs and JDBC with relational databases

• Strong distributed real-time and batch pipeline experience using Spark, Kafka, Hadoop, and SQL on in-house data center infrastructure

• Experience with high-volume streaming using Spark Streaming or Kafka Streams

• Proficiency in Go and/or Rust for low-latency, high-throughput data services or stream processors (in addition to Java)

• Knowledge of real-time vs batch trade-offs, event-time processing, partitioning, schema evolution (Avro/Protobuf/Parquet), and data correctness at scale

• Experience with data warehousing and ETL/ELT design and distributed computing concepts

• Excellent verbal and written communication skills

• Strong collaboration skills across engineering, product, and customer-facing teams

• Bachelor’s degree in engineering or an equivalent degree from a recognized institute/university

Benefits

• Work on high-scale mobile ad event data infrastructure processing billions of events daily

• Contribute to real-time analytics, attribution, campaign pacing, and fraud/IVT detection plus GenAI automation for mobile app monetization

• Competitive compensation with performance-based incentives and strong career growth opportunities

• Hybrid schedule (3 days in office, 2 days remote)

• Benefits include paternity/maternity leave, healthcare insurance, broadband reimbursement, and catered lunches/snacks when in office