Senior Platform Software Engineer, AI & Data Platforms

Quick Facts

• Role: Senior Platform Software Engineer (AI & Data Platforms)

Description

You will design and build large-scale AI and big data platform capabilities, including streaming applications and big data semantic/hybrid search, across multiple cloud environments. The role focuses on distributed systems, production reliability, and automation—providing incident resolution, documentation, monitoring/alerting, and stability/security/scalability improvements. You will also integrate AI/ML and LLM capabilities into platform workflows using agentic orchestration and automated evaluation.

Responsibilities

• Design and build tools/frameworks based on agentic workflows for database management and performance tuning

• Integrate AI/ML capabilities such as intelligent configuration recommendations, workload-aware scheduling, and LLM-powered operator interfaces

• Design and scale production-grade multi-agent orchestration systems and stateful conversational runtimes

• Develop automated evaluation harnesses for continuous offline and online benchmarking and regression testing

• Integrate database management automation into CI/CD with automated testing, canary rollouts, and rollback

• Troubleshoot and fix production issues across applications, databases, networks, and proxies using monitoring/debugging tooling

• Build monitoring, alerting, and health-check systems and implement self-healing for known failure patterns

• Document and test development and deployment processes

• Support the AI-agent/MCP server stack and identify API performance and bottlenecks

• Collaborate with product/dev/users and stakeholders to plan and shape new features

• Review code and collaborate on pull requests

• Continuously improve uptime/availability and advance technical skills through experiments and code review

Requirements

• 5+ years of software development & deployment experience in Kubernetes

• 3+ years deploying applications using Ansible, Docker, Jenkins (or related tools)

• 5+ years building robust HTTP REST-based APIs and backend services

• Experience building highly available software services/platforms in big data

• Experience designing and managing large-scale data processing pipelines using Kafka, Spark, and streaming technologies

• Proficient in Python (optionally Go & Java)

• Bachelor’s in Computer Science or Computer Engineering (or equivalent experience)

Benefits

• Work on cutting-edge distributed computing and big data technologies at very large scale across multiple cloud environments

• Emphasis on operational excellence, automation, and continuous learning through experiments and collaboration