Principal Software Engineer

Quick Facts

• Role: Principal Software Engineer

• Focus: Architect and develop a large-scale, cloud-native AI-powered data platform

• Emphasis: Distributed systems, advanced data engineering, explainable analytics, and AI-assisted engineering workflows

Description

Architect highly scalable distributed data systems to process infrastructure telemetry and cloud product consumption/revenue data, turning massive volumes into trusted, explainable insights for capacity planning and operational and CapEx decisions. Define the technical vision across ingestion, processing, modeling, analytics serving, and governance for data correctness and reliability. Use AI-assisted and agentic workflows (e.g., coding agents and RAG) to accelerate development and modernization of complex data systems.

Responsibilities

• Architect scalable distributed data systems for infrastructure telemetry and consumption/revenue datasets

• Build reusable processing frameworks, canonical data models, and data contracts

• Establish incremental processing patterns, late-arriving handling, historical backfills, reconciliation, lineage, and schema evolution

• Lead architectural decisions across cloud data platforms, distributed compute, data lakes, and streaming/batch analytics serving

• Deliver actionable, explainable insights using AI and advanced analytics

• Design AI-powered engineering workflows using coding agents, RAG, domain knowledge repositories, and tool-integrated agents

• Apply AI to legacy codebases for dependency mapping, implementation planning, refactoring automation, and improved test generation

• Create agentic workflows for pipeline development, code reviews, failure triage, root-cause analysis, and operational knowledge discovery

• Implement governance and quality guardrails for AI-generated code (testing, validation, security reviews, production readiness)

• Drive improvements in engineering productivity, lead time, test automation, defect reduction, pipeline reliability, observability, and recovery time

Requirements

• Bachelor’s degree in Computer Science or related technical field

• 6+ years of technical engineering experience with coding in Scala, Python, C#, Java (or equivalent)

• Ability to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Benefits

• Base pay range (U.S.): USD $142,800–$274,800 per year; different ranges for specific locations (San Francisco Bay area and NYC metro)

• Other compensation: Eligibility for benefits and other compensation (details provided in the employer pay/benefits link)