Senior AI Performance Modeling Engineer

Quick Facts

• Role: Senior AI Performance Modeling Engineer (AI systems performance modeling for accelerators and large-scale training/inference)
• Work style: Hybrid (3 days per week in the office)

Description

Develop and enhance analytical performance models, simulation frameworks, and workload characterization tools for AI accelerators and large-scale AI systems. Model end-to-end training and inference workloads across compute, memory, and communication to identify bottlenecks, scalability limits, and architectural trade-offs while optimizing performance, perf/W, and TCO. Validate and improve modeling accuracy by correlating predictions with silicon measurements and software traces.

Responsibilities

• Develop analytical performance models and simulation frameworks for AI accelerators, GPU architectures, and large-scale AI systems
• Model AI training and inference workloads (compute kernels, attention, MoE, memory access patterns, communication operations)
• Evaluate architectural features including compute/memory hierarchies, interconnects, and collective communication mechanisms
• Perform workload mapping and parallelization analysis across tensor, pipeline, expert, data, and context parallelism
• Build system-level performance models to assess throughput, latency, perf/W, and TCO for accelerator/rack/cluster configurations
• Correlate analytical predictions with silicon measurements, kernel benchmarks, and software traces
• Automate performance modeling, design-space exploration, sensitivity analysis, and visualization tools
• Translate modeling insights into architecture recommendations and HW–SW co-design opportunities

Requirements

• Master’s degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 3+ years technical engineering experience OR Bachelor’s degree in the same fields AND 5+ years technical engineering experience OR equivalent experience
• Ability to meet security screening requirements, including passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Benefits

• Hybrid work model with three days per week in the office
• Eligible for benefits and other compensation (role-specific), with base pay range provided in the posting