Senior Software Development Manager, Neuron Compiler

Quick Facts

• Role: Senior SDM, Neuron Graph Compiler (compiler engineering leadership for AWS Neuron)

• Focus: Develop, deploy, and scale a compiler targeting AWS Inferentia and Trainium

• Location: Toronto (relocation required)

Description

You will lead a team of compiler engineers building and scaling an AWS Neuron compiler for Inferentia and Trainium. You will drive innovations across resource management, scheduling, code generation, optimization, and instruction architectures, partnering hands-on with AWS ML services teams on pre-silicon design and new optimizations. Your goal is for the Neuron SDK to meet customer needs for high performance, low cost, and ease of use.

Responsibilities

• Design and code solutions to improve software architecture, implement automation, create metrics, and resolve root-cause defects

• Build high-impact solutions for a large customer base

• Participate in design discussions, code review, and communicate with internal and external stakeholders

• Work cross-functionally and provide technical input to business decisions

• Operate in an agile, startup-like development environment

Benefits

• Health insurance (medical, dental, vision, prescription) and life coverage options

• Employee Assistance Program and mental health support

• Flexible Spending Accounts

• 401(k) matching

• Paid time off and parental leave

• Sign-on payments and RSUs

Requirements

• 10+ years of engineering experience

• 5+ years of engineering team management experience

• 10+ years planning, designing, developing, and delivering consumer software

• Experience partnering with product or program management teams

• Experience managing multiple concurrent programs, projects, and development teams in an Agile environment

• Currently located in Toronto or willing to relocate to Toronto

Preferred Qualifications

• Experience designing and developing large-scale, high-traffic applications

• Experience with LLVM and GCC toolchains and code generation techniques for new hardware

• Knowledge of compiler internals from front end to runtime environment with emphasis on AI acceleration