Machine Learning Engineer

Microsoft is pioneering the future of collaborative intelligence through AI-native agents that transform how people work together (e.g., through Microsoft Teams). As part of our applied research initiative, we are reimagining the foundations of teamwork—making collaboration more intuitive, productive, and adaptive across diverse modalities and contexts. We are seeking Machine Learning Engineers with deep expertise in large-scale model deployment, production-grade systems, and engineering excellence. (Machine Learning Engineer II and Senior Machine Learning Engineer positions available.)

As a Machine Learning Engineer, you will work alongside leading scientists to build and optimize infrastructure for frontier models—including large language models (LLM), small language models (SLM), and multimodal systems—leveraging both proprietary and open-source frameworks. Your responsibilities will span the full engineering lifecycle: from model training and serving to monitoring and continuous deployment, with a focus on reliability, performance, and scalability in real-world environments.

We value startup-style efficiency and practical problem-solving. We are seeking a curious, adaptable problem-solver who thrives on continuous learning, embraces changing priorities, and is motivated by creating meaningful impact. Candidates must be self-driven, able to write production-grade code and debug complex distributed systems, understand how to best leverage extensive graphics processing unit (GPU) resources, document engineering decisions, and demonstrate a track record in shipping ML systems at scale. The ability to quickly translate ideas into working code for rapid experimentation is a plus. You may include information about any individual who can serve as your referral in your application. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Required Qualifications

• Bachelor's Degree in Computer Science, Math, Electrical or Computer Engineering, Statistics, Econometrics, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience.
• 2+ years experience in developing AI models in Python and relevant ML libraries, and familiar with LLM and SLM.
• 2+ years experience with building ML infra and deploying ML models for scaled production services.
• 2+ years experience in shipping applied research to production, highlighting a track record of combining coding skills with advanced expertise in AI model development.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications 

• Master's Degree in Computer Science, Math, Electrical or Computer Engineering, Statistics, Econometrics, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Bachelor's Degree in Computer Science, Math, Electrical or Computer Engineering, Statistics, Econometrics, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience.
• Doctorate in Computer Science, Math, Electrical or Computer Engineering, Statistics, Econometrics, or related field.
• 3+ years experience with Python and relevant ML libraries (e.g., PyTorch).
• 3+ years experience with building ML infrastructure and developing and deploying ML models.
• 3+ years experience in coding and design, specifically in the development of AI models for scaled production services.
• 3+ years experience in shipping applied research to production, highlighting a track record of combining coding skills with advanced expertise in AI model development.
• Publication record in the areas of Large Language Models, Machine Learning, or Natural Language Processing.

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications and processes offers for these roles on an ongoing basis.

• Research and develop an understanding of the state-of-the-art tools, technologies, and methods being used in the research community and product groups.  
• Advance research agenda through one or more projects, yielding new algorithms, prototypes, theories, tools, methods, or collections of data. 
• Drive the team's strategic vision and align it with the overall company objectives.  
• Collaborate with stakeholders to define project goals, success criteria, and deliverables.