Senior Software Engineer

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and sky is the limit thinking in a cloud-enabled world. 

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the forefront of innovation. Our projects involve cutting edge technologies and problems. Joining these projects you will gain knowledge and experience about generative AI, large language models, large scale inference infrastructure, GPU optimization, AI applications, etc.   

The Model Scaling Platform team within AI Platform is responsible for managing all the inferencing capacity that powers Microsoft’s AI ambitions. Our fleet running state-of-the-art Open AI models provides the foundation for Microsoft’s various Copilots and Azure Open AI Service. We manage a vast number of premium AI accelerators and aim to leverage them in the most agile and efficient manner. Our services and the products they power are experiencing incredible growth. As part of this team, you will have opportunities to work across team boundaries and tackle hard system problems which translate to business impact that directly affect Microsoft’s bottom line.   

We are looking for a Senior Software Engineer to help build the next wave of capabilities for the inferencing platform. You will have the opportunity to work with a team of talented engineers in a fast-paced environment to lay the foundations for a new set of systems we are building. The successful candidate will possess technical prowess, be highly motivated, and have a methodological approach to problem solving.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

#AIPLATFORM# 

Required 
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python 

OR equivalent experience. 

Preferred 

• Bachelor's Degree in Computer Science 

• OR related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, 

• OR Python 

• OR Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python 

• OR equivalent experience. 

• Experience with distributed systems design and implementation.  

• Experience in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)  

• Experience with machine learning, artificial intelligence, and data science.  

• Experience working on large-scale projects or applications.  

• Familiarity with Azure  

• Familiarity with large language model and generative AI  

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay. 

Microsoft posts positions for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

#AIPLATFORM#

• Apply engineering principles for defining robust and maintainable architectures and designs.  

• Collaborate broadly across multiple disciplines from hardware designers to ML developers.  

• Help establish and drive the adoption of good coding standards and patterns.  

• Perform software development in C#, Python, and other languages.  

• Identify requirements, scope solutions, estimate work, schedule deliverables.  

• Other: Embody our Culture and Values