Senior Software Engineer (AI Knowledge Retrieval)

Quick Facts

• Role: Senior Software Engineer (AI Knowledge Retrieval)

Description

Design, build, and operate scalable backend services integrating language models to expand Azure AI Search for complex, grounded knowledge retrieval. Develop GPU-backed integrations, evaluation tooling, and low-latency services for production AI experiences, including RAG, agentic retrieval, and LLM context engineering. Partner with Applied Science to take research advances into secure, reliable production systems.

Responsibilities

• Design, build, and maintain Azure backend services and associated APIs

• Integrate internal and external language models into production services

• Work with GPUs to support large-scale machine learning workloads

• Evaluate end-to-end production systems to ensure AI quality, reliability, and performance

• Build knowledge retrieval and data-layer AI integration (RAG, agentic retrieval, LLM context engineering)

• Determine when advanced reasoning models add value and integrate low-latency models when speed is critical

• Provide evaluation tooling and support for production integrations

• Collaborate on team plans, documentation, and communication

Requirements

• Bachelor’s degree in Computer Science or related technical field

• 4+ years technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python (or equivalent experience)

• Ability to meet security screening requirements and pass the Microsoft Cloud background check

Benefits

Certain roles may be eligible for benefits and other compensation.