Senior Software Engineer (LLM & AI Platform)

Quick Facts

• Role: Senior Software Engineer (LLM & AI Platform) / LLM Application Engineer

• Scope: Build and own the LLM platform layer for internal tools and customer products (from PoC to production)

Description

You will own the development of a shared LLM platform—from proof of concept to production—for both internal tools and customer products. The focus is on LLM application engineering over foundation models, especially RAG, agents, orchestration, prompt engineering, and product integration. You will also integrate LLM APIs (OpenAI, Anthropic, Mistral, etc.) and build AI features such as conversational analysis, semantic search, and an intelligent alert feed.

Responsibilities

• Build the LLM platform layer: retrieval backend, embedding pipeline, and API design
• Integrate LLM APIs into internal and customer systems
• Develop AI features (conversational analyst, semantic search, intelligent alert feed)
• Implement agent architectures and MCP interfaces for enterprise integration
• Participate in prototypes and proof-of-concepts for new AI use cases

Requirements

• Degree in Computer Science, Business Informatics, Data Science, or a related field
• Production experience with RAG pipelines: vector DB, retrieval, chunking, evaluation/grounding
• Experience with LLM frameworks such as LangChain / LlamaIndex for orchestration, chains/agents, and tool-use
• LLM application engineering experience: prompt/context engineering, function-calling, agent architectures
• Backend experience with Node.js or Python (clean services, async, API design, data modeling)
• Frontend experience with React / TypeScript to build usable UI surfaces for AI features
• Data pipeline experience: ingestion, normalization, embeddings from structured and semi-structured sources
• MCP (Model Context Protocol) experience

Benefits

• Permanent role with attractive salary and annual bonus
• Work in a small, engaged, international team
• Autonomy and room to bring ideas and evolve
• Opportunity to shape products in a digitally growing environment
• Flexible working hours and option for mobile work
• Flat hierarchies and short decision paths
• Regular team events (at least once per quarter)
• JobRad, JobAuto & JobTicket
• Company pension plan (bAV) and additional company health coverage (bKV)
• Corporate benefits for technology, multimedia, travel, events, and more