AI Solution Architect

Andersen is hiring an AI Solution Architect in Germany to design and integrate scalable AI systems, supporting a major digital-transformation program and enabling modern, reliable AI-driven services. 

The customer is a large international technology provider delivering end-to-end digital solutions for enterprise-level organizations. The company focuses on IT consulting, cloud services, cybersecurity, and managed operations, supporting clients across various industries with complex digital-transformation needs. With decades of experience, the customer emphasizes innovation, reliability, and high security standards. 

The project is part of a large European digital transformation initiative aimed at integrating advanced AI into mission-critical systems. The team focuses on building scalable AI solutions, modernizing legacy architectures, and ensuring reliable deployment to support next-generation public and private sector services. 

Responsibilities: 

• Defining the overall architecture and technical strategy for AI/GenAI systems, ensuring scalability, robustness and alignment with organizational standards. 

• Selecting appropriate models, frameworks, serving stacks and infrastructure components for AI workloads. 

• Designing end-to-end RAG, vector search and agent-based AI solutions, including data flows, orchestration logic and system boundaries. 

• Overseeing model lifecycle processes: training, fine-tuning, evaluation, deployment, monitoring and continuous improvement. 

• Providing architectural guidance to development teams and ensuring consistent implementation across projects. 

• Preparing architectural documentation, diagrams, guidelines and decision records. 

• Collaborating with security, data, infrastructure and product teams to ensure compliance, reliability and performance. 

• Evaluating new AI technologies, tools and frameworks and assessing their relevance for the organization's ecosystem. 

• Reviewing complex incidents, performance issues and design flaws, providing direction for remediation and optimization. 

• Supporting procurement and vendor evaluation for AI platforms, hosting, data systems or model providers. 

Must-haves: 

• Experience in software engineering for 10+ years with at least 3-4 years in AI/ML solution design. 

• Strong expertise in designing LLM/GenAI architectures, including model selection, serving, orchestration and scaling. 

• Practical experience with Python and modern AI frameworks (PyTorch, TensorFlow, JAX) 

• Deep understanding of transformer models, embeddings, vector search and RAG architectures. 

• Experience designing agent-based systems and AI orchestration frameworks (LangGraph, LangChain, AutoGen or equivalents). 

• Hands-on experience with MLOps practices, model lifecycle management, versioning and monitoring. 

• Knowledge of vector databases (FAISS, Milvus, Pinecone, Chroma) and search optimization techniques. 

• Experience designing high-availability AI inference services using vLLM, Triton, TensorRT or similar serving technologies. 

• Solid understanding of cloud environments for AI workloads (AWS/GCP/Azure), GPU/accelerator usage and cost optimization. 

• Ability to translate business requirements into AI solution architectures, integration patterns and technical specifications. 

• Experience defining security, compliance and data governance standards for AI systems. 

• Strong communication skills for working with stakeholders, engineering teams and management. 

• Level of English – from Upper-Intermediate and above. 

• Level of German – from Intermediate+ and above. 

Reasons why this job would be interesting to you: 

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc.; 

• The opportunity to change the project and/or develop expertise in an interesting business domain; 

• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant; 

• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee; 

• The opportunity to earn additional up to 1,000 USD per month by participating in the company's activities; 

• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated; 

• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies); 

• Certification compensation (AWS, PMP, etc); 

• Referral program; 

• English courses; 

• Private health insurance and compensation for sports activities. 

  
  

Your personal data is protected in accordance with GDPR regulations. Learn more: https://andersenlab.com/privacy-policy

Join us!   

https://people.andersenlab.com/