Tech Lead Engineer (Agentic AI)

🏢 Summary: Principal AI/ML Engineer role focused on defining architecture and delivering a scalable Agentic AI Framework, combining location intelligence with advanced LLM-based agent systems. The position involves hands-on development of reusable agentic components, driving framework adoption, and leading cross-team technical direction. The engineer will productionize reliable, customer-facing AI systems with strong emphasis on architecture, MLOps, and operational excellence. 🗂️ Requirements: Extensive experience delivering production-grade AI/ML systems, Proven experience architecting extensible software frameworks for autonomous agents or distributed systems, Strong hands-on expertise in LLM engineering (prompting, orchestration, RAG, tool/function calling, fine-tuning), Experience building and operating agentic systems with evaluation and safety mechanisms, Strong system design and distributed systems knowledge, Proven MLOps experience (CI/CD, model versioning, testing, monitoring), Experience designing modular architectures with reusable components and standardized APIs, Hands-on use of AI tools in daily engineering workflows, Ability to implement AI-assisted engineering practices across development lifecycle 📃 Skills: Python, LLM, RAG, MLOps, CI/CD, APIs, SDKs, DistributedSystems, SystemDesign, Observability, FineTuning, Orchestration, Prompting, ToolCalling, ModelVersioning, Monitoring, Evaluation, Caching, LatencyOptimization 🏢 Description: What's the role? We are looking for a Principal AI/ML Engineer to drive the architecture and hands-on delivery of HERE’s Agentic AI Framework. In this role, you will define technical direction, build and evolve core agentic capabilities, and help product teams deliver reliable, scalable, customer-facing agent-based systems that combine HERE Location & Navigation intelligence with modern Agentic AI techniques. You will operate with a broad scope, influencing multiple teams through technical leadership, mentoring, and cross-functional alignment. Key Responsibilities: Own the reference architecture for HERE Agentic AI Framework (runtime, orchestration, and integration patterns) Design, implement, and productionize agentic components (planning, tool-use, memory/state, evaluation, and safety/guardrails) that can be re-used at scale Translate ambiguous problem statements into end-to-end technical solutions Drive framework adoption by providing high-quality SDKs/APIs, documentation, reference implementations, and support for product teams Lead technical reviews and decision-making forums; identify and retire architectural risks and tech debt across multiple initiatives Mentor engineers and act as a force multiplier through coaching, design guidance, and pragmatic engineering standards Who are you? Extensive experience as a senior/principal engineer delivering production-grade AI/ML systems (including ownership of design, implementation, rollout, and operations) Proficiency in architecting extensible software frameworks (specifically designed for autonomous agents or complex distributed systems). Be an adept at designing modular architectures that leverage reusable software components, abstraction layers, and standardized APIs to enable rapid agent deployment (by implementing scalable, decoupled logic that integrates diverse toolsets, memory modules, and LLM-orchestration patterns) Strong hands-on skills in modern ML/LLM engineering (prompting and orchestration patterns, RAG, tool/function calling, fine-tuning/adaptation where appropriate) Experience building and operating agentic systems, including evaluation strategies, reliability patterns, and safety/guardrails Solid software engineering fundamentals: system design, distributed systems, API design, observability, and performance optimization Proven MLOps experience (data/model versioning, CI/CD, automated testing, online/offline evaluation, monitoring, and incident response) Ability to lead through influence: drive alignment across teams, communicate trade-offs, and make high-quality technical decisions Excellent communication skills with the ability to explain complex topics to engineering, product, and executive stakeholders Mandatory hands-on experience using AI tools in day-to-day engineering activities to increase productivity and effectiveness Ability to embed AI-assisted workflows into engineering practices (coding, design reviews, testing, documentation, and operations) Preferred Qualifications Experience building customer-facing AI platforms/frameworks used by multiple teams, with clear patterns for reuse and governance Experience with cost-aware LLM serving, caching, and latency optimization at scale Familiarity with location-based services, navigation, or geospatial data products Contributions to open-source, publications, patents, or recognized technical leadership in the AI/ML community What We Offer: The opportunity to tackle meaningful and challenging problems A chance to continuously learn and stay on top of the latest technology trends Work that has real-world impact, shaping the future of mobility and technology Regular feedback to help you grow and succeed in your role A collaborative and supportive team environment where your contributions are valued Competitive salary plus bonus Flexible working hours and a hybrid working environment Medical coverage for you and your family This role is eligible for Creative Tax Incentive scheme in Poland” or KUP (Autorskie Koszty Uzyskania Przychodu) Option to work on a B2B contract (please note: benefits, bonus and KUP do not apply in this case) Change is HERE. Apply Now! #LI-AK8   #LI-HYBRID Life at HERE in Poland comes with a competitive total rewards package designed to support your health, wellbeing, and performance. This includes a base salary, a Short-Term Incentive (STI) bonus (percentage based on role), a creative tax advantage for eligible positions, private medical care (including dental), life insurance, a meal allowance, vision reimbursement, a remote work allowance (if applicable), access to MyBenefit and Multisport programs, and various wellbeing initiatives. Paid time off, sick leave, and parental leave are provided in accordance with the Polish Labor Code. As part of HERE Technologies employment process, candidates will be required to successfully complete a pre-employment screening process. This offer and any related claims are subject to the successful completion of a pre-employment screening. This will involve employment, education, and criminal verification if applicable. HERE is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, age, gender identity, sexual orientation, marital status, parental status, religion, sex, national origin, disability, veteran status, and other legally protected characteristics. Who are we? HERE Technologies is a location data and technology platform company. We empower our customers to achieve better outcomes – from helping a city manage its infrastructure or a business optimize its assets to guiding drivers to their destination safely. At HERE we take it upon ourselves to be the change we wish to see. We create solutions that fuel innovation, provide opportunity and foster inclusion to improve people’s lives. If you are inspired by an open world and driven to create positive change, join us. Learn more about us on our YouTube Channel. Apply for this job online Email this job to a friend Share on your newsfeed Connect With Us! Not ready to apply? Connect with us to receive industry updates and job alerts related to your interests!

🏢 Summary: Principal AI/ML Engineer role focused on defining architecture and delivering a scalable Agentic AI Framework, including runtime, orchestration, and reusable agentic components. The position combines hands-on development with technical leadership to enable product teams to build reliable, production-grade agent-based systems. It emphasizes extensible frameworks, LLM engineering, MLOps, and distributed system design. 🗂️ Requirements: Extensive experience delivering production-grade AI/ML systems, Experience architecting extensible software frameworks for autonomous agents or distributed systems, Strong hands-on experience with modern ML/LLM engineering, Experience building and operating agentic systems with evaluation and safety mechanisms, Solid knowledge of system design and distributed systems, Experience with API design and observability practices, Proven MLOps experience including CI/CD and model versioning, Hands-on use of AI tools in daily engineering workflows, Ability to design modular, reusable architectures with standardized APIs 📃 Skills: Python, LLM, RAG, MLOps, CI/CD, APIs, SDKs, DistributedSystems, Microservices, Orchestration, Prompting, FineTuning, Monitoring, Versioning, Caching, Optimization 🏢 Description: What's the role? We are looking for a Principal AI/ML Engineer to drive the architecture and hands-on delivery of HERE’s Agentic AI Framework. In this role, you will define technical direction, build and evolve core agentic capabilities, and help product teams deliver reliable, scalable, customer-facing agent-based systems that combine HERE Location & Navigation intelligence with modern Agentic AI techniques. You will operate with a broad scope, influencing multiple teams through technical leadership, mentoring, and cross-functional alignment. Key Responsibilities: Own the reference architecture for HERE Agentic AI Framework (runtime, orchestration, and integration patterns) Design, implement, and productionize agentic components (planning, tool-use, memory/state, evaluation, and safety/guardrails) that can be re-used at scale Translate ambiguous problem statements into end-to-end technical solutions Drive framework adoption by providing high-quality SDKs/APIs, documentation, reference implementations, and support for product teams Lead technical reviews and decision-making forums; identify and retire architectural risks and tech debt across multiple initiatives Mentor engineers and act as a force multiplier through coaching, design guidance, and pragmatic engineering standards Who are you? Extensive experience as a senior/principal engineer delivering production-grade AI/ML systems (including ownership of design, implementation, rollout, and operations) Proficiency in architecting extensible software frameworks (specifically designed for autonomous agents or complex distributed systems). Be an adept at designing modular architectures that leverage reusable software components, abstraction layers, and standardized APIs to enable rapid agent deployment (by implementing scalable, decoupled logic that integrates diverse toolsets, memory modules, and LLM-orchestration patterns) Strong hands-on skills in modern ML/LLM engineering (prompting and orchestration patterns, RAG, tool/function calling, fine-tuning/adaptation where appropriate) Experience building and operating agentic systems, including evaluation strategies, reliability patterns, and safety/guardrails Solid software engineering fundamentals: system design, distributed systems, API design, observability, and performance optimization Proven MLOps experience (data/model versioning, CI/CD, automated testing, online/offline evaluation, monitoring, and incident response) Ability to lead through influence: drive alignment across teams, communicate trade-offs, and make high-quality technical decisions Excellent communication skills with the ability to explain complex topics to engineering, product, and executive stakeholders Mandatory hands-on experience using AI tools in day-to-day engineering activities to increase productivity and effectiveness Ability to embed AI-assisted workflows into engineering practices (coding, design reviews, testing, documentation, and operations) Preferred Qualifications Experience building customer-facing AI platforms/frameworks used by multiple teams, with clear patterns for reuse and governance Experience with cost-aware LLM serving, caching, and latency optimization at scale Familiarity with location-based services, navigation, or geospatial data products Contributions to open-source, publications, patents, or recognized technical leadership in the AI/ML community What We Offer: The opportunity to tackle meaningful and challenging problems A chance to continuously learn and stay on top of the latest technology trends Work that has real-world impact, shaping the future of mobility and technology Regular feedback to help you grow and succeed in your role A collaborative and supportive team environment where your contributions are valued Competitive salary plus bonus Flexible working hours and a hybrid working environment Medical coverage for you and your family This role is eligible for Creative Tax Incentive scheme in Poland” or KUP (Autorskie Koszty Uzyskania Przychodu) Option to work on a B2B contract (please note: benefits, bonus and KUP do not apply in this case) Change is HERE. Apply Now! #LI-AK8   #LI-HYBRID Life at HERE in Poland comes with a competitive total rewards package designed to support your health, wellbeing, and performance. This includes a base salary, a Short-Term Incentive (STI) bonus (percentage based on role), a creative tax advantage for eligible positions, private medical care (including dental), life insurance, a meal allowance, vision reimbursement, a remote work allowance (if applicable), access to MyBenefit and Multisport programs, and various wellbeing initiatives. Paid time off, sick leave, and parental leave are provided in accordance with the Polish Labor Code. As part of HERE Technologies employment process, candidates will be required to successfully complete a pre-employment screening process. This offer and any related claims are subject to the successful completion of a pre-employment screening. This will involve employment, education, and criminal verification if applicable. HERE is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, age, gender identity, sexual orientation, marital status, parental status, religion, sex, national origin, disability, veteran status, and other legally protected characteristics. Who are we? HERE Technologies is a location data and technology platform company. We empower our customers to achieve better outcomes – from helping a city manage its infrastructure or a business optimize its assets to guiding drivers to their destination safely. At HERE we take it upon ourselves to be the change we wish to see. We create solutions that fuel innovation, provide opportunity and foster inclusion to improve people’s lives. If you are inspired by an open world and driven to create positive change, join us. Learn more about us on our YouTube Channel. Apply for this job online Email this job to a friend Share on your newsfeed Connect With Us! Not ready to apply? Connect with us to receive industry updates and job alerts related to your interests!

🏢 Summary: Opportunity to join a newly formed AI team in the banking sector to build a modern AI-native platform from scratch. The role focuses on designing and delivering production-grade solutions using LLMs, RAG, and agent-based architectures, while shaping AI strategy and architectural decisions. You will develop secure, transparent, and scalable AI systems that drive real business value in a regulated financial environment. 🗂️ Requirements: At least 3 years of experience in AI/ML, Minimum 5 years of experience in product development, Strong Python skills, Hands-on experience with LLMs, RAG, and agent-based systems in production, Experience with AI frameworks such as Agno, LangChain, LlamaIndex or similar, Knowledge of prompt engineering and AI model evaluation, Experience with Azure or AWS, Understanding of vector databases and embeddings, Experience with workflow orchestration tools (Temporal, Prefect, Airflow), Ability to design scalable and reliable AI solutions, Experience in model monitoring and MLOps practices, Ability to make architectural decisions and assess business value of AI, Fluent English 📃 Skills: Python, LLM, RAG, LangChain, LlamaIndex, Agno, Azure, AWS, Temporal, Prefect, Airflow, MLOps, Embeddings, VectorDB 🏢 Description: We are looking for an experienced Senior AI Engineer to join a newly formed AI team delivering a strategic initiative in the banking sector. This is a unique opportunity to co-create a modern AI-native platform from scratch and influence the direction of AI within the organisation. In this role, you will design and develop solutions based on LLMs, RAG systems, and agent-based architectures to support data integration and transformation processes. You will contribute to key decisions around AI strategy, model selection, architecture, and quality standards. We are seeking a candidate with strong technical skills and hands-on experience in building production-grade AI solutions—someone who understands where AI brings real business value and can deliver high-quality, transparent, and secure solutions in a financial environment. Your tasks Design and develop solutions based on LLMs, RAG, and agent-based architectures Co-create and execute an AI strategy for a modern banking platform Select models, frameworks, and approaches for production-grade AI solutions Build systems for data integration, transformation, and validation automation Define prompt engineering, model evaluation, and AI quality standards Develop monitoring, evaluation, and continuous improvement mechanisms Collaborate with engineering and product teams on new features Ensure high quality, transparency, and auditability of AI outputs Contribute to key architectural decisions and AI direction Mentor and share knowledge within the AI team Requirements At least 3 years in AI/ML and a minimum of 5 years in product development Strong Python skills Hands-on experience with LLMs, RAG, and agent-based systems in production Familiarity with frameworks such as Agno, LangChain, LlamaIndex, or similar Knowledge of prompt engineering and AI model evaluation Experience with Azure or AWS Understanding of vector databases and embeddings Experience with workflow orchestration tools (e.g., Temporal, Prefect, Airflow) Ability to design scalable, reliable AI solutions Experience in model monitoring and MLOps practices Capability to make architectural decisions and assess the business value of AI Strong collaboration skills with technical and business stakeholders Fluent English Nice-to-have requirements Previous work in financial services, fintech, or other regulated industries Knowledge of compliance, auditability, and AI security Familiarity with MLOps and large-scale ML/LLM deployments Experience fine-tuning open-source models for specific domains Proven track record in developing AI solutions for data platforms, analytics, or SaaS products Background in AI R&D projects Publications, conference speaking, or open-source contributions Experience building and scaling technical teams What we offer Great Place to Work since 2015 - it’s thanks to feedback from our workers that we get this special title and constantly implement new ideas Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022 Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more Comfortable workplace – class A offices or remote work Dozens of fascinating projects for prestigious brands from all over the world PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers Investment in your growth – meetups, webinars, training platform and technology blog – you choose Fantastic atmosphere created by all Sii Power People If you want to work on systems with high operational significance — apply now!

🏢 Summary: Lead AI Software Developer role focused on architecting and scaling AI-powered applications, backend services, and enterprise integrations. The position leads AI agent and LLM solution development, technical standards, mentoring, and cloud-based automation delivery. 🗂️ Requirements: Degree in Computer Science, AI, Data Science, or similar field, 8+ years of software engineering experience, 5+ years of production Python backend development, Experience building and scaling Python applications, Hands-on experience with AI Agents, RAG, and MCP, Experience with AWS or Azure, storage, databases, and AI services, Knowledge of containerization and Kubernetes, Experience with API integrations and enterprise system connectivity, Leadership and mentoring experience, Fluent Polish and English at B2 minimum, Willingness to travel internationally up to 10% 📃 Skills: Python, AWS, Azure, RAG, MCP, Kubernetes, APIs, Databases, Containers, LLMs 🏢 Description: We are seeking an experienced Lead AI Software Developer to design and scale AI-powered applications and integrations. In this role, you will architect backend systems, lead AI agent development, and ensure secure, scalable integration across cloud platforms and enterprise systems. Key Responsibilities - Design and maintain middleware, APIs, and connectors integrating AI agents with enterprise systems - Architect scalable backend services and cloud-based solutions (AWS/Azure) - Develop and optimize multi-agent workflows and adaptive decision logic - Fine-tune prompts and LLM-based solutions for domain-specific use cases - Lead code reviews, mentor developers, and define development best practices - Drive complex API integrations with internal and external AI platforms, including MCP servers - Remove technical roadblocks and ensure timely delivery - Collaborate with AI, Data, and Platform teams to optimize automation architectures - Maintain technical documentation and promote continuous improvement Requirements - Degree in Computer Science, AI, Data Science, or similar field - 8+ years of software engineering experience, including 5+ years of production Python backend development - Strong experience building and scaling Python applications - Hands-on experience with AI technologies: AI Agents, RAG, and MCP - Experience with cloud platforms (AWS or Azure), storage, databases, and AI services - Knowledge of containerization and Kubernetes - Experience with API integrations and enterprise system connectivity - Strong leadership and mentoring experience - Excellent communication skills; fluent in Polish and English (minimum B2); German is a plus - Willingness to travel internationally (approximately 10%) Nice to Have - Experience with LangChain, LangGraph, multi-agent systems, prompt engineering, and LLM fine-tuning What We Offer - Work in a global and innovative technology environment - Direct impact on enterprise AI and automation solutions - Professional development and access to training programs - Hybrid work model with flexible hours (central Wroclaw office) - Competitive benefits package, cafeteria system, CSR initiatives, and employee clubs

🏢 Summary: Lead AI Software Developer role focused on architecting and scaling AI-powered applications, backend systems, and multi-agent workflows across cloud and enterprise environments. The position involves designing secure integrations, optimizing LLM-based solutions, and leading technical delivery and best practices. It combines hands-on AI development with backend architecture and technical leadership. 🗂️ Requirements: Degree in Computer Science, AI, Data Science or related field, 8+ years of software engineering experience, 5+ years of Python backend development in production, Experience building and scaling Python applications, Hands-on experience with AI Agents, RAG and MCP, Experience with AWS or Azure cloud platforms, Experience with storage systems and databases, Knowledge of containerization and Kubernetes, Experience with API integrations and enterprise system connectivity, Leadership and mentoring experience 📃 Skills: Python, AWS, Azure, Kubernetes, RAG, MCP, APIs, Cloud, Databases, Containerization, AI, LLM 🏢 Description: We are seeking an experienced Lead AI Software Developer to design and scale AI-powered applications and integrations. In this role, you will architect backend systems, lead AI agent development, and ensure secure, scalable integration across cloud platforms and enterprise systems. Key Responsibilities Design and maintain middleware, APIs, and connectors integrating AI agents with enterprise systems Architect scalable backend services and cloud-based solutions (AWS/Azure) Develop and optimize multi-agent workflows and adaptive decision logic Fine-tune prompts and LLM-based solutions for domain-specific use cases Lead code reviews, mentor developers, and define development best practices Drive complex API integrations with internal and external AI platforms (incl. MCP servers) Remove technical roadblocks and ensure timely delivery Collaborate with AI, Data, and Platform teams to optimize automation architectures Maintain technical documentation and promote continuous improvement Requirements Degree in Computer Science, AI, Data Science, or similar field 8+ years of software engineering experience, including 5+ years of Python backend development (production) Strong experience building and scaling Python applications Hands-on experience with AI technologies (AI Agents, RAG, MCP) Experience with cloud platforms (AWS or Azure), storage, databases, and AI services Knowledge of containerization and Kubernetes Experience with API integrations and enterprise system connectivity Strong leadership and mentoring experience Excellent communication skills; fluent in Polish and English (min. B2); German is a plus Willingness to travel internationally (~10%) Nice to have: Experience with LangChain, LangGraph, multi-agent systems, prompt engineering, and LLM fine-tuning. What We Offer Work in a global and innovative technology environment Direct impact on enterprise AI and automation solutions Professional development and access to training programs Hybrid work model with flexible hours (central Wroclaw office) Competitive benefits package, cafeteria system, CSR initiatives, and employee clubs

🏢 Summary: Senior AI Agent Engineer role focused on building and deploying production-grade AI agents on top of frontier LLMs for supply chain operations. You will design agent harnesses, evaluations, orchestration, and supporting infrastructure, partnering closely with product and customers to take ideas from 0 to scaled deployment. The position combines deep hands-on LLM engineering with distributed systems and customer-embedded product development. 🗂️ Requirements: 5+ years of software engineering experience, 1+ year shipping LLM- or agent-based features to production, Strong proficiency in Python and/or TypeScript/Node.js, Experience designing APIs and distributed systems, Experience with PostgreSQL and data modeling, Hands-on experience with prompt engineering and evaluation frameworks, Experience with agent orchestration patterns and frontier model APIs 📃 Skills: Python, TypeScript, Node.js, LLMs, Prompting, PostgreSQL, APIs, DistributedSystems, Orchestration, Retrieval, MCP, WMS, TMS, ERP 🏢 Description: We are seeking an entrepreneurial Senior AI Agent Engineer to join as a founding member of the Agents team and build the next layer of an agentic platform that synthesizes marketplace data and operates autonomously inside customers' supply chain workflows. You will own the AI agents and the infrastructure they depend on, partnering closely with the CTO, product, and operators to take ideas from 0 to scaled deployments. About the Role You will embed deeply in customers' operations, design and ship production agent harnesses on top of frontier models, and turn field learnings into durable product. You will build the harnesses, evaluations, orchestration, and model strategy that power the broader product. Responsibilities - Embed with customers and operators to understand supply chain workflows and design agents that automate meaningful work. - Build production agent systems on frontier LLMs, including tool use, sub-agents, retrieval, structured outputs, MCP servers, and orchestration. - Own evaluation as a first-class discipline using datasets from real traces, rubrics, graders, experiments, and measurable improvements. - Architect the data, services, and APIs the agent layer depends on, integrating internal systems with customers' WMS, TMS, and ERP environments. - Codify repeatable deployment patterns to accelerate new customer rollouts. Qualifications - 5+ years of software engineering experience, with 1+ year shipping LLM- or agent-based features into production. - Strong proficiency in Python and/or TypeScript/Node.js. - Experience designing APIs, distributed systems, and data models in PostgreSQL. - Hands-on experience with production-scale prompt engineering, evaluation frameworks, orchestration patterns, and frontier model APIs. - Track record of building in fast, ambiguous environments. - Excellent written and verbal communication skills. Benefits - Start-up equity - Competitive salary - 100% paid health, dental, and vision coverage - Dinner provided via DoorDash, free DashPass, and stocked kitchen for NY employees - Commuter benefit - Gympass benefit - Additional benefits: One Medical membership, Gympass, HSA via Optum, Talkspace, HealthAdvocate, Teledoc Health Salary Range The compensation range for this position is $200,000 to $240,000, with potential exceptions based on candidate qualifications.

🏢 Summary: The role focuses on designing, developing, and deploying AI agents to automate business processes using Microsoft Power Platform tools. It involves building compliant, secure, and well-documented AI solutions while collaborating in an Agile environment. The position emphasizes continuous improvement, integration with existing systems, and adherence to ethical AI standards. 🗂️ Requirements: Proven experience in a similar AI engineering role, Experience in AI agents or chatbot development, Hands-on experience with Microsoft Copilot Studio or similar platforms, Technical knowledge of cloud platforms, Experience working with APIs, Understanding of ethical AI principles, Fluency in English 📃 Skills: AI, Chatbots, Copilot, PowerPlatform, Cloud, APIs, Security, Compliance, Agile, Documentation 🏢 Description: Summary The AI Agent Engineer will be pivotal in developing AI agents and automation solutions aimed at enhancing business processes within an agile framewor. This role focuses on leveraging Microsoft Power Platform tools to deliver compliant, efficient, and well-documented AI solutions. Main Responsibilities: Design, Develop, and Deploy AI Agents: Architect, build, and maintain intelligent agent solutions to automate business processes, improving user experiences. Leverage Microsoft Copilot Studio: Utilize Microsoft Copilot Studio to create, customize, and optimize AI agents, ensuring seamless integration with existing systems. Collaborate Across Teams: Work closely with business stakeholders, product owners, and technology teams to gather requirements and deliver robust AI-driven solutions. Continuous Improvement: Monitor agent performance, collect user feedback, and implement enhancements for accuracy and user satisfaction. Ensure Compliance and Security: Adhere to data privacy, security, and compliance standards throughout the AI agent lifecycle. Documentation and Knowledge Sharing: Produce clear technical documentation and best practices to support adoption and maintenance. Stay Current: Keep updated with advancements in AI and recommend new tools and approaches as appropriate. Key Requirements: Proven track record in a similar role. Experience in AI agents or chatbot development. Hands-on expertise with Microsoft Copilot Studio or similar platforms. Fluency in English with strong communication skills. Understanding of ethical AI principles. Technical knowledge of cloud platforms and APIs. Nice to Have: Experience with programming languages like Python, C#, or JavaScript Knowledge of automated testing frameworks Experience in Agile teams

🏢 Summary: Lead AI Testing Engineer role focused on building and driving QA strategy for AI-driven, knowledge graph, ontology, and RAG-based LLM systems. The position involves automating evaluation frameworks, validating graph and ontology layers, integrating testing into CI/CD pipelines, and ensuring end-to-end quality across backend, frontend, and AI components. The offer includes flexible remote work within Poland, professional development programs, certifications, and comprehensive benefits. 🗂️ Requirements: 8+ years of experience in software development, test automation and DevOps, Python test automation with pytest or equivalent, Experience with AI/ML library integration, Knowledge Graph or Data Ontology testing experience, OWL2, RDF, SPARQL, SHACL validation, GraphDB experience, SQL data validation, Cypher query language, REST API testing, Frontend test automation with Playwright or equivalent, Experience testing RAG-based Gen AI / LLM applications, Knowledge of Gen AI / LLM evaluation metrics, Automation framework development experience, CI/CD pipeline integration, Agile delivery experience, Git, Azure DevOps or JIRA, English proficiency at B2 level or higher, Hands-on experience with coding agents and agentic development 📃 Skills: Python, pytest, OWL2, RDF, SPARQL, SHACL, GraphDB, SQL, Cypher, REST, Playwright, Git, Azure, JIRA, Jenkins, Postman, Bruno, LLM, RAG, GenAI, CI/CD 🏢 Description: We are looking for a Lead AI Testing Engineer to drive the quality strategy for AI-driven and data migration initiatives spanning knowledge graphs, ontologies and RAG-based LLM features. You will define and execute QA practices across data ingestion, graph layers, rule evaluation engines and AI/LLM components while building automation frameworks that scale evaluation across complex, data-heavy systems. Responsibilities Design and automate evaluation of RAG-based and LLM-driven features including grounding, answer accuracy, determinism/reproducibility, precision, recall and hallucination rate Build test harnesses to scale evaluation beyond human-in-the-loop processes Create data-driven test suites for underwriting rules and validate rule execution via SPARQL evaluator, arithmetic/threshold logic and multi-condition scenarios Verify ontology schema correctness and instance accuracy against source data, perform reasoner consistency checks and SHACL validation Define and drive end-to-end QA strategy covering data ingestion, ontology/graph layer, rule evaluation engine, AI/LLM layer and integration with underwriting solutions Establish quality gates, acceptance criteria and test coverage models Maintain automation test suites across knowledge graph, data ontology layer, backend services and frontend layers Validate end-to-end flows across ontology, rule engine and decision output, perform contract testing and cross-system data consistency validation Integrate test suites into CI/CD pipelines and define release quality gates Champion automation-first and shift-left quality practices Leverage agentic AI and Gen AI tooling in testing and framework development Requirements 8+ years of experience in software development, testing automation and DevOps Proficiency in Python test automation using pytest or equivalent, scripting and AI/ML library integration Expertise in testing Knowledge Graph or Data Ontology solutions using OWL2, RDF and SPARQL Skills in SHACL validation and graph databases such as GraphDB, including ontology validation, entity/relationship integrity, reasoner consistency checks and graph query correctness Proven ability to define and drive QA strategy independently for complex data-heavy systems, including building automation frameworks and implementing quality gates Skills in data validation using SQL and graph query languages such as SPARQL and Cypher, along with understanding of deterministic vs probabilistic systems Background in backend and API testing (REST) covering data validation, integration and E2E testing Proficiency in frontend web application test automation using Playwright or equivalent Python-compatible framework Hands-on experience using coding agents and agentic development daily Demonstrated experience testing and evaluating RAG-based Gen AI / LLM applications including grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics such as precision, recall, criteria recall and efficiency, with proven ability to automate Gen AI/RAG evaluation at scale Experience in Agile delivery using Git and Azure DevOps or JIRA English proficiency at B2 level or higher Nice to have Skills in semantic search testing and evaluation Familiarity with Vector Database integration and retrieval validation Background in data science covering ML concepts, data pipelines or data engineering collaboration Proficiency in API tooling such as Postman and Bruno Experience with quality-gate implementation in CI/CD pipelines such as Azure DevOps or Jenkins We offer We gather like-minded people: Top tech minds driving innovation in AI, cloud and digital platform modernization Supportive team and agile, startup-like culture Hybrid by design mode and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Career development programs Thought leadership, mentoring, soft skills and well-being programs Certification (Anthropic, Gemini, GCP, Azure, AWS) English classes We cover it all: Stable pay Participation in the Employee Stock Purchase Plan with a 15% discount Benefits package (health insurance, multisport, shopping vouchers) Referral bonuses up to $2,000 Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more Corporate, social and well-being events Please, note: Benefits listed above are available to employees only We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually We will reach out to selected candidates exclusively EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Lead AI Testing Engineer role focused on defining and automating QA strategy for AI-driven, knowledge graph, ontology, and RAG-based LLM systems. The position involves building scalable test frameworks, validating graph and ontology data, and integrating automated quality gates into CI/CD pipelines across backend, frontend, and AI layers. Candidates should have strong expertise in Python automation, semantic technologies, GenAI evaluation, and end-to-end testing for complex data-heavy systems. 🗂️ Requirements: 8+ years in software development, test automation and DevOps, Proficiency in Python test automation, Experience with pytest or equivalent frameworks, Expertise in OWL2, RDF and SPARQL, Experience testing Knowledge Graph or Data Ontology solutions, Skills in SHACL validation, Experience with GraphDB or graph databases, Ability to define QA strategy for complex data-heavy systems, Experience building automation frameworks and quality gates, Skills in SQL, SPARQL and Cypher, Experience with REST API testing, Experience with frontend automation using Playwright or equivalent, Hands-on experience with coding agents and agentic development, Experience testing RAG-based GenAI and LLM applications, Knowledge of GenAI/LLM evaluation metrics, Ability to automate GenAI/RAG evaluation at scale, Experience with Git and Azure DevOps or JIRA, English proficiency at B2 level or higher 📃 Skills: Python, pytest, OWL2, RDF, SPARQL, SHACL, GraphDB, SQL, Cypher, REST, Playwright, Git, JIRA, Azure, Jenkins, Postman, Bruno, LLM, RAG, GenAI, CI/CD 🏢 Description: We are looking for a Lead AI Testing Engineer to drive the quality strategy for AI-driven and data migration initiatives spanning knowledge graphs, ontologies and RAG-based LLM features. You will define and execute QA practices across data ingestion, graph layers, rule evaluation engines and AI/LLM components while building automation frameworks that scale evaluation across complex, data-heavy systems. Responsibilities Design and automate evaluation of RAG-based and LLM-driven features including grounding, answer accuracy, determinism/reproducibility, precision, recall and hallucination rate Build test harnesses to scale evaluation beyond human-in-the-loop processes Create data-driven test suites for underwriting rules and validate rule execution via SPARQL evaluator, arithmetic/threshold logic and multi-condition scenarios Verify ontology schema correctness and instance accuracy against source data, perform reasoner consistency checks and SHACL validation Define and drive end-to-end QA strategy covering data ingestion, ontology/graph layer, rule evaluation engine, AI/LLM layer and integration with underwriting solutions Establish quality gates, acceptance criteria and test coverage models Maintain automation test suites across knowledge graph, data ontology layer, backend services and frontend layers Validate end-to-end flows across ontology, rule engine and decision output, perform contract testing and cross-system data consistency validation Integrate test suites into CI/CD pipelines and define release quality gates Champion automation-first and shift-left quality practices Leverage agentic AI and Gen AI tooling in testing and framework development Requirements 8+ years of experience in software development, testing automation and DevOps Proficiency in Python test automation using pytest or equivalent, scripting and AI/ML library integration Expertise in testing Knowledge Graph or Data Ontology solutions using OWL2, RDF and SPARQL Skills in SHACL validation and graph databases such as GraphDB, including ontology validation, entity/relationship integrity, reasoner consistency checks and graph query correctness Proven ability to define and drive QA strategy independently for complex data-heavy systems, including building automation frameworks and implementing quality gates Skills in data validation using SQL and graph query languages such as SPARQL and Cypher, along with understanding of deterministic vs probabilistic systems Background in backend and API testing (REST) covering data validation, integration and E2E testing Proficiency in frontend web application test automation using Playwright or equivalent Python-compatible framework Hands-on experience using coding agents and agentic development daily Demonstrated experience testing and evaluating RAG-based Gen AI / LLM applications including grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics such as precision, recall, criteria recall and efficiency, with proven ability to automate Gen AI/RAG evaluation at scale Experience in Agile delivery using Git and Azure DevOps or JIRA English proficiency at B2 level or higher Nice to have Skills in semantic search testing and evaluation Familiarity with Vector Database integration and retrieval validation Background in data science covering ML concepts, data pipelines or data engineering collaboration Proficiency in API tooling such as Postman and Bruno Experience with quality-gate implementation in CI/CD pipelines such as Azure DevOps or Jenkins We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Lead AI Testing Engineer role focused on defining and automating QA strategies for AI-driven systems, knowledge graphs, ontologies and RAG-based LLM applications. The position involves building scalable test frameworks, validating data-heavy systems, integrating quality gates into CI/CD pipelines and ensuring end-to-end quality across backend, frontend and AI layers. Candidates will work with graph technologies, GenAI evaluation frameworks and automation-first testing practices. 🗂️ Requirements: 8+ years of experience in software development, test automation and DevOps, Python test automation with pytest or equivalent, Experience with AI/ML library integration, Knowledge Graph or Data Ontology testing experience, OWL2, RDF, SPARQL, SHACL validation, GraphDB experience, QA strategy design for complex data-heavy systems, SQL and graph query language validation, Cypher, Backend and REST API testing, Frontend test automation with Playwright or equivalent, Experience with coding agents and agentic development, RAG-based Gen AI / LLM testing and evaluation, Gen AI / LLM evaluation frameworks and metrics, Automation of Gen AI/RAG evaluation at scale, Agile delivery experience, Git, Azure DevOps or JIRA, English proficiency B2 or higher 📃 Skills: Python, pytest, OWL2, RDF, SPARQL, SHACL, GraphDB, SQL, Cypher, REST, Playwright, RAG, LLM, Git, Azure, JIRA, Postman, Bruno, Jenkins, CI/CD 🏢 Description: We are looking for a Lead AI Testing Engineer to drive the quality strategy for AI-driven and data migration initiatives spanning knowledge graphs, ontologies and RAG-based LLM features. You will define and execute QA practices across data ingestion, graph layers, rule evaluation engines and AI/LLM components while building automation frameworks that scale evaluation across complex, data-heavy systems. Responsibilities Design and automate evaluation of RAG-based and LLM-driven features including grounding, answer accuracy, determinism/reproducibility, precision, recall and hallucination rate Build test harnesses to scale evaluation beyond human-in-the-loop processes Create data-driven test suites for underwriting rules and validate rule execution via SPARQL evaluator, arithmetic/threshold logic and multi-condition scenarios Verify ontology schema correctness and instance accuracy against source data, perform reasoner consistency checks and SHACL validation Define and drive end-to-end QA strategy covering data ingestion, ontology/graph layer, rule evaluation engine, AI/LLM layer and integration with underwriting solutions Establish quality gates, acceptance criteria and test coverage models Maintain automation test suites across knowledge graph, data ontology layer, backend services and frontend layers Validate end-to-end flows across ontology, rule engine and decision output, perform contract testing and cross-system data consistency validation Integrate test suites into CI/CD pipelines and define release quality gates Champion automation-first and shift-left quality practices Leverage agentic AI and Gen AI tooling in testing and framework development Requirements 8+ years of experience in software development, testing automation and DevOps Proficiency in Python test automation using pytest or equivalent, scripting and AI/ML library integration Expertise in testing Knowledge Graph or Data Ontology solutions using OWL2, RDF and SPARQL Skills in SHACL validation and graph databases such as GraphDB, including ontology validation, entity/relationship integrity, reasoner consistency checks and graph query correctness Proven ability to define and drive QA strategy independently for complex data-heavy systems, including building automation frameworks and implementing quality gates Skills in data validation using SQL and graph query languages such as SPARQL and Cypher, along with understanding of deterministic vs probabilistic systems Background in backend and API testing (REST) covering data validation, integration and E2E testing Proficiency in frontend web application test automation using Playwright or equivalent Python-compatible framework Hands-on experience using coding agents and agentic development daily Demonstrated experience testing and evaluating RAG-based Gen AI / LLM applications including grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics such as precision, recall, criteria recall and efficiency, with proven ability to automate Gen AI/RAG evaluation at scale Experience in Agile delivery using Git and Azure DevOps or JIRA English proficiency at B2 level or higher Nice to have Skills in semantic search testing and evaluation Familiarity with Vector Database integration and retrieval validation Background in data science covering ML concepts, data pipelines or data engineering collaboration Proficiency in API tooling such as Postman and Bruno Experience with quality-gate implementation in CI/CD pipelines such as Azure DevOps or Jenkins We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.