Embedded software tester

🏢 Summary: Internship in the Embedded department focused on supporting development and testing of embedded software and electronic systems for bionic prosthetic devices. The role involves working with microcontrollers, developing internal tools, and assisting in test automation and data analysis. It is an opportunity to gain hands-on experience in real technological projects under the guidance of experienced engineers. 🗂️ Requirements: Basic knowledge of C, C++ or Python, Interest in embedded systems, Interest in electronics or automation, Ability to work with microcontrollers, Willingness to use AI-based tools, Ability to support software testing, Basic understanding of electronic devices 📃 Skills: C, C++, Python, Embedded, Microcontrollers, Electronics, Automation, AI, Testing, DataAnalysis 🏢 Description: Szukamy praktykanta lub praktykantki do naszego działu Embedded. To dobra okazja dla osoby, która chce zdobyć pierwsze doświadczenie w pracy z systemami wbudowanymi, elektroniką, oraz tworzeniem narzędzi wspierających pracę zespołu inżynierskiego. O nas Aether Biomedical rozwija technologie bioniczne dla protetyki kończyn górnych. Tworzymy bioniczne protezy dłoni, które pomagają osobom po amputacjach zyskać większą samodzielność w codziennym życiu. W naszej pracy łączymy robotykę, elektronikę oraz narzędzia cyfrowe wspierające użytkowników i specjalistów protetyki. Zakres zadań: wsparcie zespołu w tworzeniu i testowaniu oprogramowania embedded, praca z mikrokontrolerami i urządzeniami elektronicznymi, tworzenie oraz rozwijanie wewnętrznych narzędzi wspierających testowanie, analizę danych i automatyzację pracy, programowanie w C, C++ oraz Pythonie, wykorzystywanie narzędzi AI do usprawniania codziennej pracy, analizy problemów i przygotowywania rozwiązań, pomoc przy przygotowywaniu stanowisk testowych. Oczekujemy: podstawowej znajomości języka C, C++ lub Python, zainteresowania systemami embedded, elektroniką lub automatyką, otwartości na korzystanie z nowoczesnych narzędzi, w tym rozwiązań opartych o AI, chęci nauki, samodzielności i zaangażowania, Oferujemy: praktyczną naukę pod okiem doświadczonych inżynierów, udział w realnych projektach technologicznych, przyjazną atmosferę i wsparcie zespołu, możliwość dalszej współpracy po zakończeniu praktyk.

🏢 Summary: On-site role for an experienced Manual Embedded Tester in the biotech industry, focused on testing embedded platforms and devices. The position involves test case design, execution, documentation, and defect tracking within regulated environments. The role requires strong expertise in embedded systems testing and adherence to software development standards. 🗂️ Requirements: Minimum 5 years of professional software testing experience, Hands-on experience with embedded systems testing, Experience testing embedded platforms or devices, Ability to design, write, and maintain test cases and documentation, Experience with JIRA, Confluence, Postman, Polarion or TestRail, Understanding of Software Development Lifecycle, Experience in requirements and specification analysis, Experience in test strategy implementation, Experience in test execution and defect reporting, On-site availability 📃 Skills: Embedded, Testing, JIRA, Confluence, Postman, Polarion, TestRail, SDLC, ISTQB, IEC62304 🏢 Description: We are looking for an experienced Manual Embedded Tester to join one of our projects from biotech industry. On site work model require. Essential Criteria: At least 5 years of hands-on professional experience in software testing, preferably with embedded systems. Direct involvement in testing embedded platforms or devices. Proficiency in designing, writing, and updating test cases and comprehensive test documentation. Experience with tools such as JIRA, Confluence, Postman, and documentation platforms (e.g. Polarion, TestRail). Solid understanding of the software development lifecycle. Strong analytical and communication skills, with the ability to work independently and with attention to detail. Experience in requirements and specification analysis, as well as in test strategy implementation. Proven track record in test execution and bug registration. Desirable Qualifications ISTQB Foundation Certificate Understanding of IEC 62304 standardisation

🏢 Summary: The role involves designing, developing, and maintaining automated testing solutions for embedded medical software and high-safety-critical mobile medical devices. You will build and support a Python-based test automation suite, ensure high quality and reliability standards, and maintain CI processes. The position requires close collaboration with QA and Analytics teams to define acceptance criteria and optimize testing strategies. 🗂️ Requirements: Minimum 5 years of professional QA experience, Proficiency in Python, Hands-on experience building and debugging automated tests, Experience with Python testing frameworks (e.g., unittest), Experience creating and maintaining automated functional tests, Understanding of coding standards and design patterns, Experience maintaining CI environments (TeamCity), Experience working with JIRA, Ability to collaborate with QA and Analytics teams 📃 Skills: Python, unittest, TeamCity, JIRA, CI, Automation, Testing, Embedded, Mobile 🏢 Description: Working as a QA Automation Engineer, you will: Design, build, run, and maintain automated testing aligned with strategies for embedded medical software Develop and support a mobile test automation suite for high-safety-critical medical devices Ensure testing quality levels that safeguard the reliability and patient safety of the device Assist in preparing, updating, and improving test specification materials Work closely with project stakeholders, including external QA and Analytics teams to define acceptance criteria, adopt effective testing strategies, and handle technical matters Maintain and improve the CI environment (TeamCity) Collect and interpret data from automated test runs and development activities About Chabre IT Services Chabre IT Services is a global professional IT services provider, building long-lasting relationships with Enterprises. We specialize in the delivery of tailor-made solutions,  smart outsourcing, try&hire, and success fee services. We are a smart IT boutique with unique knowledge, which will deliver your ideas into reality. About our Client Our client is a global technology partner focused on delivering cutting-edge digital health solutions. With over two decades of expertise, they collaborate with leading healthcare and life science companies to design and build innovative products that improve patient outcomes. Their teams combine deep medical domain knowledge with advanced engineering capabilities, ensuring that complex regulatory and technical requirements are met. By joining them, you will work in an environment that values innovation, quality, and real-world impact on healthcare. Qualifications have at least 5 years of professional experience in QA be proficient in Python, with hands-on experience building and debugging automated tests be familiar with unittest or other commonly used Python testing frameworks understand coding standards and design patterns, applying clean code and Python-specific best practices have experience creating, executing, and maintaining automated functional tests communicate clearly in written and spoken English use tools such as JIRA efficiently be open to cooperating and coordinating work with external QA and Analytics teams We offer Rate up to 150,00 PLN /h + VAT Hybrid work model (2-3 days per week from the office in Wrocław) Subsidy for peripherals in the amount of 500,00zł Working tool (MacBook Pro or Lenovo Legion 5) Co-financing of courses related to the position Benefits: MultiSport, Medicover

🏢 Summary: The offer is for an Embedded Systems Developer responsible for developing and enhancing embedded software solutions using RTOS and wireless communication technologies. The role focuses on implementing new features, testing, debugging, and contributing to architectural decisions in embedded projects. The position involves working with modern connectivity solutions and maintaining high code quality standards. 🗂️ Requirements: Proficiency in C/C++, Experience with FreeRTOS, Experience with Zephyr, Hands-on knowledge of BLE, Familiarity with Nordic Semiconductor chips, Knowledge of LTE CAT M1 connectivity, Knowledge of Ethernet, Comfortable working in Linux environments, Experience with GitLab 📃 Skills: C, C++, FreeRTOS, Zephyr, BLE, Nordic, LTE, Ethernet, Linux, GitLab 🏢 Description: About us xBerry – we are an R&D House gaining experience in delivering custom solutions for international clients since 2016. We provide extensive expertise in embedded systems, machine learning, AR/VR technology, and image processing. Requirements Must-have: Proficiency in C/C++ Experience with FreeRTOS Experience with Zephyr Hands-on knowledge of BLE (Bluetooth Low Energy) Familiarity with Nordic Semiconductor chips, LTE CAT M1 cellular connectivity and Ethernet Comfortable working in Linux environments Version control using GitLab Nice-to-have: Basic ability to read electronic schematics and work with hardware components Experience with hardware-level debugging Responsibilities Develop and implement new features for embedded systems Conduct developer-level testing and validation Suggest architectural and technical solutions, participate in estimations Maintain code quality, fix bugs, and support release processes Collaborate with QA engineers and external stakeholders What We Offer: Flexible working hours. Hybrid work option, (office in Wrocław) Medical care and MultiSport program. Team-building activities. Employment contract or B2B, depending on preferences.

🏢 Summary: Embedded Systems Developer role focused on building and enhancing firmware solutions using RTOS for international R&D projects. The position involves developing new features, testing and validating embedded software, and contributing to architectural decisions. The work includes close collaboration with QA and stakeholders while maintaining high code quality and release standards. 🗂️ Requirements: Proficiency in C/C++, Experience with FreeRTOS, Experience with Zephyr, Hands-on knowledge of BLE, Familiarity with Nordic Semiconductor chips, Knowledge of LTE CAT M1 connectivity, Knowledge of Ethernet, Experience working in Linux environments, Experience with GitLab version control 📃 Skills: C, C++, FreeRTOS, Zephyr, BLE, Nordic, LTE, Ethernet, Linux, GitLab 🏢 Description: About us xBerry – we are an R&D House gaining experience in delivering custom solutions for international clients since 2016. We provide extensive expertise in embedded systems, machine learning, AR/VR technology, and image processing. Requirements Must-have: Proficiency in C/C++ Experience with FreeRTOS Experience with Zephyr Hands-on knowledge of BLE (Bluetooth Low Energy) Familiarity with Nordic Semiconductor chips, LTE CAT M1 cellular connectivity and Ethernet Comfortable working in Linux environments Version control using GitLab Nice-to-have: Basic ability to read electronic schematics and work with hardware components Experience with hardware-level debugging Responsibilities Develop and implement new features for embedded systems Conduct developer-level testing and validation Suggest architectural and technical solutions, participate in estimations Maintain code quality, fix bugs, and support release processes Collaborate with QA engineers and external stakeholders What We Offer: Flexible working hours. Hybrid work option, (office in Wrocław) Medical care and MultiSport program. Team-building activities. Employment contract or B2B, depending on preferences.

🏢 Summary: The role involves end-to-end testing of hardware-integrated embedded systems, including firmware and Linux-based OS updates, network communication, and Wi-Fi integration. You will validate system upgrades, perform functional and regression testing, and troubleshoot hardware-software issues in collaboration with cross-functional engineering teams. The position also includes defect tracking, root cause analysis, and contribution to test automation initiatives. 🗂️ Requirements: Experience testing physical devices and hardware-integrated systems, Experience with embedded systems, Experience with Linux-based systems, Knowledge of firmware validation and OS upgrade testing, Experience testing Ethernet and Wi-Fi communication, Understanding of TCP/IP, DHCP, and routing basics, Ability to analyze logs and diagnose system-level issues, Experience with test documentation and defect tracking tools, Ability to perform functional, regression, integration, and system testing, English proficiency 📃 Skills: Embedded, Linux, Firmware, Ethernet, Wi-Fi, TCP/IP, DHCP, Routing, Networking, QA, Testing, Automation, Bugtracking 🏢 Description: Working as an Embedded QA Engineer, you will: Design, develop, and execute test plans and test cases for hardware-integrated systems Perform end-to-end testing of physical devices, including firmware and operating system updates (Linux-based systems) Validate system upgrades, including OS updates, new feature implementations, and performance optimizations Test and verify Wi-Fi module integration (transition from Ethernet-based communication to wireless connectivity) Conduct functional, regression, integration, and system-level testing Validate device communication protocols and network connectivity (Ethernet & Wi-Fi) Identify, document, and track defects using bug tracking tools Perform root cause analysis of hardware-software integration issues Collaborate closely with firmware, software, and hardware engineering teams Support troubleshooting activities and reproduce issues found in production or field environments Contribute to test automation initiatives where applicable Ensure compliance with quality standards and internal QA processes About Chabre IT Services Chabre IT Services is a global professional IT services provider, building long-lasting relationships with Enterprises. We specialize in the delivery of tailor-made solutions,  smart outsourcing, try&hire, and success fee services. We are a smart IT boutique with unique knowledge, which will deliver your ideas into reality. About our Client Our client is a global technology partner focused on delivering cutting-edge digital health solutions. With over two decades of expertise, they collaborate with leading healthcare and life science companies to design and build innovative products that improve patient outcomes. Their teams combine deep medical domain knowledge with advanced engineering capabilities, ensuring that complex regulatory and technical requirements are met. By joining them, you will work in an environment that values innovation, quality, and real-world impact on healthcare. Qualifications Proven experience in testing physical devices and hardware-integrated systems Experience working with embedded systems and Linux-based operating systems Understanding of firmware validation and OS upgrade testing Experience testing network communication (Ethernet and Wi-Fi) Practical knowledge of networking fundamentals (TCP/IP, DHCP, routing basics) Ability to analyze logs and diagnose system-level issues Experience with test documentation, defect tracking, and reporting tools Strong analytical and problem-solving skills Ability to work independently and collaboratively in cross-functional teams Excellent English skills We offer Rate: 140 - 160 PLN /h + VAT Hybrid work model (2-3 days per week from the office in Wrocław) Subsidy for peripherals in the amount of 500,00zł Working tool (MacBook Pro or Lenovo Legion 5) Co-financing of courses related to the position Benefits: MultiSport, Medicover

🏢 Summary: Senior QA Automation Engineer role focused on building and maintaining automated tests for web applications and embedded software supporting genetic experiment analysis in a regulated medical environment. The position involves UI and API test automation, framework development, and integration testing within cross-functional teams. Hybrid work model with B2B contract. 🗂️ Requirements: Commercial experience as QA Automation Engineer, Practical knowledge of Java or TypeScript, Experience in UI test automation, Experience in API testing, Experience with test automation frameworks, Ability to work in regulated environments, English proficiency for technical communication 📃 Skills: Java, TypeScript, Selenium, Selenide, Playwright, API, CI/CD, Jenkins, Git, GitLabCI, GitHubActions, AzureDevOps, Jira, Xray, TestRail, Zephyr, BDD, ISO62304, Scrum 🏢 Description: QA Automation Engineer (Senior) Szukamy testera automatyzującego, który dołączy do projektów związanych z rozwojem oprogramowania sterującego (embedded) dla urządzeń laboratoryjnych oraz aplikacji (webowych i mobilnych) do analizy i wizualizacji danych genetycznych. Tworzone rozwiązania wspierają m.in . procesy diagnostyki medycznej oraz badania naukowe. Lokalizacja: Wrocław (model hybrydowy – ok. 1–2 dni w tygodniu w biurze) Stawka: do 140 zł/h (B2B) Obowiązki Tworzenie i rozwój testów automatycznych dla aplikacji webowej, która jest częścią systemu służącego do przygotowywania, uruchamiania  i analizowania eksperymentów genowych Utrzymanie i rozwój frameworków testowych Testowanie API oraz integracji między systemami Współpraca z zespołem deweloperskim, analitykami i QA manualnymi Analiza wymagań oraz udział w projektowaniu scenariuszy testowych Dbanie o jakość oprogramowania w środowisku regulowanym Wymagania Doświadczenie jako QA Automation Engineer Praktyczna znajomość: Java oraz/lub TypeScript (mile widziana znajomość obu lub gotowość do przejścia z Javy na TypeScript) Doświadczenie w automatyzacji testów UI (obecnie Selenium/Selenide, docelowo Playwright) Znajomość testowania API Znajomość języka angielskiego umożliwiająca swobodną komunikację i pracę z dokumentacją Umiejętności analitycznego i krytycznego myślenia Dobra komunikacja i umiejętność pracy zespołowej Dociekliwość, poczucie odpowiedzialności (ownership) i chęć rozwoju Mile widziane: Doświadczenie w pracy z rozwiązaniami AI Znajomość narzędzi CI/CD (np. Jenkins, Git, GitLab CI, GitHub Actions, Azure DevOps) Doświadczenie z narzędziami do zarządzania testami i zadaniami (np. Jira, Xray, TestRail, Zephyr, Azure DevOps) Umiejętność tworzenia i analizy dokumentacji technicznej Doświadczenie w BDD Doświadczenie w projektach regulowanych (np. branża medyczna) Znajomość standardu ISO IEC 62304 Doświadczenie pracy w metodykach Scrum Ta rola nie jest dla Ciebie, ale masz znajomego, który by się sprawdził? Poleć go i zgarnij nawet 5000 zł. Referral Program: Talent from your network Nie zwlekaj i zaaplikuj już teraz! Nr ref. : 37/4/2026/r/3419

🏢 Summary: The role involves testing embedded software for industrial automation systems, focusing on creating unit and integration tests and improving test automation frameworks. The position includes code reviews, device-level testing, and close collaboration with software engineers to ensure high quality and reliability. 🗂️ Requirements: Minimum 2 years of experience in embedded software testing, Minimum 2 years of experience with white-box testing, Advanced knowledge of C, Experience with SIL or HIL testing, Ability to develop unit and integration tests, Experience with automatic and manual testing on embedded devices, Ability to create test cases and test plans, Ability to perform code reviews for embedded software, English proficiency at minimum B2 level, Willingness to travel occasionally to Germany, CV in English 📃 Skills: C, C++, Python, SIL, HIL, GIT, ALM, Tessy, MatLab, Simulink 🏢 Description: We are looking for an Embedded Software Tester to join our team developing industrial automation systems. In this role, you will be responsible for creating unit tests in C and integration tests for software modules. Additionally, you will provide expert support to software engineers throughout the testing process and help define and implement strategies to enhance the current testing framework, focusing on greater automation and improved efficiency. What you’ll do: Develop unit tests for code components Create integration tests for modules Perform code reviews for embedded software Conduct automatic and manual testing on devices (including setting up the test environment) Review requirements and create test cases and test plans Prepare comprehensive test documentation What we’re looking for: Minimum 2 years of experience in embedded software testing Minimum 2 years of experience with white-box testing Advanced knowledge of the C programming language Experience in SIL or HIL testing Strong focus on quality and reliability Excellent written and spoken English (minimum B2 level) Willingness to occasionally travel to company headquarters in Germany for training and project coordination CV in English Optional: Bachelor’s or master’s degree (Computer Science, Automation Control and Robotics, Mechatronics, Electrical Engineering or related) C++, Python programming experience Knowledge of version control tools (GIT) Knowledge in the use of ALM (Application Lifecycle Management) tools, software testing tool (e.g. Tessy), MatLab, Simulink What we offer: Stability and long-term growth opportunities within a global organization Close cooperation with colleagues from Germany Attractive benefits such as private healthcare, Multisport Participation in interesting projects Development opportunities and a wide range of training, including subsidised language courses Housing loans and a loan and assistance fund Annual bonus A referral bonus Flexible working hours Subsidies for commuting more than 30 km from PxCBS Parking space for employees Possibility to work remotely up to 8 days a month

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based applications through both manual and automated approaches. The position centers on building scalable LLM test harnesses, designing Gen AI evaluation frameworks, and ensuring reliability, accuracy, and performance of AI-driven systems. The role requires strong Python-based automation skills and experience with AI evaluation metrics, cloud environments, and CI/CD integration. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent testing frameworks, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics: precision, recall, criteria recall, efficiency, Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git, Copilot 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and evaluating GenAI features using advanced metrics. The role requires strong Python automation skills, experience with AI evaluation frameworks, and collaboration across product and engineering teams. 🗂️ Requirements: 5+ years of software QA experience, At least 1 year testing AI agents or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming for test automation, Experience with pytest or equivalent framework, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry, or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.