Embedded software tester

🏢 Summary: On-site role for an experienced Manual Embedded Tester in the biotech industry, focused on testing embedded platforms and devices. The position involves test case design, execution, documentation, and defect tracking within regulated environments. The role requires strong expertise in embedded systems testing and adherence to software development standards. 🗂️ Requirements: Minimum 5 years of professional software testing experience, Hands-on experience with embedded systems testing, Experience testing embedded platforms or devices, Ability to design, write, and maintain test cases and documentation, Experience with JIRA, Confluence, Postman, Polarion or TestRail, Understanding of Software Development Lifecycle, Experience in requirements and specification analysis, Experience in test strategy implementation, Experience in test execution and defect reporting, On-site availability 📃 Skills: Embedded, Testing, JIRA, Confluence, Postman, Polarion, TestRail, SDLC, ISTQB, IEC62304 🏢 Description: We are looking for an experienced Manual Embedded Tester to join one of our projects from biotech industry. On site work model require. Essential Criteria: At least 5 years of hands-on professional experience in software testing, preferably with embedded systems. Direct involvement in testing embedded platforms or devices. Proficiency in designing, writing, and updating test cases and comprehensive test documentation. Experience with tools such as JIRA, Confluence, Postman, and documentation platforms (e.g. Polarion, TestRail). Solid understanding of the software development lifecycle. Strong analytical and communication skills, with the ability to work independently and with attention to detail. Experience in requirements and specification analysis, as well as in test strategy implementation. Proven track record in test execution and bug registration. Desirable Qualifications ISTQB Foundation Certificate Understanding of IEC 62304 standardisation

🏢 Summary: The offer is for a Manual System Test Engineer focused on system-level validation of industrial EtherNet/IP communication solutions in integrated hardware–software environments. The role involves performing manual tests, validating functionality and interoperability, and ensuring compliance with industrial standards within a Scrum team. It requires maintaining high-quality test documentation and managing defects using enterprise testing tools. 🗂️ Requirements: Strong knowledge of manual testing methodologies, Experience with system-level testing, Familiarity with EtherNet/IP protocol, Understanding of industrial automation systems, Ability to test integrated hardware-software environments, Experience with regression testing, Ability to use defect tracking and test management tools, Experience working in Scrum environment 📃 Skills: EtherNet/IP, PLC, Jira, qTest, Jama, Scrum, Regression, Testing, Automation, Networking 🏢 Description: We are recruiting for an established technology company specializing in sensing technologies, industrial safety solutions, and advanced communication components for automation systems. The company develops high-reliability products used in modern manufacturing environments and focuses on engineering excellence, system-level quality, and robust industrial standards. In this role, you will be responsible for performing manual system-level testing of EtherNet/IP in-cabinet solutions, validating the functionality and interoperability of industrial automation products, and maintaining high testing standards across hardware, firmware, and software layers. Key responsibilities Perform manual system-level tests for industrial EtherNet/IP communication solutions Validate functional, performance, and interoperability aspects of software releases Maintain and update test cases, test plans, and technical documentation Collaborate with cross-functional teams within a scaled Scrum environment Conduct regression testing and ensure compliance with industry standards Log defects and track their resolution using enterprise tools such as qTest, Jira, and Jama Ideal candidate profile Strong understanding of manual testing methodologies Familiarity with industrial automation and networking protocols (EtherNet/IP preferred) Ability to work with integrated hardware–software test environments Analytical mindset and high attention to detail Good communication skills and experience working in cross-functional teams Nice to have: Experience with industrial control systems Basic knowledge of PLC programming Conditions B2B contract Salary: 70 - 100 PLN net/h Hybrid work model - 3 days per week in Katowice Benefits: private medical care, life insurance, Multisport card Recruitment steps Phone call with Recruiter (20 - 30 min.) Interview with the client Feedback and decision

🏢 Summary: Oferta dla QA Engineera obejmująca pracę przy projektach FinTech, HealthTech i AI dla zagranicznych klientów, z naciskiem na testy automatyczne, wydajnościowe i koordynację zespołów testerskich. Praca w 100% zdalna z możliwością wyboru formy współpracy (B2B lub UoP) oraz dodatkowymi benefitami i budżetem szkoleniowym. 🗂️ Requirements: Minimum 3 lata doświadczenia jako QA Engineer, Doświadczenie w testach funkcjonalnych, Doświadczenie w testach integracyjnych, Doświadczenie w testach akceptacyjnych, Doświadczenie w testach automatycznych, Doświadczenie w testach wydajnościowych, Minimum 2 lata pracy z narzędziami do zarządzania testami i raportowania błędów, Minimum 2 lata pracy z SoapUI lub JMeter, Minimum 2 lata automatyzacji testów z Selenium WebDriver lub równoważnymi narzędziami, Minimum 2 lata doświadczenia w koordynowaniu zespołów testerskich, Minimum rok doświadczenia w planowaniu prac zespołu testerskiego, Znajomość SQL, Znajomość PL/SQL, Znajomość JIRA, Znajomość Confluence, Znajomość MS, Znajomość TestLink, Gotowość do udziału w rekrutacji w Warszawie 📃 Skills: QA, Selenium, WebDriver, SoapUI, JMeter, SQL, PLSQL, JIRA, Confluence, TestLink, MSOffice 🏢 Description: Tworzymy produkty z obszaru FinTech, HealthTech i AI (choć nie zamykamy się w sztywnych ramach). Pracujemy w modelach Team Augmentation, Full Outsourcing oraz end-to-end, głównie dla klientów spoza Polski. Interesuje nas konkret: kod, architektura i decyzje, które dowożą. Budujemy działające produkty, które przechodzą audyty, skalują się i realnie zdobywają rynek. Stawiamy na odpowiedzialność, techniczne myślenie i sensowną współpracę. Nasze must have - Minimum 3 lata doświadczenia jako QA Engineer obejmujące testy funkcjonalne, integracyjne, akceptacyjne, automatyczne i wydajnościowe - Co najmniej 2 lata doświadczenia w pracy z narzędziami do zarządzania testami i raportowania błędów - Minimum 2 lata doświadczenia w pracy z narzędziami wspomagającymi testy (SoapUI, JMeter) - Co najmniej 2 lata doświadczenia w automatyzacji testów z wykorzystaniem Selenium WebDriver lub narzędzi równoważnych - Minimum 2 lata doświadczenia w koordynowaniu pracy zespołów testerskich, w tym testerów biznesowych - Co najmniej rok doświadczenia w planowaniu prac zespołu testerskiego w procesie wytwarzania i utrzymania oprogramowania - Znajomość SQL / PL/SQL - Znajomość narzędzi: JIRA, Confluence, MS Office, TestLink - Gotowość do udziału w procesie rekrutacyjnym w siedzibie firmy w Warszawie w drugiej połowie sierpnia Co możemy Ci zaoferować - Współpracę B2B lub umowę o pracę - Ty wybierasz - 100% pracy zdalnej - Budżet szkoleniowy do 2500 zł netto rocznie - MacBooka i komplet niezbędnych narzędzi pracy - Kartę Multisport Plus - Prywatną opiekę medyczną (Luxmed)

🏢 Summary: Oferta dla QA Engineera obejmująca testy funkcjonalne, integracyjne, automatyczne i wydajnościowe przy projektach FinTech, HealthTech i AI realizowanych dla klientów zagranicznych. Rola wymaga doświadczenia w automatyzacji testów, koordynacji zespołów testerskich oraz pracy z narzędziami QA i bazami danych. Firma oferuje pracę zdalną, elastyczną formę współpracy oraz budżet szkoleniowy i benefity. 🗂️ Requirements: Minimum 3 lata doświadczenia jako QA Engineer, Doświadczenie w testach funkcjonalnych, Doświadczenie w testach integracyjnych, Doświadczenie w testach akceptacyjnych, Doświadczenie w testach automatycznych, Doświadczenie w testach wydajnościowych, Minimum 2 lata pracy z narzędziami do zarządzania testami i raportowania błędów, Minimum 2 lata pracy z SoapUI lub JMeter, Minimum 2 lata doświadczenia w automatyzacji testów z Selenium WebDriver lub równoważnymi narzędziami, Minimum 2 lata doświadczenia w koordynowaniu zespołów testerskich, Minimum rok doświadczenia w planowaniu pracy zespołu testerskiego, Znajomość SQL, Znajomość PL/SQL, Znajomość JIRA, Znajomość Confluence, Znajomość MS Office, Znajomość TestLink, Gotowość do udziału w procesie rekrutacyjnym w Warszawie 📃 Skills: QA, Selenium, SoapUI, JMeter, SQL, PLSQL, JIRA, Confluence, TestLink, MSOffice 🏢 Description: Tworzymy produkty z obszaru FinTech, HealthTech i AI (choć nie zamykamy się w sztywnych ramach). Pracujemy w modelach Team Augmentation, Full Outsourcing oraz end-to-end, głównie dla klientów spoza Polski. Interesuje nas konkret: kod, architektura i decyzje, które dowożą. Budujemy działające produkty, które przechodzą audyty, skalują się i realnie zdobywają rynek. Stawiamy na odpowiedzialność, techniczne myślenie i sensowną współpracę. Quick Facts - Współpraca B2B lub umowa o pracę - 100% pracy zdalnej - Budżet szkoleniowy do 2500 zł netto rocznie - MacBook i niezbędne narzędzia pracy - Karta Multisport Plus - Prywatna opieka medyczna (Luxmed) Nasze must have - Minimum 3 lata doświadczenia jako QA Engineer obejmujące testy funkcjonalne, integracyjne, akceptacyjne, automatyczne i wydajnościowe - Co najmniej 2 lata doświadczenia w pracy z narzędziami do zarządzania testami i raportowania błędów - Minimum 2 lata doświadczenia w pracy z narzędziami wspomagającymi testy (SoapUI, JMeter) - Co najmniej 2 lata doświadczenia w automatyzacji testów z wykorzystaniem Selenium WebDriver lub narzędzi równoważnych - Minimum 2 lata doświadczenia w koordynowaniu pracy zespołów testerskich, w tym testerów biznesowych - Co najmniej rok doświadczenia w planowaniu prac zespołu testerskiego w procesie wytwarzania i utrzymania oprogramowania - Znajomość SQL / PL/SQL - Znajomość narzędzi: JIRA, Confluence, MS Office, TestLink - Gotowość do udziału w procesie rekrutacyjnym w siedzibie firmy w Warszawie w drugiej połowie sierpnia

🏢 Summary: Senior Test Engineer role focused on designing and developing automated tests for embedded systems in industrial automation projects. The position involves building Python-based test frameworks and validating system functionality in Unix/Linux/QNX environments, with emphasis on networking and communication protocols. Hybrid work model with B2B contract. 🗂️ Requirements: 5+ years of embedded systems testing experience, Proficiency in Python, Experience with test automation frameworks, Hands-on experience with Unix/Linux/QNX, Strong knowledge of networking concepts, Understanding of communication protocols 📃 Skills: Python, Unix, Linux, QNX, Networking, Protocols, Automation, Embedded 🏢 Description: We are looking for an experienced Senior Test Engineer to join the team of our client – a global industrial automation company – working on cutting-edge solutions that support the automation of industrial processes. Key responsibilities Designing and developing automated tests for embedded systems Building and maintaining test automation frameworks in Python Testing system components in Unix/Linux/QNX environments Validating system functionality with a focus on network protocols and communication Ideal candidate profile 5+ years of experience in embedded systems testing Proficiency in Python and test automation tools Hands-on experience with Unix/Linux/QNX environments Solid understanding of networking concepts and communication protocols English proficiency at B2 level or higher (daily communication with international teams) Conditions B2B contract: 120 – 130 PLN / h net + VAT Hybrid work model (Katowice office: 3 days onsite, 2 days remote) Benefits: private medical care, sport card, life insurance Recruitment steps Phone call with Recruiter (Aleksandra) Technical verification call by the client Interview with the client Feedback and decision

🏢 Summary: Senior QA Automation & Performance Test Engineer role focused on designing, developing, and executing automated and performance test solutions to ensure quality, scalability, and reliability of complex software systems. The position involves owning non-functional testing activities, building automation frameworks, and optimizing application performance across web, microservices, and cloud environments. The role requires strong programming expertise and hands-on experience with enterprise-grade testing and monitoring tools. 🗂️ Requirements: Strong proficiency in Java, Strong proficiency in C, Experience with LoadRunner Enterprise, Experience with Selenium or Cucumber, Hands-on experience in automation testing across web, microservices, databases, and cloud applications, Experience with CI/CD pipelines, Experience building performance and load testing frameworks, Experience with logging and APM tools, Knowledge of Linux performance tuning, Knowledge of database optimisation techniques, Experience with WebSphere, Experience with Tomcat, Ability to analyse logs and database queries, Experience managing test and defect lifecycle in Agile and Waterfall 📃 Skills: Java, C, LoadRunner, Selenium, Cucumber, Gatling, Locust, AppDynamics, AppInsights, Splunk, Linux, SQL, WebSphere, Tomcat, CI/CD 🏢 Description: We are seeking a highly skilled Senior QA Automation & Performance Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, maintaining, and executing automated and performance test scripts to ensure the quality, reliability, and scalability of our software products. This role requires a strong background in software development, test automation frameworks, performance testing, and a passion for delivering high-quality solutions. This position offers a flex-hybrid model of work, with 3 days per week working from the office located in Wroclaw or Krakow. Responsibilities Collaborate with cross-functional teams to understand software requirements and develop comprehensive test plans, cases, and scenarios Design, develop, and maintain automated and performance test scripts using industry-standard tools and frameworks Own and manage all non-functional testing activities, including performance, stress, load, and regression testing Continuously research and evaluate new testing technologies, tools, and methodologies to improve efficiency and effectiveness Advocate for best practices in testing and quality assurance, contributing to process improvement Develop custom tools and integrate with existing tools to increase engineering productivity Ensure quality, security, reliability, and compliance by testing both functional and non-functional requirements Coordinate test activities within the pod and across other test managers as required Enable and drive a culture of 'automation-first' in the QA space Perform in-sprint automation testing and build regression test suites Analyse errors using logs, database queries, legacy and Unix file systems, etc Expertly manage the complete test and defect lifecycle across agile and waterfall methodologies Generate test reports and share status across multiple levels Capacity planning and management of web, microservices, and mobile applications Performance monitoring and tuning of applications using tools like AppDynamics, AppInsights, Splunk Use quantitative methods to identify performance and throughput bottlenecks Work on large-scale migration projects for financial institutions’ core platforms Requirements Strong proficiency in programming languages such as Java and C Strong experience in LoadRunner Enterprise (2023 or earlier) Experience with test automation frameworks such as Selenium, Cucumber, or similar BDD frameworks Hands-on experience with automation testing for desktop, web, data services, microservices, database, ETL, cloud-based applications, middleware, and OS Experience with CI/CD pipelines Expertise in building frameworks for performance and load tests using tools like Gatling, Locust, LoadRunner Experience with logging and APM tools (AppDynamics, AppInsights, Splunk) Good understanding of Linux performance tuning and database optimisation techniques Experience with WebSphere and Tomcat application servers Strong analytical skills, proactive, detail-oriented, and comfortable working in dynamic, fast-paced environments Excellent communicator with strong written and verbal English skills We offer/Benefits We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: The offer is for a Full Stack QA Engineer responsible for ensuring end-to-end quality of SaaS/web applications through manual testing, automation, and modern agentic AI practices. The role focuses on building robust UI and API test frameworks, integrating automated suites into CI/CD pipelines, and developing QA harnesses for complex workflows and integrations. It involves close collaboration with Product and Engineering to improve testability, quality standards, and release reliability. 🗂️ Requirements: 4–6+ years testing SaaS/web applications, 2+ years building UI and API automation frameworks, Experience with Playwright, Cypress, Postman, Insomnia, or Newman, Experience building tooling for test execution, simulation, or data management, Ability to analyze SQL queries, logs, and browser developer tools, Experience with Git-based workflows and CI/CD pipelines 📃 Skills: Playwright, Cypress, Postman, Insomnia, Newman, SQL, Git, CI/CD, Docker, Cloud, k6, JMeter, Lighthouse, axe, AI, SaaS, API, UI 🏢 Description: Role Description We're looking for a QA Engineer! Anitech Solutions Ltd is a dynamic IT services provider delivering innovative and unique AI technology solutions to businesses across multiple sectors. Alongside our core IT services, we are proud to offer tapybl, our flagship education-focused software product designed to enhance learning and engagement. We are looking for a highly capable Full Stack QA Engineer with a strong blend of manual testing, test automation, and modern agentic AI practices. Responsibilities Build and maintain end-to-end test coverage across UI, APIs, data, integrations, and core product workflows using a pragmatic test pyramid approach. Translate requirements and acceptance criteria into risk-based test plans and coverage maps. Create and execute test cases for new features, bug fixes, change requests, and release validation. Perform exploratory testing to uncover edge cases and integration risks, logging high-quality defects backed by technical evidence (logs, HAR files, browser traces). Build stable automated suites using modern agentic AI practices and integrate them directly into CI/CD pipelines with parallelization and results gating. Develop QA harnesses for testing, simulation, validation, execution, and monitoring of complex workflows, integrations, or regulated product flows. Maintain living QA documentation, including test plans, suites, runbooks, reports, and release readiness notes. Partner with Product and Engineering to improve acceptance criteria, optimize testability, track quality KPIs, and define team QA standards. Required Qualifications 4–6+ years testing SaaS/web applications (including deep manual testing) and 2+ years building UI/API automation frameworks. Hands-on experience with modern tools like Playwright, Cypress, Postman, Insomnia, or Newman. Experience building tooling for test execution environments, simulation, data management, or quality gates. Comfortable analyzing basic SQL queries, logs, browser developer tools, Git-based workflows, and CI artifacts. Strong bias for evidence, clear documentation, and the ability to make sound QA tradeoffs in fast-paced delivery environments. Preferred Qualifications Experience with modern agentic AI practices for QA, including prompt design, evaluation harnesses, and testing AI/ML features. Experience with workflow orchestration, event-driven architectures, or containerized test environments (Docker, Cloud). Background building internal QA platforms, evaluation frameworks, or release dashboards. Familiarity with performance testing (k6, JMeter) or accessibility testing (Lighthouse, axe). What Success Looks Like You can validate product features end-to-end across UI, API, data, integrations, and release workflows. You can build robust QA harnesses that make complex systems easier to test, measure, debug, and release confidently. You improve both product quality and engineering leverage. You help the team move faster by making regression, release validation, defect evidence, and quality reporting repeatable and reliable. You reduce manual repetition, flaky automation, unclear defects, and late-stage release risk. Working conditions Fully-remote based in Poland B2B

🏢 Summary: The offer is for a QA Automation Engineer to build and expand automated testing for a Python-based healthcare application supporting doctors in treatment decisions. The role focuses on creating and maintaining test automation frameworks, increasing test coverage, and improving system reliability. You will work within an Agile team transitioning from manual to automated testing. 🗂️ Requirements: 4+ years of experience in QA Engineering or Test Automation, Hands-on experience with test automation, Programming skills in Python, JavaScript or TypeScript, Basic SQL knowledge, Knowledge of Agile and Scrum, Knowledge of testing methodologies, English level B2 or higher 📃 Skills: Python, JavaScript, TypeScript, SQL, Agile, Scrum, ISTQB, JIRA, Git 🏢 Description: We are looking for a QA Automation Engineer to join a project focused on developing a Python-based application that supports doctors in their daily work across various healthcare institutions. The system analyzes patient data, including age, gender, and medical history, to assist in making informed treatment decisions. Currently, the team relies on manual testing and is in the process of expanding its quality assurance capabilities by introducing test automation. In this role, you will play a key part in building and maintaining automated testing frameworks, improving test coverage, and enhancing the overall reliability of the application. Qualification : 4+ years of experience in QA Engineering or Test Automation Hands‑on experience with test automation Good programming skills in Python, JavaScript or TypeScript Basic SQL knowledge Knowledge of Agile, Scrum ISTQB knowledge Have very good English (at least B2) Experience in testing methodologies Nice to have: Knowledge of JIRA Basic knowledge of version control systems Willingness to constantly develop skills Strong analytical and problem-solving skills Really high attention to detail and precision ISTQB certificate is a plus Please note that the interview process is divided into four parts: Technical phone screening~30 minutes Technical interview~2 hours Non-technical call with hiring manager~45 minutes Optional: call with client for which you will be working Perks, Snacks & Everything Nice :) Work Environment & Flexibility Top-quality equipment to support your work Flexible working hours Remote work option Exciting and challenging projects with international teams Learning & Development English lessons with a native speaker Dedicated training budget for personal and professional growth Health & Well-being Private medical insurance Multisport card Air-conditioned workspace Showers available at the office Food & Comfort Lunches from Kraków’s top restaurants delivered to the office or a refund of the budget allocated for it Fully stocked kitchen with drinks, fruit, and snacks Lifestyle & Fun No dress code — dress comfortably Chillout area with bean bags, therapy balls, PlayStation 4, Nintendo Switch 2 + games, stretching area, and pull-up bar Regular team events Additional Perks Indoor bicycle parking

🏢 Summary: Office-based role for a Regular or Senior AI Test Automation Engineer to build and maintain AI-driven test automation for a modern investment platform. The position focuses on automating functional, integration, and non-functional testing using AI agents and integrating quality controls into CI/CD pipelines. The engineer will ensure compliance, traceability, and high test coverage in a fast-paced, full-stack environment. 🗂️ Requirements: 4+ years of test automation experience, Minimum 2 years in AI-assisted or agentic testing environments, Proficiency with Playwright and PyTest, Experience with CI/CD tools such as Jenkins or GitLab, Experience in API testing, Experience with AI testing agents and synthetic data generation, Knowledge of financial platforms and time-series data validation, Understanding of test strategy design and coverage metrics, Experience with compliance-driven testing in agile environments 📃 Skills: Python, PyTest, Playwright, Jenkins, GitLab, CI/CD, API, AI, Automation, Testing, SyntheticData, TimeSeries, Agile 🏢 Description: We are looking for an experienced Regular or Senior AI Test Automation Engineer to join a full-stack team developing a cutting-edge, AI-native investment platform. The person in this role will be responsible for test automation using AI agents and modern testing tools. This is a 100% office-based position. The project utilizes technologies such as Python, PyTest, Playwright, CI/CD tools (Jenkins, GitLab), as well as solutions for API testing and synthetic data generation If you're ready to make an impact in a dynamic environment, we want to hear from you! Responsibilities Automate test coverage across functional, integration and non-functional layers using AI agents (e.g., Unit Testing Agent, API Test Agent, Automation QA Agent) Integrate testing into CI/CD pipelines and implement quality gates for code, performance and security validation Leverage AI-generated test strategies and synthetic test data to accelerate validation cycles Ensure traceability and auditability of test results in line with investment platform compliance requirements Collaborate with the team to validate code quality and promote test-driven development practices Monitor and optimize test execution using observability tools and analytics from platform usage Requirements Minimum 4+ years of experience in test automation, including at least 2 years in AI-assisted or agentic testing environments Proficiency with test frameworks (e.g., Playwright, PyTest), CI/CD tools (Jenkins, GitLab) and API testing Experience with AI testing agents, synthetic data generation and test orchestration Familiarity with financial platforms, time-series data validation and compliance-driven testing Strong understanding of test strategy design, coverage metrics and defect triage in agile environments We offer/Benefits We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based applications through both manual and automated approaches. The position centers on building scalable LLM test harnesses, designing Gen AI evaluation frameworks, and ensuring reliability, accuracy, and performance of AI-driven systems. The role requires strong Python-based automation skills and experience with AI evaluation metrics, cloud environments, and CI/CD integration. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent testing frameworks, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics: precision, recall, criteria recall, efficiency, Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git, Copilot 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.