QA Innovation Lead

🏢 Summary: Lead the design and implementation of a comprehensive QA and performance testing strategy for enterprise AI and LLM solutions, ensuring reliability, compliance, and scalability of complex AI agent workflows. The role focuses on AI model evaluation, automated performance engineering, and CI/CD quality gate integration. You will oversee end-to-end testing architecture across functional, non-functional, and AI-specific validation domains. 🗂️ Requirements: 10+ years of enterprise QA leadership experience, Experience designing functional, non-functional, and performance test architectures, Hands-on experience with AI/LLM evaluation metrics (BLEU, ROUGE, perplexity), Experience implementing load, stress, and chaos testing frameworks, Experience building CI/CD test pipelines in Azure DevOps or GitHub Actions, Experience with automated API testing using Pytest or Postman, Experience validating multi-step AI agent workflows, Knowledge of ML/LLM lifecycle and model promotion pipelines, Experience with data lineage and governance tools (Purview or Unity Catalog), Experience with synthetic data generation and dataset versioning, Experience working in regulated industries with compliance requirements 📃 Skills: AI, LLM, BLEU, ROUGE, Perplexity, Pytest, Postman, Azure, GitHub, CI/CD, Purview, Unity, Python, API, Chaos, LoadTesting, StressTesting, SyntheticData, ML, DevOps 🏢 Description: QA & Performance Engineering Lead (AI/LLM Focus) The Role We are seeking a high-caliber QA and Performance Engineering Lead to spearhead the testing strategy for enterprise-grade AI and LLM solutions. In this role, you will define the architecture for functional, non-functional, and performance testing, ensuring that complex AI agent workflows and large-scale applications meet the highest standards of reliability and compliance. You will act as a bridge between traditional QA excellence and the cutting-edge requirements of GenAI evaluation. Core Responsibilities & Technical Expertise Strategic QA Leadership: Leverage 10+ years of experience leading enterprise-wide testing initiatives within Fortune 500 environments to design comprehensive QA architectures. AI/LLM Specialized Evaluation: Implement advanced metrics for model assessment, including BLEU, ROUGE, perplexity , and specialized scoring for hallucination and grounding rates . Performance & Resilience Engineering: Build frameworks for load, stress, and chaos testing to ensure system stability under extreme conditions and peak workloads. Automation & Orchestration: Engineer robust CI/CD test pipelines using Azure DevOps or GitHub Actions , focusing on automated API testing (Pytest/Postman) and integrated test harnesses. Agentic Workflow Validation: Design testing strategies for multi-step AI agents , covering tool chaining, orchestration, and context injection accuracy. Data Governance & Compliance: Apply deep knowledge of data lineage (Purview/Unity Catalog) and maintain strict traceability and auditability standards required in regulated industries. Lifecycle Management: Oversee model release gates, registry promotions, and the management of synthetic datasets and versioning. Key Deliverables Unified Testing Framework: A standardized taxonomy and coverage model spanning unit, integration, E2E, and AI agent workflows. AI Evaluation Suite: A comprehensive suite for validating model consistency, toxicity, and correctness , supported by Proof-of-Concept (PoC) validations. Automated Performance Harness: Scalable workload models designed for peak-load scenarios and resiliency benchmarking. Smart Quality Gates: Automated pass/fail scoring mechanisms embedded directly into release pipelines across all quality dimensions. Advanced Observability: Implementation of "Golden Dashboards" tracking real-time metrics such as latency-per-thought, grounding quality, and functional pass rates. Professional Profile Expertise in Enterprise QA Architecture (Functional + Non-functional + Performance). Deep understanding of ML/LLM lifecycle and model promotion pipelines. Strong background in Regulated Industries (ensuring compliance and audit readiness). Hands-on experience with Synthetic Data generation and dataset versioning.

🏢 Summary: The offer is for a QA Engineer responsible for ensuring the quality and reliability of business applications through manual and automated testing across the full software delivery lifecycle. The role involves creating and maintaining automated tests, integrating them into CI/CD pipelines, and collaborating closely with development teams in an AI-driven environment. It combines hands-on testing, quality risk analysis, and continuous improvement of QA practices. 🗂️ Requirements: Minimum 4 years of experience in software quality assurance, Hands-on experience in manual testing, Hands-on experience in test automation, Programming skills in Python, Java, C#, or similar, Experience with version control systems, Knowledge of test automation frameworks, Experience integrating automated tests with CI pipelines, Understanding of software development practices, Ability to analyze requirements and define test coverage, Experience using AI tools in engineering work 📃 Skills: Python, Java, C#, Git, CI/CD, Automation, Testing, AI 🏢 Description: We are looking for a QA Engineer who will help ensure that business applications are reliable, user-friendly, and ready for production use. In this role, you will work closely with developers, project stakeholders, and end users to understand requirements, identify risks early, and support quality throughout the full software delivery lifecycle. The position combines manual testing, test automation, collaboration with technical teams, and continuous improvement of QA practices. It is well suited to someone who enjoys finding issues, improving processes, and using both technical skills and curiosity to deliver better software. The company operates in the financial sector and has a strong AI-oriented culture. Artificial intelligence is used in a practical way to support daily work, automate repetitive tasks, improve efficiency, and speed up delivery. As part of the recruitment process, the candidate’s AI mindset will also be assessed, including openness to using modern AI tools, ability to learn with AI support, critical review of AI-generated outputs, responsible usage, and readiness to identify areas where AI can improve QA and engineering work. Responsibilities Prepare and maintain test documentation, including test scenarios, test cases, and testing procedures. Perform different types of testing, including functional, regression, integration, UI, data validation, exploratory, and end-to-end testing. Verify applications from both technical and user perspectives to identify defects and usability improvements. Work with business users to clarify requirements and understand expected system behavior. Cooperate with developers, project managers, and other stakeholders during planning, daily meetings, and delivery activities. Identify quality risks early and suggest practical ways to reduce them. Support improvements in testing standards, development quality, and release readiness. Create and maintain automated tests using programming languages such as Python, Java, or C#. Participate in code reviews related to test automation and quality tooling. Help integrate automated tests into CI/CD processes. Share QA knowledge with the team and contribute to internal documentation or user guidance. Requirements At least 4 years of experience in software quality assurance. Hands-on experience with manual testing and test automation. Programming skills in Python, Java, C#, or a similar language. Understanding of software development practices and ability to work closely with engineering teams. Experience with version control tools such as Git or similar systems. Knowledge of test automation frameworks and interest in connecting automated tests with CI pipelines. Ability to analyze requirements, spot risks, and translate them into effective test coverage. Comfortable using AI tools to support learning, testing, automation, and daily engineering tasks. Responsible approach to AI-assisted work, including validation, critical thinking, and awareness of limitations. Strong problem-solving skills and attention to detail. Good communication skills and ability to work with both technical and non-technical stakeholders. Proactive attitude, willingness to learn, and flexibility in taking on different QA-related responsibilities.

🏢 Summary: The offer is for a QA Engineer to support the full Software Development Lifecycle in a fast-paced product environment, leveraging AI-assisted tools to design, generate, and maintain test assets. The role focuses on embedding quality across planning, development, and release stages while collaborating closely with developers and product teams. It combines traditional QA practices with modern AI-driven and automation-oriented approaches in a remote setup. 🗂️ Requirements: Basic to intermediate experience in software QA, testing, or software development, Knowledge of at least one programming or scripting language, Ability to use AI-assisted development tools in QA processes, Understanding of SDLC processes, Ability to collaborate within cross-functional technical teams, Critical thinking in identifying and mitigating quality risks 📃 Skills: QA, SDLC, JavaScript, Python, Java, AI, Automation, CI/CD, Agile, Scrum 🏢 Description: About the Role We are looking for a proactive and adaptable QA Engineer to support the Software Development Lifecycle (SDLC) for a fast-moving product track. This role is ideal for someone who is technically curious, AI-savvy and eager to collaborate closely with developers, product teams and QA leadership. Rather than relying solely on traditional manual QA approaches, this role will leverage AI-assisted development tools to help design, generate, and maintain test assets and quality processes. Key Responsibilities Support the Software Development Lifecycle (SDLC) by contributing to quality processes across planning, development, and release stages, Use AI-assisted development tools to help design, generate, and maintain test assets, Collaborate closely with developers, product teams, and QA leadership to define and uphold quality standards, Communicate findings clearly and adapt processes in response to a changing product environment, Demonstrate critical thinking in identifying quality risks and propose practical, pragmatic solutions. Required Qualifications Basic to intermediate experience in software QA, testing, or software development, Knowledge of at least one programming or scripting language (JavaScript, Python, Java or equivalent), Interest in AI-assisted development and modern engineering practices, Strong communication and collaboration skills, Proactive and curious approach - willing to learn and grow, Ability to think critically and adapt quickly in a changing environment. Nice to Have Exposure to test automation tools or CI/CD processes, Familiarity with Agile/Scrum environments, Experience using AI coding assistants or productivity tools. All our positions are Remote and are available as Full Time Employment or B2B Contracts

🏢 Summary: Senior QA Engineer role focused on automation-first testing within a Credit Assessment and Decision team, with strong emphasis on Robot Framework, API/system testing, and CI/CD-supported quality processes. The position involves designing and maintaining automated tests, supporting releases, improving test coverage, and collaborating closely with developers and business analysts. The role also includes selective manual testing, troubleshooting test failures, and promoting quality standards across delivery teams. 🗂️ Requirements: 5+ years of senior-level QA experience, Hands-on experience in automation-focused testing roles, Experience with Robot Framework, Experience with Python, Strong API testing experience, Strong system testing experience, Experience creating and maintaining automated test suites, Experience with test data and environment configuration, Experience with enterprise test management tools, Experience with CI/CD pipelines, Experience with AI-assisted tools and agent-based workflows, Good spoken and written English 📃 Skills: Robot, Python, API, CI/CD, Testing, Automation 🏢 Description: We are looking for a Senior QA Engineer to join our Credit Assessment and Decision team. In this role, you will take strong ownership of quality within the project by designing, building, and maintaining automated tests, supporting releases, and helping the team strengthen an automation-first approach to testing. This is primarily an automation-focused role, with our automation setup centered around Robot Framework, a keyword-driven framework with human-friendly syntax used to create readable and maintainable automated tests. The role also includes selective exploratory and release-focused manual testing where it adds value. We are looking for someone who is comfortable working hands-on with automation, improving test coverage and suite reliability, and acting as a senior QA voice in close collaboration with developers and business analysts. The ideal candidate combines solid automation engineering skills with a pragmatic quality mindset, strong communication, and the confidence to challenge constructively when quality risks or unclear requirements appear. Responsibilities: Design, create, and maintain automated tests for API-based system and regression testing Support release activities by preparing, executing, and following up on quality assurance tasks Perform selective exploratory and release-focused manual testing where automation is not the most effective option Manage and maintain test assets with proper traceability and reporting in enterprise test management tooling Investigate failed test runs and identify whether issues are caused by product defects, test defects, data problems, or environment instability Work closely with developers and business analysts to ensure quality is addressed early in delivery Act as a senior QA voice within the project by promoting good testing practices, strengthening quality standards, and driving an automation-first approach across delivery Contribute to knowledge sharing and participate in cross-project tester ceremonies within the unit Must-have knowledge and experience: Good Experience Requirements We are looking for someone with solid senior-level QA experience, typically 5+ years, and a clear track record in automation-focused testing roles You should bring hands-on experience from projects where automation was a core part of delivery, not only an additional activity alongside manual testing You should be comfortable taking a leading role in project-level QA work without necessarily holding formal people-management responsibility Technical Expertise Hands-on experience with Robot Framework and Python for test automation, troubleshooting, and test support tooling Strong experience in API and system testing Experience creating new automated tests and maintaining existing automated test suites Experience working with test data, environment configuration, and execution across multiple environments Experience with enterprise test management tools, including test case management, traceability, and reporting Experience working with CI/CD pipelines to support automated test execution, release readiness, and quality feedback loops Experience working with AI-assisted tools and agent-based workflows, with the ability to identify practical opportunities to improve testing and delivery through AI Good spoken and written English

🏢 Summary: The offer is for an experienced QA Engineer responsible for ensuring high software quality in complex, data-intensive applications across the full development lifecycle. The role combines manual and automated testing, close collaboration with developers and stakeholders, and active contribution to CI/CD and internal testing frameworks. It requires strong coding abilities and daily use of AI tools to enhance testing efficiency and code quality. 🗂️ Requirements: Minimum 3 years commercial experience in Software QA/Testing, Strong coding skills in Python, Java, or C#, Experience designing and executing functional, integration, regression, UI, and data validation tests, Practical experience with test automation frameworks, Experience integrating automated tests into CI/CD pipelines, Proficiency with Git, Ability to read and analyze application code, Experience using AI coding tools (e.g. Copilot, Claude, Codex) 📃 Skills: Python, Java, C#, Git, CI/CD, AI, Copilot, Claude, Codex, Automation, Testing 🏢 Description: On behalf of our client, a global, technology-driven enterprise, we are currently looking for an experienced QA Engineer. In this role, you will work closely with developers, product managers, and end-users to ensure the highest standards of software quality across the entire development lifecycle. The company builds highly complex, data-intensive applications where QA is treated as a core engineering discipline, rather than an afterthought. What you will be doing: Designing and executing comprehensive testing strategies, including functional, integration, regression, UI, and data validation testing. Actively identifying software defects and providing actionable feedback on product usability. Creating and maintaining test automation scripts, as well as participating in peer code reviews. Collaborating directly with business stakeholders to gather, understand, and refine requirements. Taking part in agile ceremonies and technical brainstorming sessions. Identifying potential technical risks early in the development pipeline. Mentoring the team on QA best practices and optimizing internal developer testing frameworks. Assisting with the creation of internal documentation and helping train end-users on new application features. What is expected of you: At least 3 years of commercial experience in a Software QA / Testing role. Solid coding skills in Python, Java, or C# . You should be comfortable reading code, writing scripts, and getting your hands dirty to effectively "break" applications. Actively using AI tools (such as GitHub Copilot, Claude, Codex, etc.) on a daily basis to accelerate your coding, write better tests, and quickly learn new platforms. Practical knowledge of test automation frameworks and integrating tests into CI/CD pipelines. Proficiency with version control systems (e.g., Git ). Strong analytical mindset, great time management, and a highly adaptable, problem-solving attitude. Eagerness to learn new platforms and technologies quickly. What our client offers: Hybrid work model in Warsaw (minimum 3 days a week in the office - strictly non-negotiable). Contract of Employment (UoP) with increased tax-deductible costs ( KUP ). Annual performance bonus . Private medical care (including full dental care). Lunch card to cover your daily meals. Multisport card .

🏢 Summary: The offer is for an experienced QA Engineer to ensure high software quality across complex, data-intensive applications by designing and executing comprehensive testing strategies. The role combines manual and automated testing, close collaboration with developers and stakeholders, and active contribution to CI/CD and agile processes. It also involves mentoring team members and optimizing internal testing frameworks. 🗂️ Requirements: Minimum 3 years of commercial experience in Software QA/Testing, Solid coding skills in Python, Java, or C#, Ability to read code and write scripts for testing purposes, Active daily use of AI coding tools (e.g., GitHub Copilot, Claude, Codex), Practical knowledge of test automation frameworks, Experience integrating automated tests into CI/CD pipelines, Proficiency with Git version control, Availability to work hybrid in Warsaw (minimum 3 days per week in office) 📃 Skills: Python, Java, C#, Git, CI/CD, Automation, Testing, AI, Copilot, Claude, Codex 🏢 Description: On behalf of our client, a global, technology-driven enterprise, we are currently looking for an experienced QA Engineer. In this role, you will work closely with developers, product managers, and end-users to ensure the highest standards of software quality across the entire development lifecycle. The company builds highly complex, data-intensive applications where QA is treated as a core engineering discipline, rather than an afterthought. What you will be doing: Designing and executing comprehensive testing strategies, including functional, integration, regression, UI, and data validation testing. Actively identifying software defects and providing actionable feedback on product usability. Creating and maintaining test automation scripts, as well as participating in peer code reviews. Collaborating directly with business stakeholders to gather, understand, and refine requirements. Taking part in agile ceremonies and technical brainstorming sessions. Identifying potential technical risks early in the development pipeline. Mentoring the team on QA best practices and optimizing internal developer testing frameworks. Assisting with the creation of internal documentation and helping train end-users on new application features. What is expected of you: At least 3 years of commercial experience in a Software QA / Testing role. Solid coding skills in Python, Java, or C# . You should be comfortable reading code, writing scripts, and getting your hands dirty to effectively "break" applications. Actively using AI tools (such as GitHub Copilot, Claude, Codex, etc.) on a daily basis to accelerate your coding, write better tests, and quickly learn new platforms. Practical knowledge of test automation frameworks and integrating tests into CI/CD pipelines. Proficiency with version control systems (e.g., Git ). Strong analytical mindset, great time management, and a highly adaptable, problem-solving attitude. Eagerness to learn new platforms and technologies quickly. What our client offers: Hybrid work model in Warsaw (minimum 3 days a week in the office - strictly non-negotiable). Contract of Employment (UoP) with increased tax-deductible costs ( KUP ). Annual performance bonus . Private medical care (including full dental care). Lunch card to cover your daily meals. Multisport card .

🏢 Summary: QA Lead role responsible for defining and executing the quality strategy, leading the QA team, and shaping test architecture for new products built from scratch. The position combines technical leadership in test automation with operational support and close collaboration with product and business stakeholders. The role has a direct impact on technology choices, testing standards, and overall engineering excellence. 🗂️ Requirements: Proven experience in leading QA teams, Advanced knowledge of test automation, Strong understanding of SDLC, Experience in designing test architecture, Hands-on experience with regression, smoke, and manual testing, Experience working with cross-functional product teams, Ability to select and evaluate testing technologies 📃 Skills: Playwright, Selenium, Appium, Java, SDLC, AI, Claude, Cursor, Copilot, Android, iOS 🏢 Description: O roli: W naszej organizacji rola QA Lead to rola techniczna. Szukamy eksperta, który bierze pełną odpowiedzialność za strategię jakości i kierunek rozwoju technicznego zespołu QA. Twoim głównym obszarem działania jest technologia: architektura testów, jakość kodu automatyzacji i techniczne standardy pracy oraz wykorzystanie AI do podnoszenia produktywności i jakości w pracy. Staniesz się kluczowym partnerem technicznym dla biznesu i inżynierii, a Twoim głównym celem będzie budowanie kultury odpowiedzialności i decyzyjności, w której QA ma realny wpływ na architekturę rozwiązań. Wierzymy, że lider techniczny to osoba, która usuwa przeszkody, podnosi poprzeczkę technicznie i wyznacza standardy. Twoje kluczowe zadania: Strategia i przywództwo techniczne: masz decydujący wpływ na wybór technologii oraz architekturę testów. Pracujemy w oparciu o Playwright (w TypeScript), Selenium i Appium (w Javie). Od Ciebie oczekujemy biegłości w tych technologiach oraz świadomych decyzji architektonicznych dotyczących frameworków testowych. Hands-on engineering: aktywnie uczestniczysz w projektowaniu i przeglądach kodu testów automatycznych, samodzielnie weryfikujesz jakość rozwiązań technicznych i wyznaczasz wzorce, które zespół może realnie naśladować. AI i automatyzacja procesów QA: wyznaczasz kierunek wykorzystania AI w testowaniu: od generowania i utrzymania testów z użyciem Claude Code, Cursora lub GitHub Copilota, przez agentowe workflow do analizy regresji i triage bugów, po automatyzację rutynowych zadań QA (np. przygotowanie danych testowych, raportowanie, klasyfikacja defektów). Definiujesz standardy, które testy warto pisać "po ludzku", a które delegować do agentów, i dbasz, by zespół realnie podnosił produktywność dzięki tym narzędziom, bez utraty jakości. Budowanie i rozwój: odpowiadasz za techniczną rekrutację nowych talentów oraz wspieranie inżynierów QA w rozwoju ich kompetencji technicznych: code review, mentoring techniczny, podnoszenie poziomu automatyzacji. Zarządzanie operacyjne i wsparcie: jesteś liderem technicznym, który aktywnie wspiera zespoły w momentach dużego obciążenia. Włączasz się merytorycznie, usuwasz blokady techniczne i dbasz o płynność procesów testowych. Partnerstwo z produktem i biznesem: współpracujesz bezpośrednio z Product Managerami oraz klientami wewnętrznymi, ustalając zakres odpowiedzialności QA oraz dbając, by finalny kształt funkcjonalności uwzględniał feedback od deweloperów i testerów. Engineering Excellence i bezpieczeństwo: nadzorujesz jakość poprzez testy regresyjne, smoke-testy i testy manualne, a także wyznaczasz standardy techniczne dla całego procesu zapewniania jakości. Współpraca Cross-functional: działasz jako partner techniczny dla pozostałych zespołów produktowych, wspólnie kształtujecie standardy pracy. Nasze wymagania: Ekspercki warsztat techniczny (kluczowe): p osiadasz zaawansowaną, praktyczną wiedzę z zakresu testów automatycznych, w szczególności w Playwright z TypeScript oraz Selenium/Appium z Javą. Czytasz, piszesz i recenzujesz kod testów na poziomie eksperckim. Rozumiesz cykl życia oprogramowania (SDLC), wzorce projektowe w automatyzacji oraz architekturę frameworków testowych. Decyzyjność architektoniczna: Masz doświadczenie w podejmowaniu decyzji o wyborze narzędzi, projektowaniu skalowalnych rozwiązań testowych i potrafisz uzasadnić swoje wybory technicznie. Praktyczne doświadczenie z AI w pracy inżynierskiej: korzystasz na co dzień z narzędzi typu Claude Code, Cursor lub GitHub Copilot. Nie do generowania fragmentów, ale do realnej pracy nad kodem testów, refaktoryzacji, debugowania i tworzenia oprzyrządowania. Wiesz, gdzie AI realnie skraca czas pracy QA, a gdzie wprowadza ryzyko (kruche testy, fałszywe poczucie pokrycia, halucynowane API). Mile widziane doświadczenie z agentowymi workflow lub integracjami przez MCP. Doświadczenie w prowadzeniu technicznym zespołu QA: Masz udokumentowane sukcesy w prowadzeniu zespołu QA od strony technicznej: wyznaczanie kierunku, code review, mentoring techniczny oraz naturalną chęć wspierania testerów w rozwoju kompetencji inżynierskich. Budowanie silnych zespołów: p otrafisz rekrutować talenty technicznie i nie boisz się zatrudniać osób, które w specyficznych obszarach posiadają większą wiedzę od Ciebie. Łączenie światów: u miejętnie balansujesz między potrzebami biznesowymi a możliwościami technicznymi, znajdując optymalne rozwiązania dla produktu. Kultura feedbacku i nauki: masz odwagę przyznawać się do błędów i traktujesz je jako cenną lekcję, wyciągając wnioski, które realnie usprawniają przyszłe procesy. Benefity: Nowoczesny sprzęt: MacBook Pro lub Air, dodatkowy monitor oraz telefony testowe ( Android i iOS ). Wsparcie AI: Pełne finansowanie narzędzi automatyzujących pracę ( Claude Code, Cursor, Windsurf, GitHub Copilot ). Ergonomiczne stanowisko: Elektrycznie regulowane biurko oraz wygodne krzesło. Prywatna opieka i ubezpieczenie: Pakiet medyczny oraz NNW dla Ciebie, Twojej rodziny lub partnera. Sport i rekreacja: Karta MultiSport dla Ciebie i bliskiej osoby. Pełne wyżywienie: Codzienne obiady na koszt firmy , świeże owoce oraz doskonała kawa. Rozwój merytoryczny: Indywidualny budżet szkoleniowy, opieka mentora oraz techniczna biblioteczka. Kultura i integracja: Jasne rozmowy o wynikach, wyjazdy integracyjne i cykliczne spotkania zespołu. Komfortowe biuro: Klimatyzowana przestrzeń w Centrum Krakowa (10 min od Dworca Głównego) z parkingiem rowerowym i prysznicami. Wsparcie relokacyjne: Pomoc finansowa przy przeprowadzce do Krakowa. Elastyczność: Wybór między B2B a Umową o pracę , model hybrydowy oraz start pracy między 7:00 a 10:00 . Tańsza księgowość: Zniżka na usługi inFakt.pl w wysokości 300 zł netto miesięcznie . Aplikuj i twórz z nami jakość aplikacji nr 1 na polskim rynku!

🏢 Summary: Long-term remote B2B contract for a Senior QA Automation Engineer to lead and scale automated testing for a single sign-on (SSO) platform supporting clinical trial access management. The role focuses on building robust automation frameworks, integrating AI-driven testing, and embedding quality into CI/CD pipelines. You will drive test strategy and ensure reliability, performance, and security of identity-based workflows. 🗂️ Requirements: 5+ years QA automation experience, Experience building scalable automation frameworks, Strong hands-on Playwright experience, Experience with AI-driven test automation, Experience testing SSO flows, Proficiency in C# or Python or Java, Experience designing functional, performance, and reliability tests, Experience integrating tests into CI/CD pipelines, Knowledge of SDLC, Agile, DevOps, Experience with GitHub or Azure DevOps, Experience with cloud-based testing environments, Experience with data-driven testing, Fluent English 📃 Skills: Playwright, C#, Python, Java, CI/CD, GitHub, Azure, DevOps, SSO, AI, SDLC, Agile, Cloud 🏢 Description: Project Details: Workload: full-time Work model: 100% remote Contract: long-term B2B Are you an experienced QA Automation Engineer who enjoys building reliable, scalable automation frameworks and working on products that have a real-world impact? We are looking for a Senior QA Automation Engineer to join a collaborative product team working on a solution connected to single sign-on access for clinical trial site staff . The platform helps ensure that users receive access to the right clinical trials based on their completed training and assigned studies. The product is built around identity and access processes. What you will be doing As a Senior QA Automation Engineer, you will take ownership of test automation activities and help drive the quality strategy for the product. Your responsibilities will include: Developing and maintaining robust, scalable automated testing frameworks. Working extensively with Playwright for automated testing. Supporting AI-driven testing capabilities, including test generation and self-healing automation . Designing and executing comprehensive automated test scripts for software applications. Testing single sign-on / SSO flows and access-related user scenarios. Creating automated tests for functionality, performance, and reliability. Configuring and monitoring CI/CD pipelines with automated test execution and reporting. Integrating QA automation into delivery pipelines using GitHub and/or Azure DevOps . Collaborating closely with developers, product managers, and IT stakeholders. Analyzing test results, identifying defects, documenting findings, and supporting fast issue resolution. Continuously improving testing methodologies, tools, frameworks, and reporting practices. Using quality metrics and test performance data to optimize long-term reliability and efficiency. Representing QA in project discussions and helping manage quality risks in line with organizational standards. What we are looking for You should have: 5+ years of experience in QA automation , including building and maintaining scalable automation frameworks. Strong hands-on experience with Playwright . Experience with AI-driven automation capabilities such as test generation and self-healing tests . Experience designing and executing automated tests for functionality, performance, and reliability. Experience with SSO / single sign-on testing scenarios . Proficiency in at least one programming language: C# , Python , or Java . Solid understanding of SDLC , Agile , and DevOps practices. Experience integrating automated tests into CI/CD pipelines. Practical knowledge of GitHub and/or Azure DevOps . Ability to analyze test results, identify defects, document issues, and collaborate with developers on resolution. Familiarity with cloud-based testing environments . Experience with data-driven testing approaches . A continuous improvement mindset and the ability to optimise tools, methods, and test reliability over time. Strong collaboration skills and the ability to provide clear, actionable, quality-focused feedback. Fluency in English, both written and spoken. Nice to have Experience working on identity, access management, authentication, or authorisation-related products. Experience with regulated healthcare, pharmaceutical, or clinical trial environments. Previous exposure to Exostar or similar access management technologies.

🏢 Summary: Full-time, long-term remote B2B role for a Senior QA Automation Engineer to lead and scale automated testing for a single sign-on platform supporting clinical trial access. The position focuses on building robust automation frameworks, integrating AI-driven testing, and embedding QA into CI/CD pipelines. You will drive quality strategy and ensure reliability, performance, and secure access flows. 🗂️ Requirements: 5+ years QA automation experience, Experience building scalable automation frameworks, Strong hands-on experience with Playwright, Experience with AI-driven test generation and self-healing tests, Experience testing SSO flows, Proficiency in C# or Python or Java, Experience designing automated functional, performance, and reliability tests, Experience integrating automated tests into CI/CD pipelines, Practical knowledge of GitHub or Azure DevOps, Understanding of SDLC, Agile, DevOps, Experience with cloud-based testing environments, Experience with data-driven testing, Fluent English 📃 Skills: Playwright, C#, Python, Java, CI/CD, GitHub, Azure, DevOps, SSO, AI, SDLC, Agile, Cloud 🏢 Description: Project Details: Workload: full-time Work model: 100% remote Contract: long-term B2B Are you an experienced QA Automation Engineer who enjoys building reliable, scalable automation frameworks and working on products that have a real-world impact? We are looking for a Senior QA Automation Engineer to join a collaborative product team working on a solution connected to single sign-on access for clinical trial site staff . The platform helps ensure that users receive access to the right clinical trials based on their completed training and assigned studies. The product is built around identity and access processes. What you will be doing As a Senior QA Automation Engineer, you will take ownership of test automation activities and help drive the quality strategy for the product. Your responsibilities will include: Developing and maintaining robust, scalable automated testing frameworks. Working extensively with Playwright for automated testing. Supporting AI-driven testing capabilities, including test generation and self-healing automation . Designing and executing comprehensive automated test scripts for software applications. Testing single sign-on / SSO flows and access-related user scenarios. Creating automated tests for functionality, performance, and reliability. Configuring and monitoring CI/CD pipelines with automated test execution and reporting. Integrating QA automation into delivery pipelines using GitHub and/or Azure DevOps . Collaborating closely with developers, product managers, and IT stakeholders. Analyzing test results, identifying defects, documenting findings, and supporting fast issue resolution. Continuously improving testing methodologies, tools, frameworks, and reporting practices. Using quality metrics and test performance data to optimize long-term reliability and efficiency. Representing QA in project discussions and helping manage quality risks in line with organizational standards. What we are looking for You should have: 5+ years of experience in QA automation , including building and maintaining scalable automation frameworks. Strong hands-on experience with Playwright . Experience with AI-driven automation capabilities such as test generation and self-healing tests . Experience designing and executing automated tests for functionality, performance, and reliability. Experience with SSO / single sign-on testing scenarios . Proficiency in at least one programming language: C# , Python , or Java . Solid understanding of SDLC , Agile , and DevOps practices. Experience integrating automated tests into CI/CD pipelines. Practical knowledge of GitHub and/or Azure DevOps . Ability to analyze test results, identify defects, document issues, and collaborate with developers on resolution. Familiarity with cloud-based testing environments . Experience with data-driven testing approaches . A continuous improvement mindset and the ability to optimise tools, methods, and test reliability over time. Strong collaboration skills and the ability to provide clear, actionable, quality-focused feedback. Fluency in English, both written and spoken. Nice to have Experience working on identity, access management, authentication, or authorisation-related products. Experience with regulated healthcare, pharmaceutical, or clinical trial environments. Previous exposure to Exostar or similar access management technologies.

🏢 Summary: Lead AI Testing Engineer role focused on building and driving QA strategy for AI-driven, knowledge graph, ontology, and RAG-based LLM systems. The position involves automating evaluation frameworks, validating graph and ontology layers, integrating testing into CI/CD pipelines, and ensuring end-to-end quality across backend, frontend, and AI components. The offer includes flexible remote work within Poland, professional development programs, certifications, and comprehensive benefits. 🗂️ Requirements: 8+ years of experience in software development, test automation and DevOps, Python test automation with pytest or equivalent, Experience with AI/ML library integration, Knowledge Graph or Data Ontology testing experience, OWL2, RDF, SPARQL, SHACL validation, GraphDB experience, SQL data validation, Cypher query language, REST API testing, Frontend test automation with Playwright or equivalent, Experience testing RAG-based Gen AI / LLM applications, Knowledge of Gen AI / LLM evaluation metrics, Automation framework development experience, CI/CD pipeline integration, Agile delivery experience, Git, Azure DevOps or JIRA, English proficiency at B2 level or higher, Hands-on experience with coding agents and agentic development 📃 Skills: Python, pytest, OWL2, RDF, SPARQL, SHACL, GraphDB, SQL, Cypher, REST, Playwright, Git, Azure, JIRA, Jenkins, Postman, Bruno, LLM, RAG, GenAI, CI/CD 🏢 Description: We are looking for a Lead AI Testing Engineer to drive the quality strategy for AI-driven and data migration initiatives spanning knowledge graphs, ontologies and RAG-based LLM features. You will define and execute QA practices across data ingestion, graph layers, rule evaluation engines and AI/LLM components while building automation frameworks that scale evaluation across complex, data-heavy systems. Responsibilities Design and automate evaluation of RAG-based and LLM-driven features including grounding, answer accuracy, determinism/reproducibility, precision, recall and hallucination rate Build test harnesses to scale evaluation beyond human-in-the-loop processes Create data-driven test suites for underwriting rules and validate rule execution via SPARQL evaluator, arithmetic/threshold logic and multi-condition scenarios Verify ontology schema correctness and instance accuracy against source data, perform reasoner consistency checks and SHACL validation Define and drive end-to-end QA strategy covering data ingestion, ontology/graph layer, rule evaluation engine, AI/LLM layer and integration with underwriting solutions Establish quality gates, acceptance criteria and test coverage models Maintain automation test suites across knowledge graph, data ontology layer, backend services and frontend layers Validate end-to-end flows across ontology, rule engine and decision output, perform contract testing and cross-system data consistency validation Integrate test suites into CI/CD pipelines and define release quality gates Champion automation-first and shift-left quality practices Leverage agentic AI and Gen AI tooling in testing and framework development Requirements 8+ years of experience in software development, testing automation and DevOps Proficiency in Python test automation using pytest or equivalent, scripting and AI/ML library integration Expertise in testing Knowledge Graph or Data Ontology solutions using OWL2, RDF and SPARQL Skills in SHACL validation and graph databases such as GraphDB, including ontology validation, entity/relationship integrity, reasoner consistency checks and graph query correctness Proven ability to define and drive QA strategy independently for complex data-heavy systems, including building automation frameworks and implementing quality gates Skills in data validation using SQL and graph query languages such as SPARQL and Cypher, along with understanding of deterministic vs probabilistic systems Background in backend and API testing (REST) covering data validation, integration and E2E testing Proficiency in frontend web application test automation using Playwright or equivalent Python-compatible framework Hands-on experience using coding agents and agentic development daily Demonstrated experience testing and evaluating RAG-based Gen AI / LLM applications including grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics such as precision, recall, criteria recall and efficiency, with proven ability to automate Gen AI/RAG evaluation at scale Experience in Agile delivery using Git and Azure DevOps or JIRA English proficiency at B2 level or higher Nice to have Skills in semantic search testing and evaluation Familiarity with Vector Database integration and retrieval validation Background in data science covering ML concepts, data pipelines or data engineering collaboration Proficiency in API tooling such as Postman and Bruno Experience with quality-gate implementation in CI/CD pipelines such as Azure DevOps or Jenkins We offer We gather like-minded people: Top tech minds driving innovation in AI, cloud and digital platform modernization Supportive team and agile, startup-like culture Hybrid by design mode and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Career development programs Thought leadership, mentoring, soft skills and well-being programs Certification (Anthropic, Gemini, GCP, Azure, AWS) English classes We cover it all: Stable pay Participation in the Employee Stock Purchase Plan with a 15% discount Benefits package (health insurance, multisport, shopping vouchers) Referral bonuses up to $2,000 Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more Corporate, social and well-being events Please, note: Benefits listed above are available to employees only We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually We will reach out to selected candidates exclusively EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.