June 12, 2026

Senior Automation QA Engineer with AI

Senior • Hybrid

Krakow, Poland

Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is is a British wholesale distributor. 

This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors.

Office work is expected 2-3 days per week. 

Requirements:

  • Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities.

  • Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving.

  • Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications.

  • Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging).

Responsibilities:

  • Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured).

  • Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product.

  • Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds.

  • Own the execution and management of both manual and automated test cases.

  • Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution.

  • Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality.

  • Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems.

We offer

  • US and EU projects based on advanced technologies.

  • Competitive compensation based on skills and experience.

  • Regular performance appraisals to support your growth.

  • Flexibility in workspace, either remote or our welcoming office.

  • Bonuses for article writing, public talks, other activities

  • Generous time off, including vacation, national holidays, sick leaves, and family days.

  • Personalized learning programs tailored to your interests and skill development.

  • Free tech webinars and meetups organized by Svitla.

  • Regular corporate online activities.

  • Awesome team and a friendly, supportive community!

Similar jobs you might like

Technology

Svitla Systems

Senior Automation QA Engineer with AI

Senior

Hybrid

Krakow, Poland

🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and leading the QA strategy for AI-powered and deterministic systems in a production-grade platform. The position involves designing and implementing scalable test automation frameworks, validating non-deterministic AI components, and ensuring overall system reliability and quality. Hybrid work model with significant ownership over testing processes, tools, and standards. 🗂️ Requirements: Strong experience in Java or Node.js or TypeScript, Experience building and maintaining test automation frameworks, Hands-on test automation for APIs, backend services, and front-end applications, Experience with Playwright or REST Assured, Experience working with LLMs and AI tools, Understanding of test design principles, Experience testing AI-driven and non-deterministic systems, Knowledge of HTTP protocols and browser DevTools 📃 Skills: Java, Node.js, TypeScript, Playwright, REST, RESTAssured, LLM, AI, HTTP, DevTools, API, Automation 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland . Our client is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Hybrid mode with 2–3 days per week working from the office in Kraków. Requirements: Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities. Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving. Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications. Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging). Responsibilities: Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in the workspace, either remote or in our welcoming office. Comprehensive medical insurance after one month. MultiSport card with access to 2500 sports facilities all over Poland Bonuses for recommendations of new employees. Bonuses for article writing, public talks, and other activities. 15 vacation days, 10 national holidays, 10 sick leaves, and family days off. Personalized learning program tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Welcome and anniversary presents, gifts for children, and more. Regular corporate events and meetups. Awesome team, friendly and supportive community! Ref #4832

Technology

Svitla Systems

Middle Automation QA Engineer with AI

Mid

Hybrid

Kraków, Poland

🏢 Summary: Full-time Middle Automation QA Engineer role focused on testing AI-powered systems and building QA strategy from the ground up in a hybrid Kraków setup. The position involves developing automation frameworks, validating non-deterministic AI behaviors, and improving quality processes for production-grade platforms. Candidates will work with modern web applications, APIs, and AI-driven products using Node.js, TypeScript, and Playwright. 🗂️ Requirements: 3+ years of commercial QA experience, Manual and automation testing experience, Node.js experience, TypeScript experience, Playwright experience, API testing experience, Backend services testing experience, Modern web application testing experience, Experience building test automation frameworks, Experience defining QA processes and testing strategy, Experience testing AI-powered or non-deterministic systems or strong interest in AI-driven products, Familiarity with LLMs, Strong analytical and problem-solving skills, Strong communication skills 📃 Skills: Node.js, TypeScript, Playwright, API, LLMs, Java, REST, RESTAssured, HTTP 🏢 Description: Svitla Systems Inc. is looking for a Middle Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland . Our client is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for an experienced AQA professional who will be responsible for testing the outputs of an AI-based system. The ideal candidate will define and build the QA strategy from the ground up, establishing test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Hybrid mode with 2–3 days per week working from the office in Kraków. Requirements: 3+ years of commercial experience as a Quality Assurance Engineer, including both manual and automation testing. Strong hands-on experience with Node.js and TypeScript for test automation. Proven experience with Playwright for end-to-end test automation. Experience testing APIs, backend services, and modern web applications. Ability to build and improve test automation frameworks, QA processes, and testing strategy. Experience testing AI-powered or non-deterministic systems , or a strong interest in working with AI-driven products. Familiarity with LLMs and AI-assisted development/testing tools. Strong analytical, problem-solving, and communication skills, with the ability to thrive in fast-paced, ambiguous environments. Nice to have: Experience with Java. Experience with REST Assured/REST API testing. Responsibilities: Develop and continuously enhance robust, scalable test automation frameworks using Node.js or TypeScript (Playwright). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in the workspace, either remote or in our welcoming office. Comprehensive medical insurance after one month. MultiSport card with access to 2500 sports facilities all over Poland Bonuses for recommendations of new employees. Bonuses for article writing, public talks, and other activities. 15 vacation days, 10 national holidays, 10 sick leaves, and family days off. Personalized learning program tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Welcome and anniversary presents, gifts for children, and more. Regular corporate events and meetups. Awesome team, friendly and supportive community! Ref #5089

Technology

Svitla Systems

Senior AQA Engineer with AI

Senior

Hybrid

Krakow, Poland

🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and establishing quality and automation foundations for a new AI-driven, API-based application module. The position involves designing and maintaining automated tests across frontend, backend, and microservices layers, with strong emphasis on AI-assisted testing and CI/CD integration. Hybrid work model in Kraków with collaboration in a distributed engineering team. 🗂️ Requirements: Experience in frontend, backend, and API testing, Practical experience applying AI tools in testing and SDLC, Understanding of microservices-based systems, Knowledge of HTTP and RESTful APIs, Hands-on experience with REST Assured or Playwright, Experience integrating automated tests into CI/CD pipelines, Experience with GitHub Actions, Experience with service mocking and contract testing (WireMock, Pact), Experience with Java and Spring Boot environments, Experience with JavaScript-based frontend applications 📃 Skills: Java, Spring, JavaScript, PostgreSQL, REST, HTTP, Microservices, RESTAssured, Playwright, GitHubActions, WireMock, Pact, AI, CI/CD, Jira, Zephyr, xAPI, MFE, BFF 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Poland. Our client is one of the world's largest food retailers. The team is launching a greenfield project to build a new module for the app. One of the main objectives of this project is to utilize AI as much as possible across every part of the delivery - from design and development to testing, automation, and delivery. The team needs an Automation QA Engineer with experience using AI in a daily tester's job. As an AQA Engineer, you'll be a key contributor to defining and implementing the quality and automation foundations for a distributed, API‐driven system. You'll collaborate closely with engineers and product teams, ensuring quality is built in from the earliest stages and supported by robust automation and AI‐assisted testing. Office work is expected 2-3 days per week in Kraków. CET Working hours. Tech stack: Micro Frontends (MFE) with a Backend for Frontend (BFF)/ xAPI + Enterprise APIs. Backend: Java (Spring Boot). Frontend: JavaScript. Database: PostgreSQL. Requirements: Solid understanding of QA methodologies, with hands‐on experience in frontend, backend, and API testing. Strong interest and practical experience in applying AI tools to testing, automation, and SDLC optimization. Understanding of testing microservices‐based systems. Practical knowledge of HTTP and RESTful APIs. Hands‐on experience with test automation frameworks (like REST Assure, Playwright). Experience working with CI/CD pipelines, preferably GitHub Actions. Familiarity with service mocking and contract testing (WireMock, Pact). Nice to have: Experience with performance testing. Experience setting up or maintaining test environments. Basic cloud knowledge (Azure / AWS). Responsibilities: Collaborate early with the engineering team to influence requirements and define effective test strategies. Design, develop, and maintain automated tests for backend services, APIs, UI, and end‐to‐end flows. Validate service interactions and data flows across microservices and BFF layers. Integrate automated tests into CI/CD pipelines (GitHub Actions). Actively apply AI‐supported tools to improve test design, execution, and maintenance. Produce clear test reports and participate in test automation code reviews. Manage test cases and test cycles (Jira Zephyr). We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!

Technology

Svitla Systems

Senior Automation QA Engineer

Senior

Hybrid

Krakow, Poland

🏢 Summary: Full-time hybrid Senior Automation QA Engineer role focused on backend, API, and frontend test automation for scalable web and mobile products in the food retail domain. The position involves building automated testing frameworks, validating distributed systems, and integrating tests into CI/CD pipelines using modern QA tools and practices. 🗂️ Requirements: 6+ years of experience as an Automation QA Engineer, Strong knowledge of QA methodologies, Experience with backend testing for Java/Kotlin microservices and APIs, Hands-on experience with REST Assured or Karate, Understanding of Playwright, Familiarity with Selenium, Experience with Cucumber, Knowledge of CI/CD pipelines, Experience with GitHub Actions, Understanding of HTTP protocols and RESTful APIs, Experience with Postman, Bruno, or Insomnia, Familiarity with WireMock or Pact, Ability to understand business requirements and domain context 📃 Skills: Java, Kotlin, REST, Playwright, Selenium, Cucumber, RESTAssured, Karate, JUnit, Postman, Bruno, Insomnia, WireMock, Pact, GitHub, HTTP, Zephyr, Jira, CI/CD, API 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer for a full-time hybrid position (40 hours per week) in Poland . Our client is one of the world's largest food retailers. You'll join the team to help build reliable, scalable, and high-quality products across web, mobile, and API platforms. If you thrive on solving complex problems, automating at scale, and working in a collaborative environment, this will be the perfect place for you. Office work in Kraków is expected 3 days per week (but some flexibility is possible). Requirements 6+ years of experience as an Automation QA Engineer. Strong understanding of QA methodologies with a focus on backend testing across Java/Kotlin microservices and APIs, complemented by frontend test automation experience. The ability to quickly learn and understand business requirements and the domain. Hands-on experience with one or more backend testing frameworks (e.g., REST Assured, Karate). Understanding of frontend testing with Playwright, with familiarity with Selenium and the BDD framework (Cucumber). Knowledge of CI/CD tools and pipelines, particularly GitHub Actions. Solid understanding of HTTP protocols, RESTful APIs, eventing and tools like Postman, Bruno or Insomnia. Familiarity with service mocking and contract testing tools (e.g., WireMock, Pact). Nice to have Experience in building and maintaining testing environments. Responsibilities Collaborate early with engineering teams during refinement sessions to influence requirements and define effective test strategies for backend services, APIs, and frontend user journeys. Design, develop, and execute comprehensive test suites for functional, regression, end-to-end API, and customer journey testing. Automate service-level tests using modern frameworks such as REST Assured, JUnit, Karate DSL, Postman/Newman/Bruno. Conduct frontend/UI testing primarily using Playwright; knowledge of Selenium and Cucumber is considered beneficial. Validate service interactions and data flows across distributed systems. Integrate automated tests into CI/CD pipelines (e.g., GitHub Actions) and maintain test environments. Prepare and present clear, actionable test reports that document coverage, results, and defects. Participate in code reviews of test automation scripts to ensure maintainability and adherence to best practices. Manage test cases and cycles using Jira Zephyr. Define and implement a robust framework for automated backend testing, with a focus on Java/Kotlin services and strategic APIs that support complex customer journeys. Ensure test coverage across the full end-to-end application flow, including backend services, frontend user journeys, and integrations with multiple external services. Utilize AI-supported tools to enhance test design, execution, and maintenance. Align with the company's established AQA practices to ensure consistency across teams. We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!

Technology

Svitla Systems

Senior QA Engineer

Senior

Remote

Warsaw, Poland

🏢 Summary: Full-time Senior QA Engineer role focused primarily on manual testing of a React Native mobile application integrated with hardware devices. The position involves validating mobile features, hardware data processing, and CI/CD pipelines while collaborating with development and hardware teams. Limited automation tasks may be required, mainly maintaining existing E2E tests. 🗂️ Requirements: 4+ years of manual testing experience, Strong experience in manual mobile application testing, Understanding of API-based systems and data flows, Basic knowledge of Bluetooth and MQTT from testing perspective, Experience testing on real devices, Ability to read and analyze CI/CD build logs, Experience with regression testing, Ability to maintain E2E tests, Professional English proficiency 📃 Skills: ManualTesting, MobileTesting, ReactNative, iOS, Android, API, Bluetooth, MQTT, CI/CD, Bitrise, Detox, TypeScript, JavaScript, macOS 🏢 Description: Svitla Systems Inc. is looking for a Senior QA Engineer for a full-time position (40 hours per week) in Europe. Our client is a company that creates interactive games, quizzes, and adventures specifically designed for children. We're looking for a tester who's comfortable focusing on mostly manual testing for now, with limited automated testing possible (there is no environment to support it yet). Requirements: 4+ years of experience in manual testing (AQA experience is a plus). Experience in small to medium companies preferred, not in startups. Strong understanding of manual mobile application testing. Understanding of API-based systems and data flows (polling, backend interactions). Basic understanding of Bluetooth and MQTT from a testing perspective. Experience working with real devices. Expertise in reading and understanding CI/CD build logs. Excellent written and spoken English. Excellent communication skills and initiative to report product/feature/software issues immediately. Ability to self-structure your work in an ambiguous environment. Sharp attention to detail and solid communication skills. Curiosity and comfort digging into unfamiliar parts of the product. Nice to have: Basic knowledge of TypeScript/JavaScript. Basic understanding of APIs or testing automation concepts. Experience triggering builds and running tests locally on macOS. Previous experience testing products with hardware integration. Responsibilities: Perform manual testing of a React Native mobile application (iOS / Android). Validate user-facing insights generated from hardware data and displayed in the app after processing. Use a real hardware device (Bluetooth box) to generate test data for QA purposes. Execute regression testing and verify new features before release. Analyze CI/CD pipeline failures in Bitrise and review build/test logs. Collaborate closely with developers and a separate hardware-focused team. Maintain and adjust existing E2E tests (Detox) when minor issues are identified. Work independently, organize your own testing focus, and adapt as requirements evolve. Verify fixes and keep track of riskier areas. Mostly manually test the company’s music box features and functions. Spot, reproduce, and clearly describe bugs. Occasionally prepare automated testing scenarios (rarely). We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, other activities Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!

Technology

Svitla Systems

Middle/Senior QA Engineer

Senior

Remote

Krakow, Poland

🏢 Summary: Full-time Middle/Senior QA Engineer role focused primarily on manual testing of a React Native mobile app integrated with hardware devices. The position involves validating mobile features, hardware-generated data, and CI/CD pipelines while collaborating with development and hardware teams. Limited automation is included, with occasional maintenance of existing E2E tests. 🗂️ Requirements: 4+ years of manual testing experience, Strong experience in manual mobile application testing, Understanding of API-based systems and data flows, Basic knowledge of Bluetooth and MQTT from testing perspective, Experience testing on real devices, Ability to read and analyze CI/CD build logs, Professional English proficiency, Experience in small to medium companies (non-startup) 📃 Skills: ManualTesting, MobileTesting, ReactNative, iOS, Android, API, Bluetooth, MQTT, CI/CD, Bitrise, Detox, TypeScript, JavaScript, macOS 🏢 Description: Svitla Systems Inc. is looking for a Middle/Senior QA Engineer for a full-time position (40 hours per week) in Europe. Our client is a company that creates interactive games, quizzes, and adventures specifically designed for children. We're looking for a tester who's comfortable focusing on mostly manual testing for now, with limited automated testing possible (there is no environment to support it yet). Requirements: 4+ years of experience in manual testing (AQA experience is a plus). Experience in small to medium companies preferred, not in startups. Strong understanding of manual mobile application testing. Understanding of API-based systems and data flows (polling, backend interactions). Hands on experience with Bluetooth and MQTT from a testing perspective. Experience working with real devices. Expertise in reading and understanding CI/CD build logs. Excellent written and spoken English. Excellent communication skills and initiative to report product/feature/software issues immediately. Ability to self-structure your work in an ambiguous environment. Sharp attention to detail and solid communication skills. Curiosity and comfort digging into unfamiliar parts of the product. Nice to have: Basic knowledge of TypeScript/JavaScript. Basic understanding of APIs or testing automation concepts. Experience triggering builds and running tests locally on macOS. Previous experience testing products with hardware integration. Responsibilities: Perform manual testing of a React Native mobile application (iOS / Android). Validate user-facing insights generated from hardware data and displayed in the app after processing. Use a real hardware device (Bluetooth box) to generate test data for QA purposes. Execute regression testing and verify new features before release. Analyze CI/CD pipeline failures in Bitrise and review build/test logs. Collaborate closely with developers and a separate hardware-focused team. Maintain and adjust existing E2E tests (Detox) when minor issues are identified. Work independently, organize your own testing focus, and adapt as requirements evolve. Verify fixes and keep track of riskier areas. Mostly manually test the company’s music box features and functions. Spot, reproduce, and clearly describe bugs. Occasionally prepare automated testing scenarios (rarely). We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community! Ref #5117

Technology

Svitla Systems

Senior AI Quality Analyst

Senior

Remote

Warsaw, Poland

🏢 Summary: Full-time Senior AI Quality Analyst role focused on evaluating, testing, and improving AI/ML models across their lifecycle. The position involves designing evaluation strategies, performing error and adversarial analysis, managing datasets, and ensuring model safety, reliability, and performance. You will drive actionable insights to enhance model quality and testing processes. 🗂️ Requirements: Proven experience in QA, testing, or data analysis in AI/ML domain, Strong understanding of ML lifecycle and AI model failure modes, Hands-on experience with data annotation and data validation, Experience managing large datasets for model evaluation, Experience with bug-tracking and test case management tools, Ability to design evaluation benchmarks and test cases, Experience in error analysis and defect triage, Ability to set up and maintain testing environments 📃 Skills: AI, ML, QA, Python, Jira, DataAnnotation, DataValidation, ErrorAnalysis, RedTeaming, TestAutomation, Datasets, ComputerVision, Benchmarking, Scripting 🏢 Description: Svitla Systems Inc. is looking for a Senior AI Quality Analyst for a full-time position (40 hours per week) in Europe. The AI Quality Analyst is a critical role responsible for ensuring the performance, safety, and reliability of our cutting-edge AI/ML models. You will be at the forefront of our development lifecycle, designing and executing comprehensive evaluation strategies to identify model weaknesses, potential biases, and critical edge cases. This role requires a blend of analytical rigor, technical aptitude, and deep curiosity about how AI models behave in real-world scenarios. You will not only find bugs but also provide actionable insights that drive model improvement and guide our research and development efforts. Responsibilities Evaluation Strategy & Benchmark Development: Create and manage a comprehensive set of test cases and evaluation benchmarks. Identify potential failure points, including edge cases, adversarial inputs, and bias sources. Error Analysis & Failure Triage: Perform systematic error analysis to categorize failures and find underlying patterns. Triage defects, prioritize by severity and impact, and collaborate with the development team for resolution. Data Sourcing & Curation: Gather, curate, and manage high-quality datasets for model testing and evaluation. Conduct data annotation and validation to maintain data integrity. Exploratory & Adversarial Testing (Red Teaming): Conduct unscripted exploratory testing to detect unexpected model behaviors. Engage in red teaming exercises to challenge models and uncover safety and security vulnerabilities. Test Environment Management: Set up, maintain, and troubleshoot testing environments to ensure reliable evaluation pipelines. Reporting & Insights: Analyze test results and create clear, actionable reports for technical and non-technical audiences. Convert complex findings into tangible recommendations for model improvements. Process Improvement: Participate in review sessions and help enhance testing methodologies, tools, and quality assurance processes. Qualifications and Skills Proven experience in quality assurance, testing, or data analysis, preferably in the AI/ML domain. A deep understanding of the machine learning lifecycle and common failure modes of AI models. Hands-on experience with data annotation, data validation, and large dataset management. Meticulous attention to detail and a methodical approach to problem-solving. Strong analytical skills, with the ability to identify patterns in data and draw meaningful conclusions. Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues. Experience with bug-tracking systems (e.g., Jira) and test case management tools. Nice to have Basic scripting skills (e.g., Python) for test automation and data manipulation. Familiarity with computer vision or other specific AI domains relevant to our work.

Technology

emagine Polska

Senior QA Engineer

Senior

Remote

Warsaw, Poland

🏢 Summary: Senior QA Engineer role in the insurance/financial services industry, focused on ensuring high-quality deliverables through manual and automated testing, including projects involving generative AI. The position emphasizes building and scaling test automation practices in a 100% remote, long-term B2B engagement. The role involves close collaboration with developers and active contribution to automation strategy and quality processes. 🗂️ Requirements: Fluency in English, Fluency in Polish, 5+ years of experience in test automation, 3+ years of experience with Python, Experience in manual testing, Experience in automated testing, Knowledge of AWS or Azure, ISTQB certification, Willingness to work with AI-related solutions 📃 Skills: Python, AWS, Azure, ISTQB, Locust, Xray, Zephyr, Jira, AzureDevOps, SITACH, UAT, QAT, Pentesting 🏢 Description: GENERAL INFORMATION: Industry: Insurance / Financial Services Location: 100% remote Rate: up to 135 PLN/hour net + VAT Contract type: B2B – long-term cooperation Summary: The role of the Senior QA Engineer focuses on ensuring high-quality deliverables through both manual and automated testing, particularly in advanced technology projects, including generative AI initiatives. The primary goal is to enhance the testing processes and foster a culture of test automation within the team. Responsibilities: Designing, creating, and executing manual and automated test cases according to agreed standards. Testing new functionalities and performing regression testing . Reporting defects identified during testing and collaborating with developers for resolution and closure. Participating in test planning activities , including estimation and task prioritization. Designing, building, testing, and deploying test automation solutions , including test concepts and automation strategies. Collaborating with developers on automation scripts from the early stages of the development process. Coordinating execution of automated tests within assigned areas or projects. Participating in the development and expansion of test automation practices within the organization. Consulting and coaching the testing team in the area of test automation. Performing testing activities related to SITACH, UAT, QAT, and security testing (pentests) . Must Haves: Fluency in English and Polish . 5+ years of experience in test automation. 3+ years of experience with Python . Experience with manual and automated testing . Knowledge of cloud solutions (AWS or Azure) . ISTQB certification . Willingness to learn and work with new AI-related solutions . Nice to Haves: Openness to changing technology stacks. Experience in performance testing (preferably using Locust). Experience with Xray, Zephyr , or other test management tools. Knowledge of Jira or Azure DevOps . Other Details: Team Structure: The QA team consists of 1 QA Manager and 3 testers. Onboarding Process: Described as very supportive and smooth. Organizational Focus: Moving strongly toward test automation, with support for skill development.

Technology

Experis Manpower Group

Senior QA Automation Engineer

Senior

Hybrid

Warsaw, Poland

110 - 130 PLN

🏢 Summary: Senior QA Automation Engineer role focused on backend and frontend test automation, integration and performance testing, and improving QA frameworks and processes. The position involves close collaboration with development teams, mentoring others, and driving testing standards in a hybrid work model. 🗂️ Requirements: 5+ years of QA/Automation experience, Strong programming skills in Java and/or JavaScript, Experience with Jira and Xray, Experience with Git, Experience with Postman for API testing, Understanding of CI/CD pipelines and tools, Knowledge of SDLC, Understanding of API structures and responses, Experience in performance testing, Experience building and maintaining testing frameworks, Experience with code reviews, Knowledge of SOLID, KISS, and OOP principles, Strong communication skills, Analytical thinking, Ability to work in a dynamic environment 📃 Skills: Java, JavaScript, Jira, Xray, Git, Postman, CI/CD, SDLC, Selenium, Selenide, Cypress, TestNG, JUnit, Cucumber, JMeter, REST, Assured, Gatling, Appium, XCUI, SOLID, KISS, OOP 🏢 Description: About the Role We are looking for a Senior QA Automation Engineer with a strong technical background in both frontend and backend testing (approx. 30% Frontend / 70% Backend). This role is ideal for a technically mature professional who can independently deliver high-quality solutions while also mentoring others and driving best practices across teams. Key Responsibilities Plan and execute integration, system, and usability testing Participate in End-to-End (E2E) and User Acceptance Testing (UAT) Collaborate with developers to understand critical paths and ensure product stability Strengthen cooperation and communication across Dev Teams Contribute to improving QA processes, frameworks, and testing standards Requirements 5+ years of experience in QA/Automation Strong programming skills in Java and/or JavaScript Practical experience with: Jira (preferably with Xray) Git Postman for API testing Deep understanding of: CI/CD pipelines and tools Software Development Life Cycle (SDLC) API structures and responses Experience in: Performance testing Building and maintaining testing frameworks Code reviews Tool integration and adoption of new technologies (PoC, showcases) Solid knowledge of: Design patterns and programming principles (SOLID, KISS, OOP) Automation & Testing Stack Web Testing Selenium / Selenide (primary tools) Cypress (depending on the team) TestNG / JUnit Cucumber JMeter (nice to have) API Testing REST Assured TestNG / JUnit Gatling (nice to have) Mobile Testing Appium XCUI Test (if applicable) Performance Testing Gatling (preferred) JMeter (nice to have) Soft Skills Strong communication skills Excellent analytical thinking Mentorship and knowledge-sharing mindset Proactive attitude and ownership Strong planning and prioritization skills Ability to work in a dynamic environment (context switching) Passion for driving technical innovation Work Model Hybrid model: 1 day every two weeks (Thursday) in the Warsaw office Additional on-site presence (2–3 days) every 2–3 months for planning sessions

Technology

emagine Polska

Senior QA Engineer (Java + TS/JS)

Senior

Remote

Warsaw, Poland

170 - 170 PLN/hr

🏢 Summary: Senior QA Engineer role focused on Java-based API test automation for CMS and digital asset management products within the ETSL project. The position involves building and maintaining automated tests, supporting CI/CD processes, and ensuring high product quality in a fully remote environment. The engineer will also maintain test infrastructure and contribute to defect analysis and resolution. 🗂️ Requirements: Minimum 4 years of experience in Java and API test automation with RestAssured, Basic experience with TypeScript or JavaScript, Experience with Cypress or Playwright for end-to-end testing, Knowledge of SQL or NoSQL databases and data validation, Experience with version control systems, Familiarity with CI/CD tools and processes, Ability to build and debug applications locally for defect investigation 📃 Skills: Java, RestAssured, TypeScript, JavaScript, Cypress, Playwright, SQL, NoSQL, Git, CICD, API 🏢 Description: contract: B2B salary: 170 pln/h + VAT mode: 100% remote We are seeking a Senior QA Engineer with a robust background in Java and API test automation to join our remote team. This role entails the development and maintenance of key products within our ETSL project, including a content management system and digital asset management tools. The ideal candidate will possess a keen eye for detail and strong analytical skills, ensuring high-quality outcomes in a collaborative, remote environment. Responsibilities: Develop and execute automated tests to ensure product quality. Collaborate with cross-functional teams to enhance product functionality. Investigate defects and reproduce issues for resolution. Participate in continuous integration and delivery processes. Maintain and improve test infrastructure and tools. Guide junior team members in quality assurance practices. Document and report test results effectively. Analyze and provide feedback on product features. Requirements: Solid experience in Java and API test automation using Rest Assured (at least 4 years) Basic experience with TypeScript or JavaScript Familiarity with Cypress or Playwright for end-to-end testing Knowledge of SQL or NoSQL databases and data validation Experience with code quality and version control tools Familiarity with CI/CD concepts and tools Ability to build and debug applications locally to investigate reported defects Very good analytical and problem-solving skills Clear and effective communication skills within the team Very good level of English, both written and spoken Nice to have: Familiarity with Docker, Kubernetes and AWS