Automation QA Engineer

🏢 Summary: Full-time Senior Automation QA Engineer role focused on designing and scaling automated testing frameworks and infrastructure, ensuring high product quality and reliable CI/CD integration within a cross-functional team. The position involves architecting automation solutions from scratch, developing UI and API tests, and maintaining testing infrastructure. B2B contract with a salary range of 35–38 EUR/h + VAT. 🗂️ Requirements: Strong experience with C#, Proven experience in Automation QA, Experience with .NET Core, Experience with unit testing, Experience with integration testing, Experience with Git, Ability to design and build test automation frameworks from scratch, Experience integrating automated tests into CI/CD pipelines 📃 Skills: C#, .NET, NETCore, Automation, UI, API, CI/CD, Git, UnitTesting, IntegrationTesting 🏢 Description: Salary range: B2B - 35-38 E/h + VAT 💰 Ciklum is looking for a Senior Automation QA Engineer to join our team full-time in Poland. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live. About the role: As a Senior Automation QA Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. Together, we will work on the project focused on building and scaling automated testing frameworks and infrastructure to ensure high product quality and reliable CI/CD integration. Responsibilities: Architect test automation frameworks from scratch Develop automated functional UI tests and API or service-level tests Integrate automated scripts into the CI/CD process Develop, maintain and expand automated testing infrastructure Devise and document test frameworks, coding standards, preferred design patterns, and development methodologies Ensure code quality through peer reviews and adherence to guidelines and standards Define quality metrics and implement measurements to determine test effectiveness and overall product quality within the automation process Prepare conclusions and reports regarding the quality of the product under test Collaborate with QA team members to automate manual test processes Manage, analyze and mitigate testing risks Onboard new team members to the project Provide technical guidance and advice for testing teams Requirements: Strong experience with C# Proven Automation QA experience Experience with .NET Core Experience with unit and integration testing Experience with Git What`s in it for you? Strong community: Work alongside top professionals in a friendly, open-door environment Growth focus: Take on large-scale projects with a global impact and expand your expertise Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies Flexibility: Enjoy flexibility – full remote working possibilities Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations About us: At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress. With delivery centers in Wrocław and Gdańsk, our 300+ professionals in Poland drive forward-thinking solutions for global clients. Join a community where collaboration sparks innovation—and your impact reaches millions. Want to learn more about us? Follow us on Instagram , Facebook , LinkedIn . Explore, empower, engineer with Ciklum! Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.

🏢 Summary: Full-time Senior .NET Engineer role focused on modernizing a legacy application through incremental migration and performance-aligned redesign. The position involves analyzing complex stored procedures, building clean data access layers, and implementing comprehensive testing strategies within a cross-functional team. The project emphasizes data synchronization, hybrid data solutions, and automation tooling. 🗂️ Requirements: Strong experience with C# and .NET for building data access layers and ORM implementations, Ability to analyze and refactor complex SQL Server stored procedures, Experience with MongoDB and NoSQL patterns, Proven experience with TDD and writing unit/integration tests, Experience with Python for scripting and migration tooling, Experience using LLM/AI tools for code analysis and documentation, Understanding of event-driven architectures with Kafka, Familiarity with enterprise architectural patterns 📃 Skills: C#, .NET, SQL, T-SQL, SQLServer, MongoDB, TDD, UnitTesting, Python, LLM, AI, Kafka, SpringBoot, ORM 🏢 Description: Salary range: B2B - 39-40 E/h + VAT 💰 Ciklum is looking for a Senior .NET Engineer to join our team full-time in Poland. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live. About the role: As a Senior .NET Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. Project Description: Modernizing Legacy application. Responsibilities: Analyze existing stored procedures and document business logic Design clean, testable .NET data access interfaces Write unit/integration tests prior to implementation Execute incremental migration with parallel validation Ensure performance parity with legacy procedures Requirements: C#/.NET - Strong experience building data access layers, repositories, and ORM implementations SQL Server/T-SQL - Ability to analyze and deconstruct complex stored procedures MongoDB - Experience with NoSQL patterns for potential hybrid data solutions TDD/Unit Testing - Proven track record writing comprehensive test suites before implementation Python - For scripting, automation, and migration tooling LLM/AI Tools - Experience leveraging AI for code analysis, conversion assistance, and documentation generation Kafka - Understanding of event-driven architectures for data synchronization Spring Boot - Familiarity with enterprise patterns (transferable to .NET architecture) What`s in it for you? Strong community: Work alongside top professionals in a friendly, open-door environment Growth focus: Take on large-scale projects with a global impact and expand your expertise Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies Flexibility: Enjoy flexibility – full remote working possibilities Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations About us: At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress. With delivery centers in Wrocław and Gdańsk, our 300+ professionals in Poland drive forward-thinking solutions for global clients. Join a community where collaboration sparks innovation—and your impact reaches millions. Want to learn more about us? Follow us on Instagram , Facebook , LinkedIn . Explore, empower, engineer with Ciklum! Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.

🏢 Summary: Full-time Software Engineer role focused on building secure, scalable backend systems and APIs on AWS using TypeScript. The position involves end-to-end ownership of automated systems that detect misuse and enforce platform policies, working across the full development lifecycle. Ideal for engineers passionate about backend stability, cloud architecture, and high-quality code. 🗂️ Requirements: 3+ years of professional backend development experience, Strong proficiency in JavaScript, TypeScript, and Node.js, Experience building and consuming RESTful or GraphQL APIs, Experience with core AWS services (Lambda, SQS, SNS, API Gateway, S3), Experience with Docker containerization, Experience with NoSQL or relational databases, Understanding of web security principles and best practices, Upper-intermediate or higher English level 📃 Skills: JavaScript, TypeScript, Node.js, AWS, Lambda, SQS, SNS, APIGateway, S3, REST, GraphQL, Docker, MongoDB, DynamoDB, PostgreSQL, Security, CI/CD, Jenkins, GitLab, GitHubActions, React, CloudWatch, Datadog, .NET, Python, GCP, BigQuery 🏢 Description: Salary range: B2B - 30 E/h + VAT 💰 Ciklum is looking for a Software Engineer to join our team full-time in Poland. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live. About the role: As a Software Engineer, you will be part of a cross-functional team with full ownership of the product and codebase. You will join a team specifically focused on businesses, building automated systems that detect misuse and enforce platform policies. You will participate in all stages of the development lifecycle: from ideation and design to implementation, deployment, and maintenance. This role is ideal for an engineer with a strong passion for backend stability and scalability who enjoys building robust cloud architectures. Responsibilities: Develop and maintain secure, scalable APIs and services on AWS using TypeScript Write clean, efficient, and testable code for both backend and frontend applications Collaborate closely with senior engineers, product managers, and designers to translate requirements into technical solutions Implement security best practices in your code to protect user data and ensure platform integrity Contribute to the entire development lifecycle, from planning and implementation to deployment and maintenance Troubleshoot, debug, and upgrade existing software to enhance functionality and performance Participate actively in code reviews, providing and receiving constructive feedback to maintain a high-quality codebase Requirements: 3+ years of professional experience in backend development Strong proficiency with JavaScript, TypeScript and Node.js Experience building and consuming RESTful or GraphQL APIs Experience with core AWS services (e.g., Lambda, SQS, SNS, API Gateway, S3) Familiarity with containerization using Docker Experience with NoSQL (e.g., MongoDB, DynamoDB) and/or relational (e.g., PostgreSQL) databases A good understanding of web security principles and best practices Strong problem-solving skills and a passion for writing quality code Upper-intermediate or higher level of spoken and written English Desirable: Hands-on expertise with React Familiarity with CI/CD practices and tools (e.g., Jenkins, GitLab CI, GitHub Actions) Experience with monitoring and logging tools (e.g., CloudWatch, Datadog) Working experience with .Net or Python is a plus Experience with GCP and services like BigQuery Personal skills: Accountability: You take ownership and follow through on your responsibilities Drive: You're proactive and results-oriented, always seeking better ways to solve problems Self-development: You stay curious, seek feedback, and aim for continuous improvement Effective communication: You communicate your ideas clearly and collaborate effectively in a team Mentoring: You're open to helping less experienced team members and sharing knowledge What`s in it for you? Strong community: Work alongside top professionals in a friendly, open-door environment Growth focus: Take on large-scale projects with a global impact and expand your expertise Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies Flexibility: Enjoy flexibility – full remote working possibilities Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations About us: At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress. With delivery centers in Wrocław and Gdańsk, our 300+ professionals in Poland drive forward-thinking solutions for global clients. Join a community where collaboration sparks innovation—and your impact reaches millions. Want to learn more about us? Follow us on Instagram , Facebook , LinkedIn . Explore, empower, engineer with Ciklum! Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.

🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and leading the QA strategy for AI-powered and deterministic systems in a production-grade platform. The position involves designing and implementing scalable test automation frameworks, validating non-deterministic AI components, and ensuring overall system reliability and quality. Hybrid work model with significant ownership over testing processes, tools, and standards. 🗂️ Requirements: Strong experience in Java or Node.js or TypeScript, Experience building and maintaining test automation frameworks, Hands-on test automation for APIs, backend services, and front-end applications, Experience with Playwright or REST Assured, Experience working with LLMs and AI tools, Understanding of test design principles, Experience testing AI-driven and non-deterministic systems, Knowledge of HTTP protocols and browser DevTools 📃 Skills: Java, Node.js, TypeScript, Playwright, REST, RESTAssured, LLM, AI, HTTP, DevTools, API, Automation 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland . Our client is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Hybrid mode with 2–3 days per week working from the office in Kraków. Requirements: Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities. Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving. Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications. Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging). Responsibilities: Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in the workspace, either remote or in our welcoming office. Comprehensive medical insurance after one month. MultiSport card with access to 2500 sports facilities all over Poland Bonuses for recommendations of new employees. Bonuses for article writing, public talks, and other activities. 15 vacation days, 10 national holidays, 10 sick leaves, and family days off. Personalized learning program tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Welcome and anniversary presents, gifts for children, and more. Regular corporate events and meetups. Awesome team, friendly and supportive community! Ref #4832

🏢 Summary: QA Automation Engineer role focused on automating end-to-end testing across Web, API, and Mobile platforms in a hybrid work model. The position involves designing and implementing automated tests, analyzing system logs, and ensuring quality within Agile teams. Ideal for mid to senior engineers with strong experience in Playwright or Selenium and cross-platform testing. 🗂️ Requirements: Minimum 4 years of experience in test automation, Experience with Playwright (Java or TypeScript) or Selenium WebDriver (Java) and Appium, Experience testing web applications, APIs, and mobile applications, Knowledge of testing pyramid concept, Ability to analyze and interpret system logs, Basic SQL knowledge, Experience working in Agile/Scrum teams 📃 Skills: Playwright, Selenium, WebDriver, Appium, Java, TypeScript, SQL, API, Agile, Scrum 🏢 Description: QA Automation Engineer (Web, API & Mobile) Rate: Up to 119 PLN/h net + VAT (B2B contract) Location: Warsaw Work model: Hybrid (currently 2 days in the office, 3 days remote) Experience level: Mid / Senior (min. 4 years of experience) We are looking for an experienced QA Automation Engineer to take ownership of ensuring the quality of end-to-end processes in our projects. If the testing pyramid concept is the foundation of your work, you can read system logs like an open book, and you can smoothly bridge the worlds of Web, API, and Mobile – we want to meet you! What will you be responsible for? Automating tests for End-to-End processes (both Frontend + Backend), Designing and automating API tests, Analyzing system logs, identifying bugs, and conducting root-cause analysis, Reviewing project documentation and creating high-quality test scenarios based on it, Supporting and handling User Acceptance Testing ( UAT ), Collaborating closely with the development team and business stakeholders in an Agile environment. What do we expect from you? (Must-have): Minimum 4 years of hands-on experience in test automation, Practical knowledge of Playwright (Java or TypeScript) OR Selenium Webdriver (Java) along with Appium , Proven experience in testing all three areas: web applications, APIs, and mobile apps , Strong understanding and ability to test according to the testing pyramid concept, Proficiency in system log analysis and interpretation, Basic knowledge of SQL , Experience working in agile development teams ( Agile/Scrum ). This role is not perfectly suited for you, but you have a friend who would fit? Recommend your friend and get up to 5000 zł! Referral Program: Talent from your network

🏢 Summary: The offer is for an experienced QA Automation Engineer responsible for designing, implementing, and maintaining automated test suites for capital market systems. The role involves frontend and backend test automation, integration and performance testing, and close collaboration with development teams in a hybrid work model. It provides stable employment, competitive salary, and professional growth opportunities. 🗂️ Requirements: Minimum 3 years of experience in functional test automation (frontend and backend), Minimum 3 years of experience in integration, acceptance, and performance testing, Strong knowledge of Cypress, Puppeteer, SoapUI, JMeter, Postman, Experience with GUI testing, REST, SOAP, Kafka, Proficiency in TypeScript and JavaScript, Understanding of Docker and WebSockets, Experience with GIT version control 📃 Skills: Cypress, Puppeteer, SoapUI, JMeter, Postman, REST, SOAP, Kafka, TypeScript, JavaScript, Docker, WebSockets, GIT, GUI, TCP, UDP, Linux 🏢 Description: QA Automation Engineer Location: Warsaw (Hybrid: 1–2 days a week in the office) Salary: 14,000 – 17,000 PLN Gross We are looking for an experienced QA Automation Engineer to join our team. In this role, you will play a key part in ensuring the quality of our capital market systems by designing, implementing, and maintaining automated test suites. Key Responsibilities Test Automation: Actively participate in the test automation process, creating and maintaining automated test scripts and tools. Test Design: Design and implement comprehensive test cases based on technical requirements. Bug Tracking: Identify, document, and report software defects in a clear and timely manner. Collaboration: Work closely with Developers, Architects, and fellow QA Engineers to ensure the highest software quality and find optimal solutions to technical issues. Specification & Analysis: Collaborate on preparing technical specifications and requirements in the testing domain. Documentation: Assist in creating and updating technical documentation for developed tools and test scripts within the transactional system. Requirements Experience: Minimum 3 years of hands-on experience in functional test automation (both frontend and backend). Testing Diversity: At least 3 years of experience in integration, acceptance, and performance testing. Tech Stack & Tools: Strong knowledge of testing tools and protocols: Cypress, Puppeteer, SoapUI, JMeter, Postman, as well as GUI testing, REST, SOAP, and Kafka. Programming Languages: Proficiency in TypeScript and JavaScript. DevOps & Tools: Solid understanding of Docker, WebSockets, and version control using GIT. Nice to Have Experience in testing software built on low-level programming languages. Knowledge of network protocols (UDP, TCP) and Linux environments. What We Offer Stability: Employment contract (Umowa o pracę). Growth: A challenging and rewarding role in the dynamic capital markets industry with clear professional development opportunities. Compensation: Attractive remuneration system matching your skills. Learning: Access to professional training, courses, and industry conferences. Benefits: A rich benefits package, including a cafeteria system, private medical care, life insurance, and PPE (Employee Pension Plan). Flexibility: Hybrid work model (1–2 days a week in our Warsaw office). This role is not perfectly suited for you, but you have a friend who would fit? Recommend your friend and get up to 5000 zł! Referral Program: Talent from your network

🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and leading test strategy for AI-powered and deterministic systems in a production-grade platform. The position involves creating scalable automation frameworks, validating non-deterministic AI behaviors, and ensuring high quality standards across backend, API, and frontend layers. The engineer will shape QA processes and tooling within a newly formed team. 🗂️ Requirements: Strong experience in Java or Node.js or TypeScript, Experience building and maintaining test automation frameworks, Hands-on experience with API, backend, and frontend test automation, Strong knowledge of test design principles, Experience with LLMs and AI tools in development or testing, Ability to design validation strategies for AI-driven and non-deterministic systems, Experience with HTTP protocols and browser DevTools 📃 Skills: Java, Node.js, TypeScript, Playwright, REST, RESTAssured, LLM, AI, HTTP, DevTools, API, Automation, Testing 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Office work is expected 2-3 days per week. Requirements : Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities. Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving. Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications. Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging). Responsibilities : Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, other activities Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!

🏢 Summary: The offer is for a QA Automation Engineer responsible for ensuring high-quality software delivery through designing and maintaining automated tests in close collaboration with development teams. The role focuses on Python-based test automation, API, security, and performance testing, and driving a quality-first mindset within Agile environments. It includes remote work options and opportunities for professional growth in a stable technology company. 🗂️ Requirements: 4+ years of experience in software testing, Minimum 2+ years of experience in test automation, Proficiency in Python, Experience with pytest, Knowledge of automation frameworks (Playwright, Selenium or Robot Framework), Familiarity with IaC and CI/CD practices, Experience working in Agile environments, Knowledge of test and project management tools (JIRA, Xray), Experience with AI tools for QA automation, Polish language proficiency C1+, English language proficiency B2+ 📃 Skills: Python, pytest, Playwright, Selenium, Robot, CI/CD, IaC, JIRA, Xray, Gatling, Locust, AI 🏢 Description: As a QA Automation Engineer you will help us to release quality software products for our clients. You will be working closely with a development team to build and maintain modern software solutions. You’ll play a key role in assuring best quality by designing and delivering automated tests speeding up the product delivery cycle and compliance requirements. Your responsibilities: Assuring quality of created products, exploratory testing, security testing, API testing and performance testing, Design and development of automated tests using Python , Document issues found, Close cooperation with developers and business stakeholders in product design, Active engagement in growth of QA best practices and tools, driving Quality-first mindset within the team and contributing to quality culture within the organisation. Our requirements: 4+ years of experience in tests, including 2+ years in test automation, Proficiency in Python and pytest, working knowledge of automation frameworks (e.g. Playwright, Selenium, Robot Framework), Familiarity IaaC and CI/CD approaches followed by common testing principles, Experience in Agile environments, Knowledge of test and project management tools (eg. JIRA, xray), Experience in using AI tools to automate QA tasks, Self-organisation, adaptability, curious mindset and high communication skills, Ability to communicate in Polish (C1+) and English (B2). Nice to have: Experience with testing Cloud solutions / data platforms , ISTQB Foundation or Advanced level certificate, Security testing or mobile testing experience, Working knowledge of performance testing tools (e.g. Gatling, Locust). What we offer: Work in a stable, growing technology company listed on the stock exchange, B2B or employment contract , Comfortable work setup and equipment tailored to your needs (laptop, accessories, etc.), Benefits (e.g. Multisport card, private medical care, group insurance, employee referral program, team events), Opportunity to work on interesting projects, grow, and further develop your skills, 100% remote work or from our office in Bydgoszcz/Warsaw. If this environment sounds like a fit — apply now!

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and evaluating GenAI features using advanced metrics. The role requires strong Python automation skills, experience with AI evaluation frameworks, and collaboration across product and engineering teams. 🗂️ Requirements: 5+ years of software QA experience, At least 1 year testing AI agents or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming for test automation, Experience with pytest or equivalent framework, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry, or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and robust evaluation processes for Gen AI features. You will collaborate cross-functionally to ensure reliability, accuracy, and quality of AI-driven applications. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents or LLM-based systems, Experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent framework, Expertise in prompt engineering and LLM evaluation metrics, Experience evaluating Gen AI/LLM applications (grounding, hallucination, determinism), Knowledge of precision, recall, criteria recall metrics, Experience with Jira, QMetry or TestRail, Experience with CI/CD integration and version control systems, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, Jira, QMetry, TestRail, AWS, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.