Senior AI QA Engineer (Automation & Manual, AI-based Applications Testing)

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based applications through both manual and automated approaches. The position centers on building scalable LLM test harnesses, designing Gen AI evaluation frameworks, and ensuring reliability, accuracy, and performance of AI-driven systems. The role requires strong Python-based automation skills and experience with AI evaluation metrics, cloud environments, and CI/CD integration. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent testing frameworks, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics: precision, recall, criteria recall, efficiency, Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git, Copilot 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time. Responsibilities - Research and evolve automation frameworks in line with Gen AI tooling and best practices - Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall - Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop - Select and apply Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency - Perform manual testing to validate new features, integrations, and user stories - Build and maintain test cases from requirements and user stories - Test applications including AI agents, APIs, databases, and other integrations - Collaborate with product, engineering, and operations teams to understand requirements and deployment environments - Track and report test results, defects, and quality metrics - Assist with troubleshooting production issues and escalate risks as needed - Guide and support team members, including onshore and offshore consultants Requirements - 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems - Hands-on experience with manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows - Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration - Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems - Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks - Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency - Familiarity with issue and test management tools such as Jira, QMetry and TestRail - Experience with version control systems and integrating tests into CI/CD pipelines - Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation - Understanding of cloud environments, particularly AWS - Excellent communication, collaboration and leadership skills Nice to have - Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar - Experience with AI safety, bias and reliability testing - Experience with test data generation for AI/ML systems We offer We gather like-minded people: - Engineering community of industry professionals - Friendly team and enjoyable working environment - Flexible schedule and opportunity to work remotely within Poland - Chance to work abroad for up to 60 days annually - Business-driven relocation opportunities We provide growth opportunities: - Outstanding career roadmap - Leadership development, career advising, soft skills, and well-being programs - Certification (GCP, Azure, AWS) - Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru - English classes We cover it all: - Stable income (Employment Contract or B2B) - Participation in the Employee Stock Purchase Plan - Benefits package (health insurance, multisport, shopping vouchers) - Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more - Referral bonuses - Corporate, social and well-being events Please note: The set of bonuses might vary based on the role you apply for – specifics will be discussed during the general interview. We will reach out to selected candidates exclusively.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing and automating evaluation of Gen AI and LLM-based applications, including AI agents and integrated systems. The position combines manual and automated testing, development of LLM test harnesses, and implementation of AI evaluation frameworks to ensure reliability, accuracy, and performance. Work is conducted in collaboration with cross-functional teams, with working hours aligned to 13:00–21:00 Polish time. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent testing frameworks, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI / LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of Gen AI / LLM evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry or TestRail, Experience with version control systems and CI/CD integration, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed during the general interview. We will reach out to selected candidates exclusively.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based applications through both manual and automated approaches. The position emphasizes building scalable LLM test harnesses, designing GenAI evaluation frameworks, and ensuring quality across AI-driven systems, APIs, and databases. Requires strong Python automation skills and hands-on experience with AI evaluation metrics and cloud environments. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming for test automation, Experience with pytest or equivalent framework, Expertise in AI agent frameworks and prompt engineering, Experience evaluating GenAI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of LLM evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, Git, CI/CD 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed during the general interview. We will reach out to selected candidates exclusively.

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing and evaluating AI agents and LLM-based systems using both manual and automated approaches. The position emphasizes building scalable LLM test harnesses, designing GenAI evaluation frameworks, and ensuring reliability, accuracy, and performance of AI-driven applications. Work is conducted in collaboration with cross-functional teams with required availability from 13:00 to 21:00 Polish time. 🗂️ Requirements: 5+ years of experience in software QA, Minimum 1 year of experience testing AI agents, agentic solutions or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent automation frameworks, Experience integrating AI/ML libraries in test automation, Expertise in AI agent frameworks and prompt engineering, Experience evaluating GenAI/LLM systems including grounding and hallucination checks, Knowledge of evaluation metrics: precision, recall, criteria recall, determinism, Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, Git, CI/CD 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and robust evaluation processes for Gen AI features. You will collaborate cross-functionally to ensure reliability, accuracy, and quality of AI-driven applications. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents or LLM-based systems, Experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent framework, Expertise in prompt engineering and LLM evaluation metrics, Experience evaluating Gen AI/LLM applications (grounding, hallucination, determinism), Knowledge of precision, recall, criteria recall metrics, Experience with Jira, QMetry or TestRail, Experience with CI/CD integration and version control systems, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, Jira, QMetry, TestRail, AWS, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time. Responsibilities - Research and evolve automation frameworks in line with Gen AI tooling and best practices - Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall - Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop - Select and apply Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency - Perform manual testing to validate new features, integrations, and user stories - Build and maintain test cases from requirements and user stories - Test applications including AI agents, APIs, databases, and other integrations - Collaborate with product, engineering, and operations teams to understand requirements and environments - Track and report test results, defects, and quality metrics - Assist with troubleshooting production issues and escalate risks as needed - Guide and support team members, including onshore and offshore consultants Requirements - 5+ years of experience in software QA - At least 1 year of experience testing AI agents, agentic solutions or LLM-based systems - Hands-on experience with manual and automated testing of AI agents, including prompt testing and workflow evaluation - Strong programming skills in Python for test automation (pytest or equivalent) - Expertise in AI agent frameworks, prompt engineering and LLM evaluation metrics - Experience testing and evaluating Gen AI/LLM applications (grounding, answer accuracy, hallucination, determinism) - Knowledge of evaluation frameworks and metrics (precision, recall, criteria recall, efficiency) - Familiarity with Jira, QMetry, TestRail or similar tools - Experience with version control systems and CI/CD integration - Flexibility to use AI-powered QA tools - Understanding of AWS cloud environments - Excellent communication and collaboration skills Nice to have - Experience with agentic AI platforms such as LangChain or OpenAI Function Calling - Experience with AI safety, bias and reliability testing - Experience with test data generation for AI/ML systems We offer - Engineering community of industry professionals - Friendly team and enjoyable working environment - Flexible schedule and remote work within Poland - Opportunity to work abroad for up to 60 days annually - Career roadmap and leadership development programs - Certification opportunities (GCP, Azure, AWS) - Access to LinkedIn Learning, Get Abstract, Cloud Guru - English classes - Stable income (Employment Contract or B2B) - Employee Stock Purchase Plan participation - Benefits package (health insurance, multisport, shopping vouchers) - Referral bonuses - Corporate, social and well-being events

🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing and automating quality assurance for Gen AI and LLM-based applications, including AI agents and integrated systems. The position combines manual and automated testing, development of LLM test harnesses, and evaluation of model quality metrics such as grounding, precision, and recall. Work is conducted in collaboration with cross-functional teams, with working hours aligned to 13:00–21:00 Polish time. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent framework, Experience integrating AI/ML libraries in automated tests, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of Gen AI/LLM evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry or TestRail, Experience with version control systems and CI/CD integration, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Strong programming skills in Python test automation — pytest or equivalent, scripting and AI/ML library integration Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events

🏢 Summary: Office-based role for a Regular or Senior AI Test Automation Engineer to build and maintain AI-driven test automation for a modern investment platform. The position focuses on automating functional, integration, and non-functional testing using AI agents and integrating quality controls into CI/CD pipelines. The engineer will ensure compliance, traceability, and high test coverage in a fast-paced, full-stack environment. 🗂️ Requirements: 4+ years of test automation experience, Minimum 2 years in AI-assisted or agentic testing environments, Proficiency with Playwright and PyTest, Experience with CI/CD tools such as Jenkins or GitLab, Experience in API testing, Experience with AI testing agents and synthetic data generation, Knowledge of financial platforms and time-series data validation, Understanding of test strategy design and coverage metrics, Experience with compliance-driven testing in agile environments 📃 Skills: Python, PyTest, Playwright, Jenkins, GitLab, CI/CD, API, AI, Automation, Testing, SyntheticData, TimeSeries, Agile 🏢 Description: We are looking for an experienced Regular or Senior AI Test Automation Engineer to join a full-stack team developing a cutting-edge, AI-native investment platform. The person in this role will be responsible for test automation using AI agents and modern testing tools. This is a 100% office-based position. The project utilizes technologies such as Python, PyTest, Playwright, CI/CD tools (Jenkins, GitLab), as well as solutions for API testing and synthetic data generation If you're ready to make an impact in a dynamic environment, we want to hear from you! Responsibilities Automate test coverage across functional, integration and non-functional layers using AI agents (e.g., Unit Testing Agent, API Test Agent, Automation QA Agent) Integrate testing into CI/CD pipelines and implement quality gates for code, performance and security validation Leverage AI-generated test strategies and synthetic test data to accelerate validation cycles Ensure traceability and auditability of test results in line with investment platform compliance requirements Collaborate with the team to validate code quality and promote test-driven development practices Monitor and optimize test execution using observability tools and analytics from platform usage Requirements Minimum 4+ years of experience in test automation, including at least 2 years in AI-assisted or agentic testing environments Proficiency with test frameworks (e.g., Playwright, PyTest), CI/CD tools (Jenkins, GitLab) and API testing Experience with AI testing agents, synthetic data generation and test orchestration Familiarity with financial platforms, time-series data validation and compliance-driven testing Strong understanding of test strategy design, coverage metrics and defect triage in agile environments We offer/Benefits We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Lead Automation Tester role focused on defining and driving test automation strategy while leading a QA team in delivering high-quality solutions for enterprise, API and Big Data systems. The position requires hands-on development of Python-based automation frameworks and integration of testing into CI/CD pipelines. It also involves leveraging AI tools to enhance test design, coverage and efficiency. 🗂️ Requirements: 5+ years of experience in QA automation and test framework development, Proficiency in Python for test automation, Experience with PyTest or Robot Framework, Strong expertise in Selenium and browser automation, Knowledge of HTML, CSS and JavaScript, Experience in API testing using Postman or Requests, Experience in Big Data testing and distributed data validation, Experience integrating automation into CI/CD pipelines (Jenkins or GitLab CI), Proficiency with Azure Cloud, Experience with Git version control, Experience using AI tools for test automation, English level B2 or higher 📃 Skills: Python, PyTest, RobotFramework, Selenium, HTML, CSS, JavaScript, Postman, Requests, BigData, Jenkins, GitLab, Azure, Git, CICD, AI 🏢 Description: We are seeking a Lead Automation Tester with over 5 years of experience to drive test automation strategy and lead a team of QA engineers. This role requires hands-on automation expertise in Python, leadership skills and a focus on delivering high-quality solutions for enterprise applications, APIs and Big Data systems, including the use of AI tools for test preparation and automation script design. Responsibilities Lead the QA automation team, providing technical guidance, mentorship and performance support Design, develop and maintain automated test frameworks using Python, PyTest, Robot Framework or equivalent Oversee test planning, execution and reporting for web, API and Big Data applications Collaborate with development, product and DevOps teams to integrate test automation into CI/CD pipelines such as Jenkins or GitLab CI Ensure consistent use of version control with Git and maintain high-quality automation code standards Conduct code reviews, implement best practices and define automation strategy for new initiatives Leverage AI-assisted tools for test generation, automation script design and efficiency improvements Facilitate risk assessment and defect management to ensure high-quality releases Requirements 5+ years of working experience in QA automation and test framework development Knowledge of Python, PyTest, Robot Framework or equivalent Expertise in browser automation using Selenium and web technologies such as HTML, CSS and JavaScript Deep knowledge of API testing with Postman or Requests library Strong experience with Big Data testing and distributed data validation Proficiency in integrating test automation into CI/CD pipelines using Jenkins or GitLab CI Strong familiarity with Azure Cloud Skills in version control with Git and maintaining automation code standards Background in leveraging AI tools to enhance test design, efficiency and coverage Ability to mentor junior engineers and drive adoption of automation best practices English proficiency at B2 level or higher We offer/Benefits We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: Senior QA Automation & Performance Test Engineer role focused on designing, developing, and executing automated and performance test solutions to ensure quality, scalability, and reliability of complex software systems. The position involves owning non-functional testing activities, building automation frameworks, and optimizing application performance across web, microservices, and cloud environments. The role requires strong programming expertise and hands-on experience with enterprise-grade testing and monitoring tools. 🗂️ Requirements: Strong proficiency in Java, Strong proficiency in C, Experience with LoadRunner Enterprise, Experience with Selenium or Cucumber, Hands-on experience in automation testing across web, microservices, databases, and cloud applications, Experience with CI/CD pipelines, Experience building performance and load testing frameworks, Experience with logging and APM tools, Knowledge of Linux performance tuning, Knowledge of database optimisation techniques, Experience with WebSphere, Experience with Tomcat, Ability to analyse logs and database queries, Experience managing test and defect lifecycle in Agile and Waterfall 📃 Skills: Java, C, LoadRunner, Selenium, Cucumber, Gatling, Locust, AppDynamics, AppInsights, Splunk, Linux, SQL, WebSphere, Tomcat, CI/CD 🏢 Description: We are seeking a highly skilled Senior QA Automation & Performance Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, maintaining, and executing automated and performance test scripts to ensure the quality, reliability, and scalability of our software products. This role requires a strong background in software development, test automation frameworks, performance testing, and a passion for delivering high-quality solutions. This position offers a flex-hybrid model of work, with 3 days per week working from the office located in Wroclaw or Krakow. Responsibilities Collaborate with cross-functional teams to understand software requirements and develop comprehensive test plans, cases, and scenarios Design, develop, and maintain automated and performance test scripts using industry-standard tools and frameworks Own and manage all non-functional testing activities, including performance, stress, load, and regression testing Continuously research and evaluate new testing technologies, tools, and methodologies to improve efficiency and effectiveness Advocate for best practices in testing and quality assurance, contributing to process improvement Develop custom tools and integrate with existing tools to increase engineering productivity Ensure quality, security, reliability, and compliance by testing both functional and non-functional requirements Coordinate test activities within the pod and across other test managers as required Enable and drive a culture of 'automation-first' in the QA space Perform in-sprint automation testing and build regression test suites Analyse errors using logs, database queries, legacy and Unix file systems, etc Expertly manage the complete test and defect lifecycle across agile and waterfall methodologies Generate test reports and share status across multiple levels Capacity planning and management of web, microservices, and mobile applications Performance monitoring and tuning of applications using tools like AppDynamics, AppInsights, Splunk Use quantitative methods to identify performance and throughput bottlenecks Work on large-scale migration projects for financial institutions’ core platforms Requirements Strong proficiency in programming languages such as Java and C Strong experience in LoadRunner Enterprise (2023 or earlier) Experience with test automation frameworks such as Selenium, Cucumber, or similar BDD frameworks Hands-on experience with automation testing for desktop, web, data services, microservices, database, ETL, cloud-based applications, middleware, and OS Experience with CI/CD pipelines Expertise in building frameworks for performance and load tests using tools like Gatling, Locust, LoadRunner Experience with logging and APM tools (AppDynamics, AppInsights, Splunk) Good understanding of Linux performance tuning and database optimisation techniques Experience with WebSphere and Tomcat application servers Strong analytical skills, proactive, detail-oriented, and comfortable working in dynamic, fast-paced environments Excellent communicator with strong written and verbal English skills We offer/Benefits We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

🏢 Summary: The role focuses on designing and maintaining automated test solutions in Java to improve software quality, reduce lead time, and enable rapid feedback through DevOps practices. The engineer will work on API, database, and UI testing while collaborating with cross-functional teams to deliver reliable, high-value business solutions. 🗂️ Requirements: Minimum 3 years of QA experience, Experience in API and database testing, Strong Java expertise, ISTQB Foundation certification or knowledge, Proficiency in Playwright, Understanding of Page Object Model, Experience in UI, REST API and integration testing, Ability to write SQL scripts, Experience working with databases, Familiarity with CI/CD processes, Knowledge of DevOps principles, Understanding of Agile methodologies 📃 Skills: Java, Playwright, TypeScript, SQL, REST, API, CI/CD, DevOps, ISTQB, POM, Databases, Git 🏢 Description: We are seeking a Senior Test Automation Engineer in Java to drive quality and efficiency in our software delivery process by leveraging test automation and DevOps practices. This role is pivotal in reducing lead time, ensuring rapid feedback on application health, and delivering high-value business solutions. Responsibilities Design, test and maintain automated test suites Gain exposure to DevOps tasks to enhance understanding of the software development lifecycle Identify challenges in current processes and innovate solutions to improve productivity and quality Collaborate with Developers, Business Analysts and Quality Assurance professionals to implement optimal solutions for complex business problems Conduct code reviews to ensure high-quality test code aligned with company standards Perform data validation and integration testing with databases Select and implement solutions for thorough database verification, API development and front-end validation Requirements Minimum 3 years of working experience in QA, including testing APIs and databases, with expertise in Java Knowledge of ISTQB Foundation Software Testing Proficiency in test automation tools such as Playwright (TypeScript) and understanding of the Page Object Model pattern Experience in testing user interfaces, REST APIs and application integrations Skills in writing SQL scripts and working with databases Familiarity with CI/CD processes and DevOps principles Background in collaborating with cross-functional teams and business partners of varying seniority Understanding of agile methodologies and team-oriented work environments Capability to work proactively and think critically in dynamic settings Showcase of continuous learning mindset and willingness to explore new tools and technologies Commitment to fostering an inclusive and diverse workplace culture We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview We will reach out to selected candidates exclusively EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.