June 5, 2026
Senior AI Quality Analyst
Senior • Remote
Warsaw, Poland
Svitla Systems Inc. is looking for a Senior AI Quality Analyst for a full-time position (40 hours per week) in Europe.
The AI Quality Analyst is a critical role responsible for ensuring the performance, safety, and reliability of our cutting-edge AI/ML models. You will be at the forefront of our development lifecycle, designing and executing comprehensive evaluation strategies to identify model weaknesses, potential biases, and critical edge cases. This role requires a blend of analytical rigor, technical aptitude, and deep curiosity about how AI models behave in real-world scenarios. You will not only find bugs but also provide actionable insights that drive model improvement and guide our research and development efforts.
Responsibilities
Evaluation Strategy & Benchmark Development: Create and manage a comprehensive set of test cases and evaluation benchmarks. Identify potential failure points, including edge cases, adversarial inputs, and bias sources.
Error Analysis & Failure Triage: Perform systematic error analysis to categorize failures and find underlying patterns. Triage defects, prioritize by severity and impact, and collaborate with the development team for resolution.
Data Sourcing & Curation: Gather, curate, and manage high-quality datasets for model testing and evaluation. Conduct data annotation and validation to maintain data integrity.
Exploratory & Adversarial Testing (Red Teaming): Conduct unscripted exploratory testing to detect unexpected model behaviors. Engage in red teaming exercises to challenge models and uncover safety and security vulnerabilities.
Test Environment Management: Set up, maintain, and troubleshoot testing environments to ensure reliable evaluation pipelines.
Reporting & Insights: Analyze test results and create clear, actionable reports for technical and non-technical audiences. Convert complex findings into tangible recommendations for model improvements.
Process Improvement: Participate in review sessions and help enhance testing methodologies, tools, and quality assurance processes.
Qualifications and Skills
Proven experience in quality assurance, testing, or data analysis, preferably in the AI/ML domain.
A deep understanding of the machine learning lifecycle and common failure modes of AI models.
Hands-on experience with data annotation, data validation, and large dataset management.
Meticulous attention to detail and a methodical approach to problem-solving.
Strong analytical skills, with the ability to identify patterns in data and draw meaningful conclusions.
Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.
Experience with bug-tracking systems (e.g., Jira) and test case management tools.
Nice to have
Basic scripting skills (e.g., Python) for test automation and data manipulation.
Familiarity with computer vision or other specific AI domains relevant to our work.
Similar jobs you might like
Technology
Svitla Systems
Senior Automation QA Engineer with AI
Senior
Hybrid
Krakow, Poland
🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and leading test strategy for AI-powered and deterministic systems in a production-grade platform. The position involves creating scalable automation frameworks, validating non-deterministic AI behaviors, and ensuring high quality standards across backend, API, and frontend layers. The engineer will shape QA processes and tooling within a newly formed team. 🗂️ Requirements: Strong experience in Java or Node.js or TypeScript, Experience building and maintaining test automation frameworks, Hands-on experience with API, backend, and frontend test automation, Strong knowledge of test design principles, Experience with LLMs and AI tools in development or testing, Ability to design validation strategies for AI-driven and non-deterministic systems, Experience with HTTP protocols and browser DevTools 📃 Skills: Java, Node.js, TypeScript, Playwright, REST, RESTAssured, LLM, AI, HTTP, DevTools, API, Automation, Testing 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Office work is expected 2-3 days per week. Requirements : Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities. Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving. Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications. Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging). Responsibilities : Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, other activities Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!
Technology
Svitla Systems
Senior Automation QA Engineer with AI
Senior
Hybrid
Krakow, Poland
🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and leading the QA strategy for AI-powered and deterministic systems in a production-grade platform. The position involves designing and implementing scalable test automation frameworks, validating non-deterministic AI components, and ensuring overall system reliability and quality. Hybrid work model with significant ownership over testing processes, tools, and standards. 🗂️ Requirements: Strong experience in Java or Node.js or TypeScript, Experience building and maintaining test automation frameworks, Hands-on test automation for APIs, backend services, and front-end applications, Experience with Playwright or REST Assured, Experience working with LLMs and AI tools, Understanding of test design principles, Experience testing AI-driven and non-deterministic systems, Knowledge of HTTP protocols and browser DevTools 📃 Skills: Java, Node.js, TypeScript, Playwright, REST, RESTAssured, LLM, AI, HTTP, DevTools, API, Automation 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland . Our client is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Hybrid mode with 2–3 days per week working from the office in Kraków. Requirements: Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities. Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving. Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications. Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging). Responsibilities: Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured). Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. Own the execution and management of both manual and automated test cases. Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in the workspace, either remote or in our welcoming office. Comprehensive medical insurance after one month. MultiSport card with access to 2500 sports facilities all over Poland Bonuses for recommendations of new employees. Bonuses for article writing, public talks, and other activities. 15 vacation days, 10 national holidays, 10 sick leaves, and family days off. Personalized learning program tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Welcome and anniversary presents, gifts for children, and more. Regular corporate events and meetups. Awesome team, friendly and supportive community! Ref #4832
Technology
New offer
Svitla Systems
Middle Automation QA Engineer with AI
Mid
Hybrid
Kraków, Poland
🏢 Summary: Full-time Middle Automation QA Engineer role focused on testing AI-powered systems and building QA strategy from the ground up in a hybrid Kraków setup. The position involves developing automation frameworks, validating non-deterministic AI behaviors, and improving quality processes for production-grade platforms. Candidates will work with modern web applications, APIs, and AI-driven products using Node.js, TypeScript, and Playwright. 🗂️ Requirements: 3+ years of commercial QA experience, Manual and automation testing experience, Node.js experience, TypeScript experience, Playwright experience, API testing experience, Backend services testing experience, Modern web application testing experience, Experience building test automation frameworks, Experience defining QA processes and testing strategy, Experience testing AI-powered or non-deterministic systems or strong interest in AI-driven products, Familiarity with LLMs, Strong analytical and problem-solving skills, Strong communication skills 📃 Skills: Node.js, TypeScript, Playwright, API, LLMs, Java, REST, RESTAssured, HTTP 🏢 Description: Svitla Systems Inc. is looking for a Middle Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is a British wholesale distributor. This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for an experienced AQA professional who will be responsible for testing the outputs of an AI-based system. The ideal candidate will define and build the QA strategy from the ground up, establishing test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors. Hybrid mode with 2–3 days per week working from the office in Kraków. Requirements: - 3+ years of commercial experience as a Quality Assurance Engineer, including both manual and automation testing. - Strong hands-on experience with Node.js and TypeScript for test automation. - Proven experience with Playwright for end-to-end test automation. - Experience testing APIs, backend services, and modern web applications. - Ability to build and improve test automation frameworks, QA processes, and testing strategy. - Experience testing AI-powered or non-deterministic systems, or a strong interest in working with AI-driven products. - Familiarity with LLMs and AI-assisted development/testing tools. - Strong analytical, problem-solving, and communication skills, with the ability to thrive in fast-paced, ambiguous environments. Nice to have: - Experience with Java. - Experience with REST Assured/REST API testing. Responsibilities: - Develop and continuously enhance robust, scalable test automation frameworks using Node.js or TypeScript (Playwright). - Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product. - Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds. - Own the execution and management of both manual and automated test cases. - Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution. - Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality. - Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems. We offer: - US and EU projects based on advanced technologies. - Competitive compensation based on skills and experience. - Regular performance appraisals to support your growth. - Flexibility in the workspace, either remote or in our welcoming office. - Comprehensive medical insurance after one month. - MultiSport card with access to 2500 sports facilities all over Poland. - Bonuses for recommendations of new employees. - Bonuses for article writing, public talks, and other activities. - 15 vacation days, 10 national holidays, 10 sick leaves, and family days off. - Personalized learning program tailored to your interests and skill development. - Free tech webinars and meetups. - Welcome and anniversary presents, gifts for children, and more. - Regular corporate events and meetups. - Awesome team, friendly and supportive community!
Technology
Svitla Systems
Senior AQA Engineer with AI
Senior
Hybrid
Krakow, Poland
🏢 Summary: Full-time Senior Automation QA Engineer role focused on building and establishing quality and automation foundations for a new AI-driven, API-based application module. The position involves designing and maintaining automated tests across frontend, backend, and microservices layers, with strong emphasis on AI-assisted testing and CI/CD integration. Hybrid work model in Kraków with collaboration in a distributed engineering team. 🗂️ Requirements: Experience in frontend, backend, and API testing, Practical experience applying AI tools in testing and SDLC, Understanding of microservices-based systems, Knowledge of HTTP and RESTful APIs, Hands-on experience with REST Assured or Playwright, Experience integrating automated tests into CI/CD pipelines, Experience with GitHub Actions, Experience with service mocking and contract testing (WireMock, Pact), Experience with Java and Spring Boot environments, Experience with JavaScript-based frontend applications 📃 Skills: Java, Spring, JavaScript, PostgreSQL, REST, HTTP, Microservices, RESTAssured, Playwright, GitHubActions, WireMock, Pact, AI, CI/CD, Jira, Zephyr, xAPI, MFE, BFF 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Poland. Our client is one of the world's largest food retailers. The team is launching a greenfield project to build a new module for the app. One of the main objectives of this project is to utilize AI as much as possible across every part of the delivery - from design and development to testing, automation, and delivery. The team needs an Automation QA Engineer with experience using AI in a daily tester's job. As an AQA Engineer, you'll be a key contributor to defining and implementing the quality and automation foundations for a distributed, API‐driven system. You'll collaborate closely with engineers and product teams, ensuring quality is built in from the earliest stages and supported by robust automation and AI‐assisted testing. Office work is expected 2-3 days per week in Kraków. CET Working hours. Tech stack: Micro Frontends (MFE) with a Backend for Frontend (BFF)/ xAPI + Enterprise APIs. Backend: Java (Spring Boot). Frontend: JavaScript. Database: PostgreSQL. Requirements: Solid understanding of QA methodologies, with hands‐on experience in frontend, backend, and API testing. Strong interest and practical experience in applying AI tools to testing, automation, and SDLC optimization. Understanding of testing microservices‐based systems. Practical knowledge of HTTP and RESTful APIs. Hands‐on experience with test automation frameworks (like REST Assure, Playwright). Experience working with CI/CD pipelines, preferably GitHub Actions. Familiarity with service mocking and contract testing (WireMock, Pact). Nice to have: Experience with performance testing. Experience setting up or maintaining test environments. Basic cloud knowledge (Azure / AWS). Responsibilities: Collaborate early with the engineering team to influence requirements and define effective test strategies. Design, develop, and maintain automated tests for backend services, APIs, UI, and end‐to‐end flows. Validate service interactions and data flows across microservices and BFF layers. Integrate automated tests into CI/CD pipelines (GitHub Actions). Actively apply AI‐supported tools to improve test design, execution, and maintenance. Produce clear test reports and participate in test automation code reviews. Manage test cases and test cycles (Jira Zephyr). We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!
Technology
Svitla Systems
Senior Back End Engineer with AI/LLM experince
Senior
Remote
Warsaw, Poland
🏢 Summary: Full-time Senior Back End Engineer role with an AI/LLM focus, responsible for building scalable backend systems and leading the integration of AI capabilities into products and engineering workflows. The position combines hands-on backend development with designing MCP servers, RAG pipelines, and AI-driven automation. It requires driving advanced adoption of LLMs and AI tooling across the development lifecycle. 🗂️ Requirements: 5+ years backend or full-stack software engineering experience, Proficiency in at least one backend language: Python, Go, Node.js, TypeScript, or Java, Experience designing and building production REST or GraphQL APIs, Experience with distributed systems, Strong knowledge of relational databases such as PostgreSQL or MySQL, Experience with caching, queues, and event-driven architectures, Experience with AWS, GCP, or Azure, Experience with CI/CD, containerization, and infrastructure as code, Hands-on experience building or integrating MCP servers, Experience implementing RAG pipelines with embeddings and retrieval logic, Experience integrating LLM APIs in production environments, Experience building AI agents or agentic workflows, Experience with prompt engineering and LLM evaluation, Experience fine-tuning or customizing models, Experience automating testing, code review, or deployment using AI 📃 Skills: Python, Go, Node.js, TypeScript, Java, REST, GraphQL, PostgreSQL, MySQL, AWS, GCP, Azure, CI/CD, Docker, Kubernetes, MCP, RAG, LLM, OpenAI, Anthropic, LangChain, LangGraph, AutoGen, Pinecone, Weaviate, pgvector, Chroma 🏢 Description: Svitla Systems Inc. is looking for a Senior Back End Engineer with AI/LLM for a full-time position (40 hours per week) in Europe. Our client generates opportunities for innovation and enhances time and cost efficiencies for MVNOs, mobile operators, and businesses providing connectivity within the telecom ecosystem. You will not only deliver production-grade backend and full-stack systems, but also help lead the organization's adoption of progressive AI tooling and engineering practices. It is a hands-on engineering role with an AI-forward mandate: we want someone who pushes the team beyond passive AI use to build, integrate, and operationalize AI capabilities across our codebase, workflows, and products. Requirements 5+ years of experience in software engineering in backend or full-stack roles. Strong knowledge of at least one modern backend language (Python, Go, Node.js/TypeScript, Java, or similar). Experience designing and building production REST/GraphQL APIs and distributed systems. Extensive knowledge of databases (PostgreSQL, MySQL, or similar) and familiarity with caching, queues, and event-driven architectures. Knowledge of cloud environment (AWS, GCP, or Azure) and modern DevOps practices (CI/CD, containerization, infrastructure as code). Have experience not just using AI (as in using Claude, Cursor, and Codex), but also building an MCP server, understanding of the RAG and LLM, and LPM that can help automate the testing, etc. Strong written and verbal communication; able to mentor and influence peers. Hands-on experience with AI/LLM engineering, including at least several of the following: Building or integrating with MCP servers; Implementing RAG pipelines (embeddings, vector databases, retrieval logic); Working with LLM APIs (OpenAI, Anthropic, Google) in production; Building AI agents or agentic workflows (LangChain, LangGraph, AutoGen, or similar); Prompt engineering and LLM evaluation; Fine-tuning or model customization; Active, sophisticated use of AI coding assistants (Claude Code, Cursor, Codex, GitHub Copilot) - able to articulate workflows, limits, and best practices; Experience automating engineering processes (testing, code review, deployment) with AI. Nice to have Open-source contributions to AI/LLM tooling or the MCP ecosystem. Familiarity with vector databases (Pinecone, Weaviate, pgvector, Chroma). Background in telecommunications, networking, or SaaS infrastructure Familiarity with model evaluation frameworks and AI observability tools. Bachelor's or Master's in Computer Science or a related field. Responsibilities Design, build, and maintain scalable backend services and APIs supporting the platform. Contribute to full-stack feature development, collaborating with frontend, infrastructure, and product teams. Write clean, well-tested, production-ready code with strong attention to performance, reliability, and maintainability. Participate in architecture decisions, code reviews, and technical planning. Lead by example in advanced AI tool adoption — go beyond using Claude, Cursor, and Codex to shape how the team uses them actively. Design and build MCP servers to expose internal data sources, APIs, and tools to LLMs and AI agents. Architect and implement RAG systems for internal and product-facing use cases. Apply working knowledge of LLMs and LPMs to evaluate, fine-tune, and integrate models into engineering workflows. Build AI-driven automation for testing, code review, documentation, and operational workflows. Mentor engineers on effective AI tool usage, prompt engineering, and AI-augmented development practices. Evaluate emerging AI tools, frameworks, and platforms; recommend adoption strategies. We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!
Technology
Svitla Systems
Senior QA Engineer
Senior
Remote
Warsaw, Poland
🏢 Summary: Full-time Senior QA Engineer role focused primarily on manual testing of a React Native mobile application integrated with hardware devices. The position involves validating mobile features, hardware data processing, and CI/CD pipelines while collaborating with development and hardware teams. Limited automation tasks may be required, mainly maintaining existing E2E tests. 🗂️ Requirements: 4+ years of manual testing experience, Strong experience in manual mobile application testing, Understanding of API-based systems and data flows, Basic knowledge of Bluetooth and MQTT from testing perspective, Experience testing on real devices, Ability to read and analyze CI/CD build logs, Experience with regression testing, Ability to maintain E2E tests, Professional English proficiency 📃 Skills: ManualTesting, MobileTesting, ReactNative, iOS, Android, API, Bluetooth, MQTT, CI/CD, Bitrise, Detox, TypeScript, JavaScript, macOS 🏢 Description: Svitla Systems Inc. is looking for a Senior QA Engineer for a full-time position (40 hours per week) in Europe. Our client is a company that creates interactive games, quizzes, and adventures specifically designed for children. We're looking for a tester who's comfortable focusing on mostly manual testing for now, with limited automated testing possible (there is no environment to support it yet). Requirements: 4+ years of experience in manual testing (AQA experience is a plus). Experience in small to medium companies preferred, not in startups. Strong understanding of manual mobile application testing. Understanding of API-based systems and data flows (polling, backend interactions). Basic understanding of Bluetooth and MQTT from a testing perspective. Experience working with real devices. Expertise in reading and understanding CI/CD build logs. Excellent written and spoken English. Excellent communication skills and initiative to report product/feature/software issues immediately. Ability to self-structure your work in an ambiguous environment. Sharp attention to detail and solid communication skills. Curiosity and comfort digging into unfamiliar parts of the product. Nice to have: Basic knowledge of TypeScript/JavaScript. Basic understanding of APIs or testing automation concepts. Experience triggering builds and running tests locally on macOS. Previous experience testing products with hardware integration. Responsibilities: Perform manual testing of a React Native mobile application (iOS / Android). Validate user-facing insights generated from hardware data and displayed in the app after processing. Use a real hardware device (Bluetooth box) to generate test data for QA purposes. Execute regression testing and verify new features before release. Analyze CI/CD pipeline failures in Bitrise and review build/test logs. Collaborate closely with developers and a separate hardware-focused team. Maintain and adjust existing E2E tests (Detox) when minor issues are identified. Work independently, organize your own testing focus, and adapt as requirements evolve. Verify fixes and keep track of riskier areas. Mostly manually test the company’s music box features and functions. Spot, reproduce, and clearly describe bugs. Occasionally prepare automated testing scenarios (rarely). We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, other activities Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!
Technology
New offer
Superdevs
Senior AI Tester (German & English)
Senior
Remote
🏢 Summary: Senior AI Tester role for a long-term public sector project focused on validating AI-powered applications in regulated environments. The position involves designing and executing testing strategies across the AI lifecycle, ensuring robustness, fairness, compliance, and quality. Fully remote work with occasional collaboration in Berlin and opportunities to shape AI quality standards. 🗂️ Requirements: 5+ years of Software Testing experience, Experience designing and executing software testing strategies, Strong knowledge of software testing methodologies, Strong understanding of QA best practices, Experience with AI-powered applications or strong interest in AI Testing, Bachelor's degree in Computer Science or related technical field, Professional English proficiency 📃 Skills: AI, Testing, QA, ISTQB, Automation, AnomalyDetection, BiasDetection, LoadTesting, StressTesting, BoundaryTesting, ScenarioTesting, Compliance 🏢 Description: About We are looking for an experienced Senior AI Tester to join a long-term public sector project focused on validating and ensuring the quality of AI-powered applications. You will play a key role in designing and executing comprehensive testing strategies across the entire AI system lifecycle, ensuring reliability, robustness, fairness, and compliance in highly regulated environments. This is an excellent opportunity for professionals passionate about AI quality assurance, software testing, and responsible AI. Responsibilities - Design and execute risk-based testing strategies for AI-powered applications. - Validate the functionality, robustness, and output quality of AI systems throughout their lifecycle. - Utilize AI-assisted testing and analysis tools for automated test case generation, test management, documentation, anomaly detection, bias identification, and output stability analysis. - Develop testing methodologies to identify biased or discriminatory AI behavior, non-deterministic model responses, model drift, and unexpected AI behavior. - Plan and execute load, stress, boundary, and scenario testing under realistic operating conditions. - Define and maintain quality metrics to continuously assess AI accuracy, consistency, and stability. - Lead testing activities and contribute to the definition of testing standards within a regulated public sector environment. - Collaborate closely with development, AI, and project teams to ensure high-quality AI solutions. Our offer - Long-term international project within the public sector. - Opportunity to work on cutting-edge AI technologies. - Fully remote work with occasional on-site collaboration in Berlin. - Stable, long-term engagement. - Collaboration with experienced AI and software engineering professionals. - The opportunity to shape quality standards for next-generation AI solutions. What you bring - 5+ years of experience in Software Testing - Experience designing and executing software testing strategies. - Strong understanding of software testing methodologies and QA best practices. - Experience working with AI-powered applications or strong interest in AI Testing. - Bachelor's degree in Computer Science or a related technical field. Nice to have - ISTQB® Certified Tester Foundation Level - ISTQB® AI Testing (Foundation Extension) - ISTQB® Advanced Level (Test Analyst / Technical Test Analyst) - Equivalent software testing certifications - Experience in regulated industries or public sector projects - Knowledge of AI ethics, fairness, bias detection, and explainability Languages - English – Professional proficiency - German – Working proficiency (preferred due to the project environment)
Technology
Svitla Systems
Senior Automation QA Engineer
Senior
Hybrid
Krakow, Poland
🏢 Summary: Full-time hybrid Senior Automation QA Engineer role focused on backend, API, and frontend test automation for scalable web and mobile products in the food retail domain. The position involves building automated testing frameworks, validating distributed systems, and integrating tests into CI/CD pipelines using modern QA tools and practices. 🗂️ Requirements: 6+ years of experience as an Automation QA Engineer, Strong knowledge of QA methodologies, Experience with backend testing for Java/Kotlin microservices and APIs, Hands-on experience with REST Assured or Karate, Understanding of Playwright, Familiarity with Selenium, Experience with Cucumber, Knowledge of CI/CD pipelines, Experience with GitHub Actions, Understanding of HTTP protocols and RESTful APIs, Experience with Postman, Bruno, or Insomnia, Familiarity with WireMock or Pact, Ability to understand business requirements and domain context 📃 Skills: Java, Kotlin, REST, Playwright, Selenium, Cucumber, RESTAssured, Karate, JUnit, Postman, Bruno, Insomnia, WireMock, Pact, GitHub, HTTP, Zephyr, Jira, CI/CD, API 🏢 Description: Svitla Systems Inc. is looking for a Senior Automation QA Engineer for a full-time hybrid position (40 hours per week) in Poland . Our client is one of the world's largest food retailers. You'll join the team to help build reliable, scalable, and high-quality products across web, mobile, and API platforms. If you thrive on solving complex problems, automating at scale, and working in a collaborative environment, this will be the perfect place for you. Office work in Kraków is expected 3 days per week (but some flexibility is possible). Requirements 6+ years of experience as an Automation QA Engineer. Strong understanding of QA methodologies with a focus on backend testing across Java/Kotlin microservices and APIs, complemented by frontend test automation experience. The ability to quickly learn and understand business requirements and the domain. Hands-on experience with one or more backend testing frameworks (e.g., REST Assured, Karate). Understanding of frontend testing with Playwright, with familiarity with Selenium and the BDD framework (Cucumber). Knowledge of CI/CD tools and pipelines, particularly GitHub Actions. Solid understanding of HTTP protocols, RESTful APIs, eventing and tools like Postman, Bruno or Insomnia. Familiarity with service mocking and contract testing tools (e.g., WireMock, Pact). Nice to have Experience in building and maintaining testing environments. Responsibilities Collaborate early with engineering teams during refinement sessions to influence requirements and define effective test strategies for backend services, APIs, and frontend user journeys. Design, develop, and execute comprehensive test suites for functional, regression, end-to-end API, and customer journey testing. Automate service-level tests using modern frameworks such as REST Assured, JUnit, Karate DSL, Postman/Newman/Bruno. Conduct frontend/UI testing primarily using Playwright; knowledge of Selenium and Cucumber is considered beneficial. Validate service interactions and data flows across distributed systems. Integrate automated tests into CI/CD pipelines (e.g., GitHub Actions) and maintain test environments. Prepare and present clear, actionable test reports that document coverage, results, and defects. Participate in code reviews of test automation scripts to ensure maintainability and adherence to best practices. Manage test cases and cycles using Jira Zephyr. Define and implement a robust framework for automated backend testing, with a focus on Java/Kotlin services and strategic APIs that support complex customer journeys. Ensure test coverage across the full end-to-end application flow, including backend services, frontend user journeys, and integrations with multiple external services. Utilize AI-supported tools to enhance test design, execution, and maintenance. Align with the company's established AQA practices to ensure consistency across teams. We offer US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!
Technology
Svitla Systems
Middle/Senior QA Engineer
Senior
Remote
Krakow, Poland
🏢 Summary: Full-time Middle/Senior QA Engineer role focused primarily on manual testing of a React Native mobile app integrated with hardware devices. The position involves validating mobile features, hardware-generated data, and CI/CD pipelines while collaborating with development and hardware teams. Limited automation is included, with occasional maintenance of existing E2E tests. 🗂️ Requirements: 4+ years of manual testing experience, Strong experience in manual mobile application testing, Understanding of API-based systems and data flows, Basic knowledge of Bluetooth and MQTT from testing perspective, Experience testing on real devices, Ability to read and analyze CI/CD build logs, Professional English proficiency, Experience in small to medium companies (non-startup) 📃 Skills: ManualTesting, MobileTesting, ReactNative, iOS, Android, API, Bluetooth, MQTT, CI/CD, Bitrise, Detox, TypeScript, JavaScript, macOS 🏢 Description: Svitla Systems Inc. is looking for a Middle/Senior QA Engineer for a full-time position (40 hours per week) in Europe. Our client is a company that creates interactive games, quizzes, and adventures specifically designed for children. We're looking for a tester who's comfortable focusing on mostly manual testing for now, with limited automated testing possible (there is no environment to support it yet). Requirements: 4+ years of experience in manual testing (AQA experience is a plus). Experience in small to medium companies preferred, not in startups. Strong understanding of manual mobile application testing. Understanding of API-based systems and data flows (polling, backend interactions). Hands on experience with Bluetooth and MQTT from a testing perspective. Experience working with real devices. Expertise in reading and understanding CI/CD build logs. Excellent written and spoken English. Excellent communication skills and initiative to report product/feature/software issues immediately. Ability to self-structure your work in an ambiguous environment. Sharp attention to detail and solid communication skills. Curiosity and comfort digging into unfamiliar parts of the product. Nice to have: Basic knowledge of TypeScript/JavaScript. Basic understanding of APIs or testing automation concepts. Experience triggering builds and running tests locally on macOS. Previous experience testing products with hardware integration. Responsibilities: Perform manual testing of a React Native mobile application (iOS / Android). Validate user-facing insights generated from hardware data and displayed in the app after processing. Use a real hardware device (Bluetooth box) to generate test data for QA purposes. Execute regression testing and verify new features before release. Analyze CI/CD pipeline failures in Bitrise and review build/test logs. Collaborate closely with developers and a separate hardware-focused team. Maintain and adjust existing E2E tests (Detox) when minor issues are identified. Work independently, organize your own testing focus, and adapt as requirements evolve. Verify fixes and keep track of riskier areas. Mostly manually test the company’s music box features and functions. Spot, reproduce, and clearly describe bugs. Occasionally prepare automated testing scenarios (rarely). We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community! Ref #5117
Technology
Svitla Systems
Senior Full Stack Engineer
Senior
Remote
Warsaw, Poland
🏢 Summary: Full-time Senior Full Stack Engineer role building and scaling a high-throughput cloud platform for call tracking, marketing attribution, real-time analysis, and AI-driven workflows. The position involves hands-on development across backend and frontend systems, contributing to architecture, integrations, and production stability in a fast-moving startup environment. The engineer will work closely with founders to deliver scalable, reliable features with strong ownership and minimal oversight. 🗂️ Requirements: Senior-level full stack engineering experience in production environments, Strong backend development experience with Node.js, Strong frontend development experience with React or similar frameworks, Experience designing and maintaining complex web applications and APIs, Experience with relational databases and production data models, Knowledge of PostgreSQL or similar relational databases, Understanding of REST APIs and distributed system design, Experience integrating third-party APIs and external systems, Ability to debug and troubleshoot production systems, Experience balancing scalability, performance, and maintainability 📃 Skills: Node.js, React, JavaScript, PostgreSQL, SQL, REST, APIs, Redis, Python, HTML, CSS, Git, Cloud, AI 🏢 Description: Svitla Systems Inc. is looking for a Senior Full Stack Engineer for a full-time position (40 hours per week) in Europe. Our client is building an advanced cloud platform for call tracking, marketing attribution, real-time call analysis, and intelligent workflow automation in the pay-per-call and lead generation space. The company is in a hypergrowth phase and is actively scaling both its product platform and engineering capability. The platform combines high-throughput infrastructure, deterministic backend systems, real-time integrations, and AI-driven functionality to support transcription, summarization, extraction, scoring, and increasingly sophisticated agent-enabled workflows. You'll operate with a high degree of independence and make meaningful contributions across both backend and frontend systems. It is a hands-on senior engineering role for someone comfortable working directly with founders, shipping quickly, solving difficult production problems, and contributing to architectural and implementation decisions in a fast-moving startup environment. This role is best suited to an engineer with strong technical depth, sound judgment, product awareness, and the ability to move quickly without creating unnecessary technical debt. The right candidate will not need a heavy process, extensive oversight, or narrow task-by-task direction. This person should be able to step into an evolving system, understand the broader technical and business context, and deliver high-quality work in a practical, efficient way. The engineer will work closely with the founders and the rest of the engineering team, contributing directly to core product and platform development. The client has made it clear that they value engineers based on their performance in a real working environment, not on artificial interview exercises or theoretical problem-solving detached from production realities. Requirements: Strong experience as a Senior Full Stack Engineer, with clear ownership of both backend and frontend production systems. Solid experience in backend engineering with Node.js in real-world production environments. Expertise in frontend engineering with React or similar modern JavaScript frontend frameworks. Understanding of design, build, and maintain complex web applications and APIs that support meaningful business workflows. Strong experience working with relational databases, application data models, and production data access patterns. Knowledge of PostgreSQL or similar relational database technologies in production systems. In-depth understanding of REST APIs, asynchronous workflows, distributed integration patterns, and service-based application design. Experience integrating with third-party APIs and external systems in production environments. Ability to work effectively in evolving codebases and make good engineering decisions without requiring excessive structure or hand-holding. Expertise in debugging and troubleshooting across application logic, integrations, and production issues. Ability to balance delivery speed with long-term maintainability in a startup or high-growth environment. Nice to have: Experience working in startup or hypergrowth environments where engineers are expected to take ownership and move quickly. Familiarity with Redis, caching strategies, job processing, or event-driven application behavior. Exposure to Python and collaboration with AI or data-oriented systems. Experience building or supporting systems with high throughput, near-real-time workflows, or operationally sensitive business logic. Background in AdTech, MarTech, call tracking, attribution platforms, lead generation systems, or analytics-heavy products. Experience building internal operational tooling and admin workflows for technical or business users. Exposure to cloud-native environments and scalable distributed systems. Experience collaborating closely with technical founders, product leadership, or senior engineering stakeholders. Responsibilities: Design, build, and maintain production-grade application features across both backend and frontend systems, with strong attention to scalability, performance, reliability, and maintainability. Develop backend services and APIs using Node.js to support platform capabilities such as workflow orchestration, system integrations, feature logic, internal tooling, and real-time operational processing. Build and enhance frontend applications using React or similar modern frontend technologies to support dashboards, management interfaces, internal tools, and user-facing platform capabilities. Take ownership of significant technical areas and deliver solutions with minimal day-to-day oversight, while collaborating closely with founders and other senior engineers. Work on systems that support high-volume workflows, external integrations, and operationally important product capabilities where responsiveness and reliability matter. Implement and maintain integrations with external partner platforms, APIs, and data-driven systems, including CRM platforms, call-tracking systems, and other third-party services that are central to the product ecosystem. Contribute to architectural discussions and technical decisions related to application structure, data flow, performance optimization, maintainability, and production stability. Investigate and resolve production bottlenecks, system issues, and integration challenges in a practical, efficient manner. Collaborate with AI and data engineering team members where needed to connect backend and frontend product capabilities with intelligent workflows such as transcription, data extraction, scoring, or analytics-driven features. Help establish sound engineering patterns and raise the quality bar as the team scales, including code quality, implementation discipline, and pragmatic technical decision-making. Participate in a fast-moving engineering culture where new features, experiments, and improvements are shipped continuously. We offer: US and EU projects based on advanced technologies. Competitive compensation based on skills and experience. Regular performance appraisals to support your growth. Flexibility in workspace, either remote or our welcoming office. Bonuses for article writing, public talks, and other activities. Generous time off, including vacation, national holidays, sick leaves, and family days. Personalized learning programs tailored to your interests and skill development. Free tech webinars and meetups organized by Svitla. Regular corporate online activities. Awesome team and a friendly, supportive community!