June 23, 2026
System QA Engineer
Mid • On-site
60,000 - 80,004 USD/yr
Fremont, CA
Life at Plume
At Plume, we believe that technology isn't about moving faster, it's about making life's moments better. Which is why we've built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale.
We now deliver services to over 60 million locations globally and have managed over 3 billion devices on our platform. We're expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Internet Service Providers (ISPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data.
With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can't do it exceptionally well, we don't do it. It's how we've assembled a team of world-class builders, thinkers, and doers. And it's how we're reinventing what's possible every day.
Role Description:
We are looking for an experienced QA engineer to help us make sure that the product we are delivering meets both our and our customers' quality expectations. The ideal candidate is a talented engineer who can show initiative, adaptability to a challenging environment, problem-solving skills, and a strong understanding of QA and test automation.
Responsibilities:
- Preparation of feature and regression test plans.
- Design, implementation, execution, and maintenance of manual and automated test cases.
- Design and maintenance of the test environment.
- Review of test results, defect analysis and reporting, and verification of fixed issues.
- Preparation of execution reports.
- Supporting development teams with the testing of new features.
Qualifications:
- 2+ years of QA experience.
- Analytical and problem-solving skills.
- Knowledge of software QA methodologies and processes.
- Understanding of embedded device testing.
- Knowledge of tools and technologies: source control (e.g., Git), defect reporting (e.g., Jira), CI (e.g., Jenkins), JSON, REST.
- Solid foundation with Debian/Ubuntu/Enterprise Linux.
- Comfortable in CLI environment.
- Solid foundation with networking, including strong knowledge of L2/L3 networks (switching, routing, and associated protocols).
- The ability to analyze and solve problems independently.
- Able to read and debug in Python or other scripting languages (Python preferred).
- Fluency in the English language.
Must have:
- Desire to acquire new knowledge
- Great team player with the ability to work with minimal supervision
We are unable to offer sponsorship at this time, now or in the future. Total Compensation package would include: anticipated base compensation range of $60,000.00 - $80,000.00 + bonus + equity + benefits. Benefits include: a 401k plan and a company match, basic life and disability insurance, plus health, dental, vision and other benefits and perks. https://www.plume.com/
An employee's base salary and its position within the range may depend on a number of factors including job related knowledge, education, skills, experience and other business related considerations. Published ranges are provided in good faith at the time of posting.
This role requires someone to come into our Union City, CA test house 5 days per week.
About Plume
As the creator of the only open, hardware-independent, cloud-controlled experience platform for ISPs and their subscribers, Plume partners with over 400 ISP customers, including some of the world's largest such as Comcast, Charter, Liberty Global, and J:COM.
Using OpenSync, the most widely supported open-source, silicon-to-cloud framework for smart spaces, Plume's software-defined network allows ISPs to decouple their service offerings from hardware and rapidly curate and deliver new services over a multi-vendor, open-platform architecture.
Plume is an equal opportunity workplace that maintains a continuing policy of nondiscrimination in all employment practices and decisions, ensuring equal employment opportunities for all qualified individuals without regard to race, color, creed, religion, sex, national origin, age, physical or mental disability, sexual orientation, gender identity, marital status, pregnancy, childbirth or related individual conditions, medical conditions (as defined by state law), military or veteran status, or any other characteristic protected by federal, state or local law.
Similar jobs you might like
Technology

Plume
System QA Intern
Intern
On-site
Union City, CA
25 - 35 USD/hr
🏢 Summary: System QA Intern role focused on supporting manual and automated testing, regression planning, defect analysis, and test environment maintenance in a fast-paced SaaS and smart-home technology environment. The position offers hands-on experience in quality assurance, automation, and collaboration with development teams. On-site presence in Union City, CA is required five days per week. 🗂️ Requirements: Pursuing or recently completed degree in Computer Science, Engineering, or related field, Understanding of software QA methodologies and processes, Fluency in English, Ability to work on-site in Union City, CA five days per week, Strong collaboration and initiative skills 📃 Skills: QA, Python, Git, Jira, CLI, Networking 🏢 Description: Life at Plume At Plume, we believe that technology isn't about moving faster, it's about making life's moments better. Which is why we've built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale. We now deliver services to over 60 million locations globally and have managed over 3 billion devices on our platform. We're expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Internet Service Providers (ISPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data. With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can't do it exceptionally well, we don't do it. Role Description: We are looking for a System QA Intern to join our team and help ensure that the products we deliver meet both our and our customers' quality expectations. This is a great opportunity for someone who is eager to learn, enjoys problem-solving, and wants to gain hands-on experience in quality assurance and test automation in a fast-paced environment. Responsibilities: - Assist in the preparation of feature and regression test plans - Support the design, implementation, and execution of manual and automated test cases - Help maintain and improve the test environment - Review test results, assist with defect analysis and reporting, and verify fixed issues - Help prepare execution reports - Collaborate with development teams to support testing of new features Qualifications: - Currently pursuing or recently completed a degree in Computer Science, Engineering, or a related technical field - Basic understanding of software QA methodologies and processes - Familiarity with tools such as Git, Jira, or similar is a plus - Exposure to Python or other scripting languages is a plus - Basic knowledge of networking concepts is a plus - Comfortable working in a CLI environment is a plus - Fluency in the English language Must Have: - A strong desire to learn and grow - Great team player who can collaborate effectively and take initiative - Eagerness to tackle new challenges in a dynamic environment Please note that we are unable to offer visa sponsorship now or in the future. The anticipated hourly rate for this position is $25.00 – $35.00. This role requires someone to come into our Union City, CA test house 5 days per week.
Technology

Plume
Senior Wireless Firmware Engineer
Senior
Remote
Raleigh, NC
140,004 - 150,000 USD/yr
🏢 Summary: Senior Wireless Firmware Engineer role focused on leading the design and development of WiFi firmware and low-level drivers for next-generation wireless platforms, working across embedded systems and Linux networking stacks. The position involves owning critical components of the WiFi stack, optimizing performance, and driving large-scale wireless deployments. This is a high-impact remote role requiring deep expertise in IEEE 802.11 technologies and chipset-level driver development. 🗂️ Requirements: BS/MS/PhD in Computer Science, Electrical Engineering, or related field, 8+ years of experience in embedded systems, firmware, or driver development, Proven experience leading complex technical projects end-to-end, Strong expertise in C/C++, Deep experience with WiFi driver development at chipset/SoC level, Strong understanding of Linux kernel and networking stack, Deep knowledge of IEEE 802.11 MAC and PHY layers, Experience with OpenWRT, RDK, or OpenSync, Strong debugging and performance optimization skills, Residence in EST time zone, Authorization to work without sponsorship 📃 Skills: C, C++, Linux, WiFi, IEEE802.11, MAC, PHY, OpenWRT, RDK, OpenSync, Broadcom, Qualcomm, MediaTek, MU-MIMO, OFDMA, Beamforming, Python 🏢 Description: Life at Plume At Plume, we believe that technology isn't about moving faster, it's about making life's moments better. Which is why we've built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale. We now deliver services to over 60 million locations globally and have managed over 3 billion devices on our platform. We're expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Internet Service Providers (ISPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data. With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can't do it exceptionally well, we don't do it. It's how we've assembled a team of world-class builders, thinkers, and doers. And it's how we're reinventing what's possible every day.About the Role Plume's Core Engineering team is looking for a Senior Wireless Firmware Engineer with deep expertise in WiFi driver development to lead innovation for large-scale WiFi and broadband solutions. You will work across embedded firmware, wireless drivers, and system-level software to enable high-performance, scalable, and reliable WiFi experiences. This is a high-impact senior role where you will lead complex initiatives in wireless networking, performance optimization, and large-scale deployments, while mentoring other engineers and influencing system architecture. What You'll Do - Lead design and development of WiFi firmware and driver architecture for next-generation wireless platforms - Own critical components of the WiFi stack and drive technical direction across projects - Mentor junior engineers and provide technical guidance across firmware and driver domains - Design, develop, and optimize WiFi firmware and low-level wireless drivers - Work on IEEE 802.11 stack (WiFi 4/5/6/6E/7), including MAC/PHY layers - Debug and optimize WiFi drivers with chipset/SoC vendors - Analyze network behavior and improve performance (throughput, latency, reliability) - Participate in full software lifecycle: design, development, testing, deployment, and support - Troubleshoot complex system-level issues across firmware, drivers, and networking stacks Required Qualifications - BS/MS/PhD in Computer Science, Electrical Engineering, or related field - 8+ years of experience in embedded systems, firmware, or driver development - Proven experience leading complex technical projects end-to-end - Strong expertise in C/C++ - Deep experience with WiFi driver development at chipset/SoC level - Strong understanding of Linux kernel and networking stack - Deep knowledge of IEEE 802.11 MAC and PHY layers - Experience with OpenWRT, RDK, or OpenSync - Strong debugging and performance optimization skills Preferred Qualifications - Experience with Broadcom, Qualcomm, or MediaTek WiFi chipsets - Experience with mesh networking and large-scale deployments - Knowledge of MU-MIMO, OFDMA, beamforming, WiFi 7 - Python or scripting for automation - Familiarity with cloud-managed networking systems What You Bring - Strong ownership and leadership mindset - Ability to solve complex, ambiguous problems - Experience mentoring engineers - Excellent communication and collaboration skills - Passion for building high-performance wireless systems This role is fully remote but requires someone to reside in EST. The total compensation package would include an anticipated compensation range of $140,000.00 - $150,000.00, plus bonus, equity, and benefits. Benefits include: a 401 (k) plan and a company match, basic life insurance, plus unparalleled health, dental, vision, and other benefits and perks. An employee's base salary and its position within the range may depend on several factors, including job-related knowledge, education, skills, experience, and other business-related considerations. Published ranges are provided in good faith at the time of posting. #LI-Remote, #RemoteJobs, #WorkFromHome, #RemoteWork, #WFHAbout Plume As the creator of the only open, hardware-independent, cloud-controlled experience platform for ISPs and their subscribers, Plume partners with over 400 ISP customers, including some of the world's largest such as Comcast, Charter, Liberty Global, and J:COM. Using OpenSync, the most widely supported open-source, silicon-to-cloud framework for smart spaces, Plume's software-defined network allows ISPs to decouple their service offerings from hardware and rapidly curate and deliver new services over a multi-vendor, open-platform architecture. Plume is an equal opportunity workplace that maintains a continuing policy of nondiscrimination in all employment practices and decisions, ensuring equal employment opportunities for all qualified individuals without regard to race, color, creed, religion, sex, national origin, age, physical or mental disability, sexual orientation, gender identity, marital status, pregnancy, childbirth or related individual conditions, medical conditions (as defined by state law), military or veteran status, or any other characteristic protected by federal, state or local law.
Technology

Plume
Staff Product Manager
Senior
On-site
Denver, CO
159,000 - 185,004 USD/yr
🏢 Summary: Senior technical product leadership role owning the vision, strategy, and execution of an API gateway platform and external developer ecosystem for connected home and ISP solutions, with deep focus on WiFi standards, broadband protocols, and data models. The role drives roadmap for USP (TR-369) and TR-181 interfaces, represents the company in standards bodies, and builds scalable developer programs and tooling for large-scale integrations. It combines platform product management, protocol expertise, and developer advocacy at enterprise scale. 🗂️ Requirements: BS/MS/PhD in Computer Science, Engineering, Telecommunications or related field, 8+ years in technical product management, platform engineering, or developer relations in broadband/telecommunications/connected-home industry, Strong knowledge of USP (TR-369), TR-069, and TR-181 data models, Experience authoring, extending, or reviewing data model schema definitions, Hands-on experience with API gateway platforms and RESTful and event-driven API design, Experience with developer tooling such as OpenAPI/Swagger and Postman, Proficiency with git-based workflows and configuration-as-code patterns, Active participation in standards bodies (BBF, IETF, IEEE or similar), Experience building or scaling external developer ecosystems or API platforms, In-depth knowledge of WiFi standards (802.11a/b/g/n/ac/ax/be), RF fundamentals, roaming, mesh, band steering, QoS, Current CWNA certification, Ability to work without sponsorship 📃 Skills: USP, TR-369, TR-069, TR-181, WiFi, 802.11, RF, Mesh, QoS, API, REST, OpenAPI, Swagger, Postman, Git, CI/CD, Chef, Ansible, Jira, Confluence, BBF, IETF, IEEE, CWNA, CWSP, CWDP, CWAP, CWNE, AI 🏢 Description: Life at Plume At Plume, we believe that technology isn't about moving faster, it's about making life's moments better. Which is why we've built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale. We now deliver services to over 60 million locations globally and have managed over 3 billion devices on our platform. We're expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Internet Service Providers (ISPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data. With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can't do it exceptionally well, we don't do it. It's how we've assembled a team of world-class builders, thinkers, and doers. And it's how we're reinventing what's possible every day.Role Description: As Staff Product Manager, API & Developer Ecosystem, you will own the vision, strategy, and success of Plume's API gateway platform and the developer ecosystem built on top of it.This includes defining and driving the roadmap for USP (TR-369) and TR-181 data model–based interfaces, API gateway architecture, and the tooling that enables ISP and third-party developers to build, test, and deploy integrations at scale across millions of connected homes. You'll be equal parts WiFi domain expert, standards authority, platform product leader, and developer advocate—someone who can author and review data model schemas, shape git-based cookbook workflows for partner onboarding, and rally cross-functional teams to deliver world-class developer experiences. You'll be the founding force behind Plume's external developer ecosystem, establishing the programs, documentation, and community that turn our API gateway into an open platform ISPs and their technology partners build on. This is a high-visibility, high-impact role for a technical product leader who bridges deep WiFi, protocol, and data-model expertise with the ability to build thriving developer communities—someone equally comfortable analyzing 802.11 roaming behavior, debating USP message semantics in a BBF working group, and presenting a platform go-to-market strategy to executives. Responsibilities: Drive forward the API Gateway & Data Model Roadmap: define and prioritize the product roadmap for Plume's API gateway, USP (TR-369) controller interfaces, and TR-181 data model extensions, aligning with company strategy and ISP partner needs. Build the Developer Ecosystem: establish and grow an external developer program from the ground up—including developer portals, documentation, sandbox environments, sample cookbooks, and community engagement—to drive third-party adoption of Plume's platform APIs. Drive Standards & Data Schema Design: represent Plume in Broadband Forum (BBF) and related standards bodies; author, review, and extend TR-181 data model objects and USP protocol specifications to meet product and partner requirements. Lead Cross-Functional Collaboration: partner with engineering, firmware, cloud platform, marketing, sales, and customer success teams to deliver cohesive API products and developer tools. Champion the Voice of the Customer & Partner: ensure ISP operator needs, developer pain points, and partner integration requirements are at the heart of every platform decision. Measure, Learn & Adapt: define API adoption metrics, developer engagement KPIs, and integration success criteria; use data-driven insights to iterate on the platform and ecosystem strategy. Qualifications: BS/MS/PhD in Computer Science, Engineering, Telecommunications, or related field. 8+ years in technical product management, platform engineering, or developer relations roles within the broadband, telecommunications, or connected-home industry. Strong working knowledge of USP (TR-369), TR-069, and TR-181 data models—including experience authoring, extending, or reviewing data model schema definitions. Hands-on experience with API gateway platforms, RESTful and event-driven API design, and developer tooling (OpenAPI/Swagger, Postman, developer portals). Proficiency with git-based workflows, configuration-as-code patterns, and cookbook/recipe-style integration templates (e.g., Chef, Ansible, or custom git-managedcookbooks). Previous active participation in a standards body or alliance (BBF, IETF, IEEE, or similar); experience contributing to or editing published specifications is strongly preferred. Experience building or scaling a developer ecosystem, partner program, or external API platform for a B2B or infrastructure product. In-depth knowledge of WiFi technologies and standards (802.11a/b/g/n/ac/ax/be), including RF fundamentals, roaming, mesh networking, band steering, and QoS mechanisms. Ability to serve as a resident WiFi subject-matter expert within the organization. Current CWNA (Certified Wireless Network Administrator) certification required; CWSP, CWDP, CWAP, or CWNE certification strongly preferred. Experience & Skills: Demonstrated success defining product vision, setting strategy, and driving execution across the full product lifecycle for platform or API products. Deep technical acumen spanning WiFi (802.11 standards, RF design, mesh architectures) and broadband protocols, with the ability to read and write data model schemas, discuss API architecture and protocol tradeoffs with engineering, and contribute hands-on to specification documents. Proven ability to establish developer programs from scratch: writing technical documentation, creating quickstart guides and cookbooks, and building feedback loops with an external developer community. Effective communicator with demonstrated ability to influence at all levels of the organization, present to leadership, and serve as the external evangelist for the platform. Proficiency in Jira, Confluence, git (including branching strategies, pull-request workflows, and CI/CD pipelines), and other product development tools. Proven ability to operate and lead in agile environments with experience in iterative development, backlog prioritization, and rapid prototyping. Demonstrated ability to leverage modern AI tools and rapid prototyping platforms (ChatGPT, Perplexity, Replit, Cursor, etc.) to accelerate product discovery and developer experience innovation. Experience managing platform products at large scale, including API versioning, backward compatibility, rate limiting, and ensuring performance, reliability, and security for enterprise customers and their developer communities. We are unable to offer sponsorship at this time. Total Compensation package would include: anticipated base compensation range of $159,000.00 - $185,000.00 + bonus + equity + benefits. Benefits include: a 401k plan and a company match, basic life insurance plus unparalleled health, dental, vision and other benefits and perks. Please see here for more details. An employee's base salary and its position within the range may depend on a number of factors including job related knowledge, education, skills, experience and other business related considerations. Published ranges are provided in good faith at the time of posting.#RemoteWork #LI-Remote #WorkFromHome #RemoteJob #WFHAbout Plume As the creator of the only open, hardware-independent, cloud-controlled experience platform for ISPs and their subscribers, Plume partners with over 400 ISP customers, including some of the world's largest such as Comcast, Charter, Liberty Global, and J:COM. Using OpenSync, the most widely supported open-source, silicon-to-cloud framework for smart spaces, Plume's software-defined network allows ISPs to decouple their service offerings from hardware and rapidly curate and deliver new services over a multi-vendor, open-platform architecture. Plume is an equal opportunity workplace that maintains a continuing policy of nondiscrimination in all employment practices and decisions, ensuring equal employment opportunities for all qualified individuals without regard to race, color, creed, religion, sex, national origin, age, physical or mental disability, sexual orientation, gender identity, marital status, pregnancy, childbirth or related individual conditions, medical conditions (as defined by state law), military or veteran status, or any other characteristic protected by federal, state or local law.
Technology

Plume
Senior Technical Account Manager
Senior
On-site
Denver, CO
150,000 - 165,000 USD/yr
🏢 Summary: Senior Technical Account Manager role focused on serving as a trusted technical and operational advisor for ISP and enterprise customers, driving deployments, platform adoption, integrations, and issue resolution within a SaaS and cloud-based environment. The position combines customer-facing technical leadership, cross-functional coordination, and deep networking expertise to ensure successful operationalization of platform capabilities at scale. It requires strong knowledge of cloud, networking, APIs, and troubleshooting tools to manage escalations and support complex technical environments. 🗂️ Requirements: Bachelor’s degree in Computer Science, Engineering, Information Systems, Telecommunications or related field, or equivalent practical experience, Experience in customer-facing technical roles (e.g., Technical Account Management, Solutions Engineering, Technical Program Management, Technical Support), Experience working with ISPs, telecommunications providers, networking vendors, or cloud/SaaS platforms, Working knowledge of cloud platforms, SaaS environments, and APIs, Familiarity with networking concepts (LAN/WAN, routing, switching, WiFi, CPE/gateway technologies), Experience with technical troubleshooting tools (logs, dashboards, SSH, packet captures, monitoring platforms), Ability to manage technical escalations and coordinate cross-functional technical initiatives, Strong analytical skills and ability to interpret SQL queries and technical reports, Proficiency with collaboration tools such as Jira, Confluence, and Slack 📃 Skills: Cloud, SaaS, APIs, LAN, WAN, Routing, Switching, WiFi, CPE, SSH, SQL, Jira, Confluence, Slack, OpenSync, OpenWRT, RDK, Databricks, SageMaker, Mixpanel, CCNA, CCNP, CWNA, CWSP, AWS, PMP, ITIL 🏢 Description: Life at Plume At Plume, we believe that technology isn't about moving faster, it's about making life's moments better. Which is why we've built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale. We now deliver services to over 60 million locations globally and have managed over 3 billion devices on our platform. We're expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Internet Service Providers (ISPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data. With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can't do it exceptionally well, we don't do it. It's how we've assembled a team of world-class builders, thinkers, and doers. And it's how we're reinventing what's possible every day.Overview Plume is seeking a customer-focused Sr. Technical Account Manager (TAM) to serve as a trusted technical and operational advisor for strategic ISP and Enterprise customers. This is a highly collaborative, customer-facing role that combines technical problem-solving, stakeholder management, program coordination, and operational leadership. The TAM works closely with customer technical teams as well as internal Product, Engineering, Support, and Delivery organizations to drive successful deployments, platform adoption, release management, and ongoing customer success. The ideal candidate brings strong technical aptitude, excellent communication skills, and the ability to confidently navigate both technical and business discussions. This role is best suited for someone who can effectively leverage technical teams and tools to drive outcomes, rather than functioning as a software engineer embedded within Customer Success. The TAM develops deep knowledge of customer environments, ISP operational workflows, and Plume platform capabilities, helping customers successfully adopt and operationalize Plume solutions at scale. Responsibilities Serve as the primary technical and operational point of contact for assigned customer accounts. Build trusted relationships with ISP and Enterprise technical stakeholders. Coordinate cross-functional efforts between customers and Plume Product, Engineering, Support, and Delivery teams. Drive technical issue resolution, escalation management, and follow-through to completion. Support customer onboarding, deployments, integrations, release planning, and operational readiness. Help customers successfully adopt and operationalize Plume platform capabilities and tools. Facilitate troubleshooting sessions and coordinate investigations across multiple technical teams. Analyze trends, recurring issues, and operational gaps to proactively improve customer outcomes. Assist customers with platform usage, APIs, reporting tools, dashboards, and operational workflows. Create and maintain clear customer-facing documentation, operational processes, and internal runbooks. Lead regular technical reviews, status meetings, and customer operational governance discussions. Translate customer feedback into actionable recommendations for Product and Engineering teams. Help drive alignment across internal and external stakeholders to achieve shared goals and timelines. Partner with Engineering and Support teams on complex technical escalations when needed. Contribute to the development of TAM operational processes, best practices, and customer engagement models. Qualifications Education Bachelor's degree in Computer Science, Engineering, Information Systems, Telecommunications, or related field preferred. Equivalent practical experience will also be considered. Experience Experience in a customer-facing technical role such as Technical Account Management, Solutions Engineering, Sales Engineering, Technical Program Management, Customer Success Engineering, or Technical Support. Experience working with ISPs, telecommunications providers, networking vendors, or cloud/SaaS platforms preferred. Strong ability to communicate technical concepts clearly to both technical and non-technical audiences. Proven experience managing customer relationships and coordinating cross-functional technical initiatives. Experience handling technical escalations and driving issue resolution across multiple teams. Strong organizational, analytical, and project coordination skills. Comfortable operating in fast-paced environments with evolving priorities. Ability to learn new technologies and platforms quickly. Required Skills Customer & Operational Skills Excellent verbal and written communication skills. Strong stakeholder management and customer engagement abilities. Ability to independently lead customer technical discussions and operational reviews. Strong problem-solving and troubleshooting mindset. Excellent organizational and follow-through skills. Ability to manage multiple priorities and coordinate across teams effectively. Technical Skills Working knowledge of cloud platforms, SaaS environments, and APIs. Familiarity with networking concepts including LAN/WAN, routing, switching, WiFi, and CPE/gateway technologies. Experience using technical troubleshooting tools such as logs, dashboards, SSH, packet captures, or monitoring platforms. Familiarity with data analysis and reporting tools. Ability to run or interpret SQL queries and technical reports is preferred. Familiarity with Jira, Confluence, Slack, and related collaboration tools. Preferred Experience ISP or telecommunications industry experience. Vendor-side experience supporting service providers or enterprise customers. Experience with WiFi technologies (802.11 standards), gateway devices, or broadband platforms. Exposure to OpenSync, OpenWRT, RDK, or similar ecosystems. Familiarity with cloud operational tooling, dashboards, analytics platforms, or API integrations. Experience supporting customer release management or operational governance processes. Nice-to-Have Technical Skills The following are considered strong differentiators but are not required: Advanced SQL or analytics experience. Scripting or coding experience. Cloud architecture certifications or experience. Deep packet/network troubleshooting expertise. Experience with Databricks, SageMaker, Mixpanel, or similar platforms. Preferred Certifications CCNA / CCNP CWNA / CWSP AWS Certified Cloud Practitioner or Solutions Architect PMP or equivalent project/program management certification ITIL Foundation or similar operational certification The total compensation package would include an anticipated compensation range of $150,000.00 - $165,000.00, plus bonus, equity, and benefits. Benefits include: a 401 (k) plan and a company match, basic life insurance, plus unparalleled health, dental, vision, and other benefits and perks. An employee's base salary and its position within the range may depend on several factors, including job-related knowledge, education, skills, experience, and other business-related considerations. Published ranges are provided in good faith at the time of posting. #Hiring #HybridJobs #HybridWork #TechnicalAccountManager #CustomerSuccess #Telecommunications #ISP #Networking #WiFi #CloudComputing #SaaS #TechnicalLeadership #TechCareers #JoinOurTeam #FlexibleWorkAbout Plume As the creator of the only open, hardware-independent, cloud-controlled experience platform for ISPs and their subscribers, Plume partners with over 400 ISP customers, including some of the world's largest such as Comcast, Charter, Liberty Global, and J:COM. Using OpenSync, the most widely supported open-source, silicon-to-cloud framework for smart spaces, Plume's software-defined network allows ISPs to decouple their service offerings from hardware and rapidly curate and deliver new services over a multi-vendor, open-platform architecture. Plume is an equal opportunity workplace that maintains a continuing policy of nondiscrimination in all employment practices and decisions, ensuring equal employment opportunities for all qualified individuals without regard to race, color, creed, religion, sex, national origin, age, physical or mental disability, sexual orientation, gender identity, marital status, pregnancy, childbirth or related individual conditions, medical conditions (as defined by state law), military or veteran status, or any other characteristic protected by federal, state or local law.
Technology
blau direkt
QA Engineer
Senior
Remote
Krakow, Poland
7,600 - 12,000 PLN
🏢 Summary: The offer is for a QA Engineer to join an Agile cross-functional team, focusing on manual and automated testing of web and mobile applications with strong emphasis on Playwright/Python automation and API testing. The role involves building and maintaining automated test suites, supporting CI/CD processes, and leveraging AI-powered QA tools to enhance test creation and defect analysis. You will collaborate closely with developers and product teams to ensure high-quality software delivery. 🗂️ Requirements: 4+ years of commercial experience in software testing, Hands-on experience in manual and automated testing, Good knowledge of Playwright, Good knowledge of Python, Solid API testing experience with Postman, Experience with CI/CD pipelines, Experience with test case management tools, Ability to design and maintain automated test scripts, Experience working in Agile/Scrum environment, Fluent English (spoken and written) 📃 Skills: Playwright, Python, Postman, GitLab, CI/CD, Jira, Confluence, Docker, Kubernetes, MySQL, MariaDB, PHP, Symfony, Laravel, JavaScript, TypeScript, Go, Flutter, Dart, RabbitMQ, UNIX 🏢 Description: About the Role We are looking for a QA Engineer to join our cross-functional Agile team and ensure the delivery of high-quality software across web platforms. In this role, you’ll work closely with developers, product owners, and other QAs to execute manual and automated tests, create test cases, and contribute to test automation development (Playwright/Python). You’ll also get hands-on experience with modern AI-powered QA tools, helping to optimize test case generation, defect analysis, and regression suite maintenance. Your Responsibilities Testing web and mobile applications with all available methods (including automated regression suites, API validation, and exploratory testing of the app) Perform risk-based exploratory testing to identify critical defects beyond the scope of scripted checks, ensuring testing efforts are always prioritized where they matter most. Design, maintain, and improve automated test scripts in Playwright/Python. Analyze the product and its business/technical requirements to design high-value test scenarios and scripts that serve as a foundation for robust automation. Perform API testing (Postman), including automated API test execution. Collaborate with developers and product teams in an Agile/Scrum environment. Support CI/CD testing processes (GitLab CI). Report and track defects using Jira and ensure proper documentation in Confluence. Participate in the introduction and daily use of AI testing tools (e.g., for test creation, defect analysis). Contribute to improving QA processes and sharing knowledge with the team. Requirements Must have: +4 years of experience in software testing in commercial projects. High level of ownership and proactive mindset Exceptional critical thinking skills and the ability to explain your testing logic. Hands-on experience in both manual and automated testing. Good knowledge of Playwright and Python for test automation. Solid API testing experience with Postman (manual & automated). Familiarity with CI/CD pipelines (GitLab CI preferred). Experience with test case management tools. Strong analytical and problem-solving skills. Good time management and ability to work independently on assigned tasks. Fluent communication skills in English (spoken & written). Nice to have: Practical experience with AI tools (Claude Code, Junie etc.). Experience testing mobile applications (real devices or device farms). Knowledge of Agile/Scrum methodologies. ISTQB Foundation or Advanced certification (or equivalent practical experience (we value your actual testing skills over certificates).). Experience with performance and/or security testing. Exposure to AI/ML testing tools (e.g., intelligent test creation). Our Tech & QA Stack Languages/Frameworks: PHP 8+/Symfony 6+/Laravel 9+, JS/TypeScript, Go, PHPUnit, Codeception, Flutter/Dart Databases: MySQL, MariaDB Infrastructure: UNIX, Kubernetes, RabbitMQ Testing: Playwright, Python, Dart, Postman CI/CD: GitLab CI, Code Magic Containerization: Docker AI Tools: Claude Cod, Cursor, Jetbrains AI, Gemini for Google Workspace Tools: Jira, Requirements & Test Management for Jira, Confluence, Slack, IDE (freedom of choice), G Suite, Sentry Engineering Culture Agile Scrum + XP elements OOP, TDD, DDD, SOLID, Clean Code Code reviews, pull requests, automation mindset QA as part of cross-functional team Benefits and Perks Private healthcare Cafeteria system Training budget €800 per year Integration meetings (internal training, hackathon, integration trips and meetings) Referral Bonus Startup atmosphere No dress code Flexible hours Flexible working format - remote or hybrid Modern office, Chillout zone, Standing desk, parking for bicycles, and a cloakroom with showers Regular office lunches and integration meetings Some international travels included
Technology
EPAM Systems
Senior AI QA Engineer (Automation & Manual, AI-based Applications Testing)
Senior
Remote
Lodz, Poland
🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and evaluating GenAI features using advanced metrics. The role requires strong Python automation skills, experience with AI evaluation frameworks, and collaboration across product and engineering teams. 🗂️ Requirements: 5+ years of software QA experience, At least 1 year testing AI agents or LLM-based systems, Experience with manual and automated testing of AI agents, Strong Python programming for test automation, Experience with pytest or equivalent framework, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry, or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Technology
EPAM Systems
Senior AI QA Engineer (Automation & Manual, AI-based Applications Testing)
Senior
Remote
Gdansk, Poland
🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based systems through both manual and automated approaches. The position emphasizes building scalable automation frameworks, LLM test harnesses, and robust evaluation processes for Gen AI features. You will collaborate cross-functionally to ensure reliability, accuracy, and quality of AI-driven applications. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents or LLM-based systems, Experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent framework, Expertise in prompt engineering and LLM evaluation metrics, Experience evaluating Gen AI/LLM applications (grounding, hallucination, determinism), Knowledge of precision, recall, criteria recall metrics, Experience with Jira, QMetry or TestRail, Experience with CI/CD integration and version control systems, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, Jira, QMetry, TestRail, AWS, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Technology
EPAM Systems
Senior AI QA Engineer (Automation & Manual, AI-based Applications Testing)
Senior
Remote
Wroclaw, Poland
🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing and automating quality assurance for Gen AI and LLM-based applications, including AI agents and integrated systems. The position combines manual and automated testing, development of LLM test harnesses, and evaluation of model quality metrics such as grounding, precision, and recall. Work is conducted in collaboration with cross-functional teams, with working hours aligned to 13:00–21:00 Polish time. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents, agentic solutions or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming skills for test automation, Experience with pytest or equivalent framework, Experience integrating AI/ML libraries in automated tests, Expertise in AI agent frameworks and prompt engineering, Experience evaluating Gen AI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of Gen AI/LLM evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry or TestRail, Experience with version control systems and CI/CD integration, Understanding of AWS cloud environments, Availability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, CI/CD, Git 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Technology
EPAM Systems
Senior AI QA Engineer (Automation & Manual, AI-based Applications Testing)
Senior
Remote
Warsaw, Poland
🏢 Summary: Fully remote Senior AI QA Engineer role focused on testing AI agents and LLM-based applications through both manual and automated approaches. The position emphasizes building scalable LLM test harnesses, designing GenAI evaluation frameworks, and ensuring quality across AI-driven systems, APIs, and databases. Requires strong Python automation skills and hands-on experience with AI evaluation metrics and cloud environments. 🗂️ Requirements: 5+ years of software QA experience, Minimum 1 year testing AI agents or LLM-based systems, Hands-on experience in manual and automated testing of AI agents, Strong Python programming for test automation, Experience with pytest or equivalent framework, Expertise in AI agent frameworks and prompt engineering, Experience evaluating GenAI/LLM systems (grounding, accuracy, hallucination, determinism), Knowledge of LLM evaluation metrics (precision, recall, criteria recall, efficiency), Experience with Jira, QMetry or TestRail, Experience with version control systems, Experience integrating tests into CI/CD pipelines, Understanding of AWS cloud environments, Ability to work 13:00–21:00 Polish time 📃 Skills: Python, pytest, LLM, GenAI, LangChain, OpenAI, AWS, Jira, QMetry, TestRail, Git, CI/CD 🏢 Description: We are seeking a skilled Senior AI QA Engineer with strong experience in both manual and automated testing and extensive exposure to AI-based application testing. The ideal candidate will test a variety of applications, including projects involving AI agents and integrations with APIs and databases. You will help ensure our solutions are reliable and accurate and meet business requirements, while also contributing to the development of our automation capabilities. This is a fully remote position with a requirement to work from 13:00 to 21:00 Polish time, due to the client team's location. Responsibilities Research and evolve automation frameworks in line with Gen AI tooling and best practices Design and automate evaluation of Gen AI features — grounding, answer accuracy, determinism/reproducibility, precision, recall, and criteria recall Build automated LLM test harnesses that scale evaluation beyond human-in-the-loop Selection and application of Gen AI evaluation frameworks, measuring answer quality and pipeline efficiency Perform manual testing as needed to validate new features, integrations, and user stories Build and maintain test cases from requirements and user stories Test applications that may include AI agents, APIs, databases, and other integrations Collaborate with product, engineering, and operations teams to understand requirements and deployment environments Track and report test results, defects, and quality metrics Assist with troubleshooting production issues and escalate risks as needed Guide and support team members, including onshore and offshore consultants Requirements 5+ years of experience in software QA, with at least 1 year focused on testing AI agents, agentic solutions or LLM-based systems Hands-on experience with both manual and automated testing of AI agents, including prompt/instruction testing and evaluation of agentic workflows Proficiency in at least one programming language for test automation (Python, Java, JavaScript, TypeScript, C#) Expertise in AI agent frameworks, prompt engineering and evaluation metrics for LLM-based systems Demonstrated experience testing and evaluating Gen AI / LLM applications — grounding, answer accuracy and hallucination/determinism checks Applied knowledge of Gen AI / LLM evaluation frameworks and metrics — precision, recall, criteria recall and efficiency Familiarity with issue and test management tools such as Jira, QMetry and TestRail Experience with version control systems and integrating tests into CI/CD pipelines Flexibility to use AI-powered tools for QA such as GitHub Copilot and LLM-based test generation Understanding of cloud environments, particularly AWS Excellent communication, collaboration and leadership skills Nice to have Experience with agentic AI platforms such as LangChain, OpenAI Function Calling or similar Experience with AI safety, bias and reliability testing Experience with test data generation for AI/ML systems We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Technology
ITLT
QA Engineer (Backend & API Testing)
Mid
Hybrid
Warsaw, Poland
60 - 90 PLN/hr
🏢 Summary: B2B contract role for a QA Engineer focused on backend and REST API testing within a project developing platforms for managing electric vehicle charging networks. The position involves functional, integration, system, and regression testing, log analysis, and close collaboration in an Agile environment. Hybrid work model with long-term engagement in the energy sector. 🗂️ Requirements: Minimum 3 years of backend testing experience, Practical experience in REST API testing, Very good knowledge of Postman or SOAP UI, Basic knowledge of SQL, Experience with log analysis using Kibana or Azure AppInsights, Knowledge of version control systems (Git), Knowledge of QA best practices and testing standards (ISTQB), English proficiency at minimum B2+/C1 level 📃 Skills: REST, API, Postman, SOAPUI, SQL, Kibana, Azure, AppInsights, Git, ISTQB, Jenkins, AWS, GCP, CosmosDB, CI/CD 🏢 Description: W ITLT pomagamy naszym zaprzyjaźnionym firmom przekształcać ambitne pomysły w cyfrową rzeczywistość. Z nastawieniem na wyzwania, ciekawość technologii i zwinność współtworzymy wyjątkowe rozwiązania IT i zapewniamy doświadczone osoby eksperckie, które pomagają przyspieszać cyfrową transformację. Aktualnie poszukujemy profilu na stanowisko: QA Engineer (Backend & API Testing) Informacje organizacyjne: Forma współpracy: kontrakt b2b, zaangażowanie stabilne, długofalowe Stawka: 60 - 90 PLN netto + Vat/h (w zależności od umiejętności i doświadczenia) Lokalizacja biura: Warszawa, Mokotów Tryb realizacji usług: hybryda, 2-3 dni w tygodniu z biura Język angielski: wymagany na poziomie umożliwiającym swobodną komunikację (min. B2+/C1-), praca w międzynarodowym środowisku Sektor: energetyka Projekt: rozwój platform i systemów do zarządzania siecią stacji ładowania pojazdów elektrycznych Zakres zadań: Testowanie i weryfikacja REST API, komponentów backendowych oraz integracji między systemami Tworzenie i utrzymywanie skryptów testowych dla API przy użyciu narzędzi takich jak Postman lub podobnych frameworków Projektowanie i wykonywanie testów funkcjonalnych, integracyjnych, systemowych oraz regresyjnych Weryfikacja poprawności danych oraz analiza logów aplikacyjnych z wykorzystaniem narzędzi takich jak Kibana czy Azure AppInsights Wsparcie testów wydajnościowych i obciążeniowych Analiza wymagań biznesowych i dokumentacji technicznej oraz przygotowywanie scenariuszy testowych Tworzenie planów testów i definiowanie danych testowych Tworzenie i utrzymywanie dokumentacji testowej Identyfikowanie, raportowanie i monitorowanie błędów do momentu ich rozwiązania Ścisła współpraca z programistami, analitykami, Product Ownerami oraz zespołem QA Udział w ceremoniach Agile/Scrum, w tym planowaniu sprintów, daily meetings i retrospektywach Oczekiwania: Min. 3 lata doświadczenia w testowaniu backendu Praktyczne doświadczenie w testowaniu API (REST API) Bardzo dobra znajomość narzędzi do testowania API, takich jak Postman lub SOAP UI Podstawowa znajomość SQL Doświadczenie w analizie logów oraz pracy z narzędziami takimi jak Kibana/Azure AppInsights Znajomość systemów kontroli wersji, np. Git Znajomość dobrych praktyk QA oraz standardów testowania (np. ISTQB) Bardzo dobre umiejętności komunikacyjne i współpracy z zespołami developerskimi Mile widziane Doświadczenie w pracy z rozwiązaniami chmurowymi (AWS, Azure lub GCP) Znajomość procesów CI/CD oraz narzędzi takich jak Jenkins Doświadczenie z bazami danych NoSQL, np. Cosmos DB Oferujemy: Długofalową, stabilną współpracę w oparciu o kontrakt B2B Szansę na rozwój w dużej strukturze, bezpośredni kontakt z Managerem zespołu Współpracę z ekspertami w firmie, w której IT jest dojrzałe i globalne, a metodyki zwinne są respektowane Dopłatę do karty MultiSport oraz ubezpieczenia Godziny startu pracy 7:30 - 9:30 Agencja zatrudnienia - nr certyfikatu 14181