Senior QA Engineer (Test Automation)

Quick Facts

• 100% remote
• B2B contract
• Start: ASAP
• Project duration: until 14.12.2026, with a real perspective of continuation for at least 12 months

Description

Senior QA Engineer needed for a remote B2B project automating the production of promotional newspaper flyers and inserts. The solution uses AI pipelines to generate editorial content and OR-Tools CP-SAT solvers to select content and page layouts, producing print-ready PDFs (300 dpi) compliant with PDF/X-3. Manual checkpoints remain for editorial acceptance and pre-print approval.

Responsibilities

• Test concept and QA approach: build and maintain test concepts (test levels, ownership split between development and QA), risk-based prioritization, test environments and test data approach, error classification with severity and blocker criteria, acceptance/release criteria, and QA documentation.
• Test automation: implement integration/API and pipeline testing; automate in Python with pytest and integrate with CI; perform PDF regression testing (visual comparison, preflight, PDF/X-3 validation); automate the frontend (e.g., Playwright) and optionally apply AI-supported testing.
• Test data: generate synthetic rule-based datasets including incomplete/invalid inputs, duplicates and edge cases; test multiple edition size and ad structure combinations; maintain reference datasets from real outputs; use property-based testing (e.g., Hypothesis).
• Quality measurement: define and automatically collect quality metrics and monitor trends/regressions (e.g., fill rate, white space, rule violations, runtime vs search budget; AI text length and prompt/model regressions).
• Runtime, performance, volume testing: measure runtime/throughput/output quality on large and parallelized runs; profile and analyze bottlenecks in Grafana; scale tests on AWS EKS and validate readiness for broader deployment.
• Manual testing: exploratory and release testing where automation is not yet justified, plus planning and documentation of manual tests.

Requirements

• Senior level experience independently leading QA on at least one project
• Experience independently creating and implementing a test concept/test strategy
• Strong test automation skills in Python with pytest
• Experience configuring and maintaining tests in CI pipelines
• Backend and data systems testing experience (APIs, data pipelines, batch processing, integrations)
• Experience generating synthetic or rule-based test data
• Experience with runtime, performance, and volume testing of backend/batch systems
• Experience testing parallel processing
• Ability to design performance scenarios, define metrics, and analyze bottlenecks
• Frontend test automation experience (e.g., Playwright or comparable tools)
• Manual testing and exploratory testing experience
• Experience with defect classification, severity levels, and release criteria
• English proficiency C1

Benefits

• High independence: set up the test specification yourself based on goals and system access
• 100% remote work with strong continuation expectations
• Opportunity to test an end-to-end system combining AI generation, mathematical optimization, and print-ready PDF output