Senior Applied AI Engineer

Quick Facts

• Role: Senior Applied AI Engineer

• Focus: Production LLM systems, evaluation, reliability, and backend/API integration

Description

You will build and improve production AI systems powered by LLMs, including agentic workflows and LLM applications. The work emphasizes measurable AI quality through evaluation, debugging, experiments, and production reliability. You will also provide technical direction and mentoring, and validate new models/tools based on practical results.

Responsibilities

• Design and develop LLM-powered systems from prototype to production

• Diagnose and improve AI systems by analyzing code, data, logs, and execution traces

• Select appropriate architectures (workflows to agentic architectures)

• Build evaluations and regression tests to measure quality and detect failures

• Run experiments comparing solutions by quality, cost, latency, and reliability

• Build backend services and API integrations with validation, error handling, logging, and monitoring

• Work with clients to define requirements and acceptance criteria; communicate decisions, results, and limitations

• Provide technical direction: review solutions and mentor engineers

• Evaluate new models/tools/approaches and validate their practical value for production

Requirements

• Strong software engineering skills with experience building production applications

• Hands-on experience with LLM-powered systems (LLM APIs, tool calling, structured outputs, multi-step workflows)

• Experience with RAG, vector search, or agent-based architectures

• Backend services and API experience, preferably with FastAPI; automated testing, Git, and code review

• Practical experience with LLM evaluation and observability (quality, failures, latency, cost)

• Strong technical problem-solving and ability to make sound architectural trade-offs

• Experience providing technical guidance (architecture decisions, code reviews, mentoring)

• Strong communication skills with clients and engineers

• Comfortable using AI coding assistants (Cursor, GitHub Copilot, ChatGPT, Claude)

• Comfortable working in a bilingual environment (Polish C2 and English C1)

Benefits

• 26,000–33,000 PLN net + VAT monthly (B2B)

• 100% remote setup with flexible hours

• Private medical care, life insurance, and Multisport

• Referral bonuses

• Equipment (MacBook by default)

• Challenging, interesting projects