AI Engineer

Quick Facts

• Role: AI Engineer

Description

You will work on an AI team inside a bank, creating and evolving LLM-based solutions for customer communication and automation for workflows involving calls and documents. The role focuses on improving RAG pipelines, running PoCs for new ideas, iterating prompt designs, and ensuring answer quality with evaluation sets and metrics. You will collaborate with AI developers, tech leads, and business teams to turn requirements into working technical solutions.

Responsibilities

• Improve the RAG pipeline, including document preparation, splitting/chunking, and result relevance

• Prepare data where it makes sense for fine-tuning and support model selection

• Validate new approaches quickly through PoCs and produce recommendations plus technical plans

• Design, test, and continuously refine prompts for AI components

• Build evaluation datasets and define metrics for quality of answers, classification, and extraction

• Compare model and prompt variants and prevent quality degradation over time

• Collaborate across AI development and business teams; share and challenge ideas with other AI specialists

Requirements

• Practical experience building LLM-based solutions (beyond using AI tools)

• Ability to design prompts, evaluate outputs, and refine prompts based on evaluation results

• Ability to create AI evaluations using metrics, test sets, and/or automated quality checks

• Practical RAG experience and understanding of quality drivers (documents, chunking, embeddings, retrieval)

• Ability to build a PoC quickly and evaluate technical feasibility of AI use cases

• Basic Python knowledge for automation and scripting

• Experience with LLM APIs and/or tools for AI evaluation

• Ability to elicit business requirements, translate them into technical solutions, and communicate capabilities and limitations

Benefits

• Team with regular in-office meetups (with flexibility to work from home by agreement)

• 5 weeks vacation plus 5 additional days off per year

• Free access to quality healthcare via premium clinics (Canadian Medical/EUC Premium)

• Contribution to pension/extra retirement savings of 2,000 CZK per month

• Additional benefits available on request