AI Platform Engineer

Quick Facts

• Role: AI Platform Engineer

Description

You will own and run an on-prem, multi-GPU AI inference infrastructure end-to-end—covering the GPU server lifecycle (with IT), the model-serving stack, and the people using it. You’ll benchmark and evaluate newly released open-weight models on hardware you control, deploy and tune inference services, and help engineers integrate internal models into their tooling.

Responsibilities

• Run and maintain the GPU server lifecycle with IT (OS, storage, networking)
• Set up observability and alerting for GPU utilization, thermals, memory, latency, and throughput
• Operate and evolve an inference stack (e.g., vLLM/SGLang, LiteLLM gateway, Open WebUI front end)
• Deploy, upgrade, and tune open-weight models; benchmark quality, throughput, and latency
• Own quotas, routing, and cost/usage reporting across teams
• Support developers integrating internal models into workflows (IDE assistants, agents, CI pipelines, internal apps)
• Maintain API keys/endpoints and internal documentation; create onboarding guides and run internal enablement workshops
• Design queueing and prioritization (who gets priority, long-running tasks)

Requirements

• Coding experience
• Infrastructure as Code skills (Ansible, Terraform, Docker/Kubernetes)
• Linux systems administration experience (networking, storage, containers, systemd, troubleshooting)
• Interest in the open-weight model ecosystem
• Service mindset and ability to document solutions
• English proficiency for daily work (Czech is a plus)

Benefits

• High ownership and freedom
• Build, implement, and see real impact
• Opportunity to work in an open-source culture focused on transparency, trust, and security
• Option to get paid in bitcoin
• Flexible working hours
• Budget for professional development (training, courses, workshops)
• Supportive team and friendly open culture with events
• Renovated offices with onsite perks (gym, massages, football table, billiards, PlayStation, 3D printer, free parking)
• Additional benefits (MultiSport card, mobile tariff, yoga, fitness classes)