Software Engineer, AI Platform

Bask Health

16m ago • Remote

Senior

Remote

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Quick Facts

  • Role: Software Engineer (AI Platform)

Description

Join an AI-first engineering team to build and maintain the foundational platform infrastructure that powers AI-powered applications. You’ll create reusable backend services and APIs for model integration, inference request handling, routing/configuration, authentication and authorization, rate limiting, usage tracking/cost monitoring, observability, and secure multi-tenant data access. This is a hands-on role with ownership of production infrastructure and shared developer capabilities.

Responsibilities

  • Design, build, and maintain shared infrastructure for AI-powered applications

  • Develop backend services and APIs for model integration and AI execution

  • Build centralized model integration and inference request handling

  • Implement routing and configuration for multiple model providers

  • Manage model API credentials, authentication, and access permissions

  • Implement request validation, structured output handling, and standardized error responses

  • Add rate limiting, retries, timeouts, and fallback mechanisms for model API requests

  • Build usage tracking and cost monitoring for AI services

  • Support prompt configuration, versioning, and controlled updates

  • Create shared services for embeddings, retrieval, and knowledge-grounded AI

  • Develop APIs and integration patterns that support AI agents and workflow automation

  • Ensure secure data access with tenant isolation and authorization requirements

  • Implement observability for model requests, latency, errors, and operational performance (structured logging and distributed tracing)

  • Build automated testing and deployment pipelines for platform components

  • Improve reliability, fault tolerance, availability, throughput, and infrastructure costs

  • Design scalable asynchronous processing and background job systems

  • Integrate platform services with existing application databases and backend infrastructure

  • Create internal developer tools and documentation

  • Collaborate with applied AI/ML/product/infrastructure teams and investigate production incidents

Requirements

  • 3+ years of professional software engineering experience, preferably backend/platform/infrastructure

  • Demonstrated experience building and maintaining production backend services

  • Strong programming skills in TypeScript, JavaScript, Python, or comparable backend languages

  • Experience designing and developing APIs and service integrations

  • Strong understanding of backend application architecture and distributed systems fundamentals

  • Familiarity with large language models and modern AI application integration patterns

  • Experience integrating third-party APIs or external services into production applications

  • Understanding of authentication, authorization, and secure service communication

  • Experience working with relational databases and application data models

  • Familiarity with asynchronous processing, background jobs, and event-driven systems

  • Experience designing systems that handle errors, retries, timeouts, and service failures

  • Understanding of cloud infrastructure and production deployment practices

  • Familiarity with automated testing and continuous integration workflows

  • Experience with logging, monitoring, and production observability tools

  • Understanding of system performance, latency, scalability, and reliability

  • Experience designing reusable components and shared engineering services

  • Familiarity with API versioning, configuration management, and service maintenance

  • Understanding of data privacy and secure application development

  • Experience using Git and collaborative practices such as code reviews

  • Ability to troubleshoot complex backend and infrastructure issues

  • Ability to write maintainable, well-documented production code

  • Ability to evaluate engineering tradeoffs involving performance, complexity, and operational costs

  • Ability to collaborate with engineers across multiple product or technical teams

  • Strong technical problem-solving and analytical skills

  • Ability to independently own engineering projects from design through deployment

Benefits

  • Hands-on ownership of production infrastructure and shared developer capabilities

  • Work on AI-first infrastructure enabling multiple AI-powered products

  • Collaborate closely with applied AI, ML, product, and infrastructure specialists

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report