
Software Engineer, AI Platform
Bask Health
16m ago • Remote
Senior
Remote
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Quick Facts
Role: Software Engineer (AI Platform)
Description
Join an AI-first engineering team to build and maintain the foundational platform infrastructure that powers AI-powered applications. You’ll create reusable backend services and APIs for model integration, inference request handling, routing/configuration, authentication and authorization, rate limiting, usage tracking/cost monitoring, observability, and secure multi-tenant data access. This is a hands-on role with ownership of production infrastructure and shared developer capabilities.
Responsibilities
Design, build, and maintain shared infrastructure for AI-powered applications
Develop backend services and APIs for model integration and AI execution
Build centralized model integration and inference request handling
Implement routing and configuration for multiple model providers
Manage model API credentials, authentication, and access permissions
Implement request validation, structured output handling, and standardized error responses
Add rate limiting, retries, timeouts, and fallback mechanisms for model API requests
Build usage tracking and cost monitoring for AI services
Support prompt configuration, versioning, and controlled updates
Create shared services for embeddings, retrieval, and knowledge-grounded AI
Develop APIs and integration patterns that support AI agents and workflow automation
Ensure secure data access with tenant isolation and authorization requirements
Implement observability for model requests, latency, errors, and operational performance (structured logging and distributed tracing)
Build automated testing and deployment pipelines for platform components
Improve reliability, fault tolerance, availability, throughput, and infrastructure costs
Design scalable asynchronous processing and background job systems
Integrate platform services with existing application databases and backend infrastructure
Create internal developer tools and documentation
Collaborate with applied AI/ML/product/infrastructure teams and investigate production incidents
Requirements
3+ years of professional software engineering experience, preferably backend/platform/infrastructure
Demonstrated experience building and maintaining production backend services
Strong programming skills in TypeScript, JavaScript, Python, or comparable backend languages
Experience designing and developing APIs and service integrations
Strong understanding of backend application architecture and distributed systems fundamentals
Familiarity with large language models and modern AI application integration patterns
Experience integrating third-party APIs or external services into production applications
Understanding of authentication, authorization, and secure service communication
Experience working with relational databases and application data models
Familiarity with asynchronous processing, background jobs, and event-driven systems
Experience designing systems that handle errors, retries, timeouts, and service failures
Understanding of cloud infrastructure and production deployment practices
Familiarity with automated testing and continuous integration workflows
Experience with logging, monitoring, and production observability tools
Understanding of system performance, latency, scalability, and reliability
Experience designing reusable components and shared engineering services
Familiarity with API versioning, configuration management, and service maintenance
Understanding of data privacy and secure application development
Experience using Git and collaborative practices such as code reviews
Ability to troubleshoot complex backend and infrastructure issues
Ability to write maintainable, well-documented production code
Ability to evaluate engineering tradeoffs involving performance, complexity, and operational costs
Ability to collaborate with engineers across multiple product or technical teams
Strong technical problem-solving and analytical skills
Ability to independently own engineering projects from design through deployment
Benefits
Hands-on ownership of production infrastructure and shared developer capabilities
Work on AI-first infrastructure enabling multiple AI-powered products
Collaborate closely with applied AI, ML, product, and infrastructure specialists
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Software Engineer
Atlassian Inc.
Senior
Technology
Seattle, WA · Remote
$150k - $196k/yr
2 days ago

Software Engineer, AI Quality & Evaluation
Bask Health
Mid
Technology
Remote
N/A
16m ago

Software Engineer
Atlassian Inc.
Mid
Technology
Seattle, WA · On-site
$150k - $196k/yr
6 days ago

Lead Software Engineer
JPMorgan Chase & Co.
Senior
Technology
Hoboken, NJ · On-site
N/A
9 days ago

Senior Software Engineer
Jobot
Senior
Technology
San Francisco, CA · On-site
$150k - $200k/yr
6 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior Software Engineer
Jobot
Senior
Technology
New York, NY, United States of America · On-site
$150k - $200k/yr
6 days ago

Software Engineer
Zoom Video Communications
Senior
Technology
Remote
$99k - $229k/yr
4 days ago
AI Software Engineer
Hilton
Mid
Technology
Remote
$78k - $110k/yr
8 days ago

Backend Software Engineer
Horizontal Talent
Mid
Technology
Brooklyn Park, MN · On-site
N/A
4h ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights