
Principal AI Technology Architect (AI Platforms)
Boston Consulting Group
Atlanta, GA • 15m ago • On-site
Senior
On-site
230,000 - 230,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
PDF up to 10 MB
Your resume is private & secure

Quick Facts
- Role: Principal AI Technology Architect (AI Platforms)
- Work: AI platform and agentic intelligent system architecture with hands-on prototyping and engineering
Description
Principal AI Tech Architects design, guide, and evolve next-generation intelligent agentic systems by bridging high-level system design with hands-on AI engineering. You will work across AI, data, product, and engineering teams to define scalable architectures for AI-driven applications, enabling seamless integration of LLMs, data pipelines, and enterprise systems. The role also includes production readiness via governance, observability, and evaluation.
Responsibilities
- Define system architectures for AI and LLM-based solutions to ensure scalability, low-latency inference, and modularity.
- Design agentic AI solutions for workflow automation using memory, agentic reflection, and task planning.
- Design AI integration patterns such as RAG for model orchestration, context management, prompt orchestration, and external system connectivity.
- Establish architectural blueprints, design principles, and governance frameworks for model versioning, data lineage, and responsible AI.
- Architect polyglot model runtimes and hybrid pipelines (batch training + streaming inference), managing cost, latency, and risk.
- Develop minimal viable prototypes/POCs to validate model architectures, RAG flows, and agent orchestration.
- Evaluate emerging AI frameworks and tools (e.g., LangChain, LlamaIndex, LangGraph, Semantic Kernel, AutoGen, CrewAI).
- Develop solutions using agent orchestration engines (e.g., n8n, Retool, OpenAI Agentkit, Microsoft Copilot Studio, AWS Flows).
- Support restructuring IT processes to adopt new systems and oversee performance, observability, and governance moving to production.
- Optimize model and AI service development processes via LLMOps standards for versioning, testing, and monitoring.
- Lead technical workshops and presentations, translating complex ideas for technical and non-technical audiences.
- Mentor and manage junior team members, including QA oversight and structured growth objectives.
- Stay ahead on distributed AI, RAG, retrieval/indexing, and agent frameworks; support business development with technical proposals.
Benefits
- Best-in-class benefits supporting personal and professional growth.
- Opportunity to work across disciplines with strategic thinking plus hands-on implementation.
- U.S. base compensation: $230,000 annually, plus a discretionary performance bonus and retirement contribution.
- Employer-paid medical, dental, and vision premiums for employees, spouses, and children (zero premium cost for covered individuals).
- Paid time off, paid parental leave, and family benefits (including egg freezing, surrogacy, and adoption reimbursement).
- Gym membership/fitness reimbursement and fully vested retirement contributions annually.
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See moreAI Engineer (m/k/os)
DOZ S.A.
Mid
Technology
Warsaw, Poland · On-site
N/A
8 days ago
Principal Software Engineer, Build Platform
Roblox
Senior
Technology
San Mateo, CA · On-site
$345K - $399K/yr
5 days ago

Agentic AI Engineer
SumasEdge Corporation
Senior
Technology
Remote
N/A
27m ago

Senior AI Solutions Engineer with Python
EPAM Systems
Senior
Technology
Krakow, Poland · Remote
N/A
7 days ago
AI Engineer - Agentic AI (k/m/n)
Nexio Management
Senior
Technology
Warsaw, Poland · On-site
N/A
5 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Senior AI Engineer (LLM / Agents)
CodeTalent
Mid
Technology
Gdańsk, PM, Poland · Remote
29K zł - 37K zł/yr
8 days ago

Staff Machine Learning Engineer
ServiceNow
Senior
Technology
Santa Clara, CA · On-site
$176K - $308K/yr
15h ago

Agentic AI Engineer / Architect
Software Guidance & Assistance
Senior
Technology
Atlanta, GA · On-site
$0K - $0K/yr
2 days ago

Senior Agentic AI Engineer
Spyrosoft
Senior
Technology
Wrocław, Dsc, Poland · Remote
0K zł - 0K zł/yr
7 days ago
Potential salary for Principal AI Technology Architect (AI Platforms) role
Improve your resume for just $5
$230,000 – $230,000/year
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights