Principal AI Technology Architect (AI Platforms)

Boston Consulting Group

Atlanta, GA • 15m ago • On-site

Senior

On-site

230,000 - 230,000 USD/yr

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Resume Checker & Builder preview

Quick Facts

  • Role: Principal AI Technology Architect (AI Platforms)
  • Work: AI platform and agentic intelligent system architecture with hands-on prototyping and engineering

Description

Principal AI Tech Architects design, guide, and evolve next-generation intelligent agentic systems by bridging high-level system design with hands-on AI engineering. You will work across AI, data, product, and engineering teams to define scalable architectures for AI-driven applications, enabling seamless integration of LLMs, data pipelines, and enterprise systems. The role also includes production readiness via governance, observability, and evaluation.

Responsibilities

  • Define system architectures for AI and LLM-based solutions to ensure scalability, low-latency inference, and modularity.
  • Design agentic AI solutions for workflow automation using memory, agentic reflection, and task planning.
  • Design AI integration patterns such as RAG for model orchestration, context management, prompt orchestration, and external system connectivity.
  • Establish architectural blueprints, design principles, and governance frameworks for model versioning, data lineage, and responsible AI.
  • Architect polyglot model runtimes and hybrid pipelines (batch training + streaming inference), managing cost, latency, and risk.
  • Develop minimal viable prototypes/POCs to validate model architectures, RAG flows, and agent orchestration.
  • Evaluate emerging AI frameworks and tools (e.g., LangChain, LlamaIndex, LangGraph, Semantic Kernel, AutoGen, CrewAI).
  • Develop solutions using agent orchestration engines (e.g., n8n, Retool, OpenAI Agentkit, Microsoft Copilot Studio, AWS Flows).
  • Support restructuring IT processes to adopt new systems and oversee performance, observability, and governance moving to production.
  • Optimize model and AI service development processes via LLMOps standards for versioning, testing, and monitoring.
  • Lead technical workshops and presentations, translating complex ideas for technical and non-technical audiences.
  • Mentor and manage junior team members, including QA oversight and structured growth objectives.
  • Stay ahead on distributed AI, RAG, retrieval/indexing, and agent frameworks; support business development with technical proposals.

Benefits

  • Best-in-class benefits supporting personal and professional growth.
  • Opportunity to work across disciplines with strategic thinking plus hands-on implementation.
  • U.S. base compensation: $230,000 annually, plus a discretionary performance bonus and retirement contribution.
  • Employer-paid medical, dental, and vision premiums for employees, spouses, and children (zero premium cost for covered individuals).
  • Paid time off, paid parental leave, and family benefits (including egg freezing, surrogacy, and adoption reimbursement).
  • Gym membership/fitness reimbursement and fully vested retirement contributions annually.

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Potential salary for Principal AI Technology Architect (AI Platforms) role

Improve your resume for just $5

$230,000 – $230,000/year

Unlock Full Resume Report