
Senior Architecture & Performance Modeling Engineer (AI Inference Silicon)
Positron.ai
15m ago • Remote
Senior
Remote
220,000 - 350,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Senior Architecture & Performance Modeling Engineer (AI Inference Silicon) role
Improve your resume now
$220,000 – $350,000/year
Quick Facts
- Role: Senior Architecture & Performance Modeling Engineer (AI Inference Silicon)
- Focus: Pre-RTL performance modeling for AI inference accelerators
Description
You will help shape next-generation AI inference accelerator architecture by running focused modeling studies, quantifying tradeoffs, and turning results into actionable design recommendations. You will build and extend analytical, transaction-level, and cycle-level models (in Rust), correlate predictions against RTL/emu/silicon, and communicate findings as the design matures. You will also evaluate representative LLM inference workloads to identify limits on latency, throughput, and utilization.
Responsibilities
- Partner with chip architects to define modeling studies with clear assumptions, alternatives, metrics, and recommendations
- Perform what-if analysis across compute engines, memory capacity/bandwidth, dataflow, DMA, command processing, on-chip interconnect, and chip-to-chip communication
- Compare architectural options, explain performance sensitivities, and recommend changes under system constraints (power, area, implementation)
- Analyze inference workloads across prefill/decode, batch size, context length, and dense vs mixture-of-experts models
- Provide timely feedback during the design cycle by investigating unexpected results and updating studies
- Develop and extend reusable analytical/transaction/cycle models with appropriate fidelity and turnaround time
- Maintain models in the Rust simulator and correlate with RTL simulation, emulation, or silicon measurements with regression coverage and documented assumptions/limitations
Requirements
- 5+ years experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, or GPUs
- Demonstrated ability to use models to drive architectural decisions with quantitative evidence
- Strong understanding of pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnects
- Hands-on experience building analytical, transaction-level, or cycle-level performance models
- Comfort making explicit assumptions with incomplete specs while balancing fidelity and iteration speed
- Strong Rust skills (or expert C/C++ skills with willingness to work in Rust day to day)
- Proficiency in Python for workload analysis, experiments, and visualization
- Ability to read SystemVerilog RTL and reconcile/calibrate models against architectural specifications and verification results
- Excellent communication skills
Benefits
- Fully company-paid medical, dental, and vision insurance for you and dependents
- Company-paid life and disability coverage (with voluntary options to add more)
- Supplemental hospital, critical illness, and accident coverage
- Unlimited paid time off plus 13 paid company holidays
- Remote-first culture with company-provided computer and home office setup
- Competitive salary and equity; 401(k) with company matching eligible from day one
- Visa support: candidates authorized to work in the U.S.; no new sponsorship, but H-1B transfers may be facilitated
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See moreSenior AI Performance Modeling Engineer
Microsoft
Senior
Technology
Mountain View, CA · Hybrid
$120K - $235K/yr
6 days ago

Performance & Debug Software Engineer (AI Inference)
Positron.ai
Senior
Technology
Remote
$200K - $300K/yr
8 days ago
Senior/Principal Software Engineer (AI Performance)
Microsoft
Senior
Technology
Remote
N/A
5 days ago
Senior AI Engineer
Evertz
Senior
Technology
Warsaw, Poland · Remote
24K zł - 30K zł/yr
9 days ago
Senior Applied AI Engineer
Flyps
Senior
Technology
Poznań, Pl-30, Poland · Remote
312K zł - 396K zł/yr
11 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.
Senior LLM Inference Quality Engineer
Apple
Senior
Technology
Seattle, WA · On-site
$175K - $309K/yr
1 days ago

Senior AI Engineer
WealthArc
Senior
Technology
Warsaw, Poland · On-site
1K zł - 2K zł/yr
11 days ago

Senior Staff Software Engineer, AI/ML Inference Engineering
ServiceNow, Inc.
Senior
Technology
San Diego, CA · On-site
$181K - $317K/yr
8 days ago

Senior Staff Software Engineer, AI/ML Inference
ServiceNow, Inc.
Senior
Technology
Kirkland, WA, United States of America · On-site
$201K - $352K/yr
8 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights
