
Staff Software Engineer, Data Infrastructure
Cohere
New York, NY • 2h ago • On-site
Senior
On-site
245,000 - 335,000 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Staff Software Engineer, Data Infrastructure role
Improve your resume now
$245,000 – $335,000/year
Quick Facts
Role: Staff Software Engineer, Data Infrastructure
Description
You will design, architect, and operate the distributed storage system that feeds model training and evaluation. You’ll lead deployment across multiple Kubernetes clusters at petabyte scale, setting standards for best practices. You’ll collaborate with researchers and training-infra teams to define data read/write patterns and tackle networking, I/O, and consistency challenges that reduce GPU idle time and improve time-to-insight.
Responsibilities
Design, architect, and operate a distributed storage system for training and evaluation
Lead deployment across multiple Kubernetes clusters; establish organizational standards and best practices
Partner with researchers and training-infra teams to define how jobs read/write data and translate requirements into platform roadmap goals
Address networking, I/O, and consistency challenges for moving large datasets and checkpoints across regions and backends to improve GPU utilization and time-to-insight
Requirements
Strong storage fundamentals (replication, consistency, caching, data lifecycle management) with demonstrated architecture/design experience
Strong coding ability in Python and Go; ability to lead implementations and mentor in either language
Proven experience running stateful systems on Kubernetes (Persistent Volumes, CSI drivers, StatefulSets) and ability to design and execute operational strategies
Hands-on experience with cloud object storage (e.g., S3) and POSIX-style filesystems
Benefits
Weekly lunch stipend
Full health and dental benefits with a separate mental health budget
RRSP matching, 401K, pension scheme
100% parental leave top-up for up to 6 months (either parent)
Annual enrichment benefits (arts & culture, fitness/wellness, quality time, workspace credit)
Education and learning stipend for conferences, courses, and coaching
6 weeks of paid vacation (30 working days)
Budget for travel to other offices if remote, plus annual company offsite
Remote-friendly work model plus office amenities and a $500 home office stipend
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Staff Software Engineer
Senior
Technology
Mountain View, CA · On-site
$156k - $255k/yr
6 days ago

Staff Software Engineer
Walmart Inc.
Senior
Technology
Bentonville, AR · On-site
$110k - $220k/yr
14h ago

Staff Software Engineer, Compute Engineering
ServiceNow
Senior
Technology
Santa Clara, CA · Hybrid
$167k - $291k/yr
2 days ago
Staff Software Engineer
Scalo
Senior
Technology
Wrocław, Poland · Remote
395k zł - 437k zł/yr
11 days ago

Software Engineer (Storage & Data Pipeline Infrastructure)
DocuSign Inc
Mid
Technology
Seattle, WA · On-site
$112k - $162k/yr
2 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Staff Software Development Engineer
CVS Health
Senior
Technology
CT · Remote
$130k - $261k/yr
2 days ago
Software Engineer, Infrastructure
Cursor
Mid
Technology
San Francisco, CA · On-site
$140k - $225k/yr
6 days ago

Staff Software Engineer, Control Plane Infrastructure
IBM
Senior
Technology
Santa Clara, CA · On-site
N/A
4 days ago

Staff Software Engineer, Control Plane Infrastructure
IBM
Senior
Technology
Durham, NC, United States of America · On-site
N/A
4 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights