June 18, 2026

Data Engineer

Senior • On-site

140,004 - 159,996 USD/yr

San Francisco, CA

Position Summary

Cargomatic is seeking a Senior Data Architect – Data Engineering to design and build scalable, cloud-native data infrastructure that powers analytics, machine learning, and AI-driven applications. This role combines deep data architecture expertise with hands-on experience in modern data platforms and LLM-enabled application development.

You will lead the design of enterprise-grade data models, architect RAG systems, implement agentic workflows, and integrate secure, production-ready LLM capabilities into our ecosystem. This is a high-impact role with significant ownership, visibility, and opportunity to shape the future of intelligent logistics technology.

Key Responsibilities

Data Architecture & Engineering

  • Design and build scalable, cloud-native data pipelines (batch and streaming) supporting analytics, ML, and AI-powered applications
  • Architect enterprise-grade data models across data lakes, warehouses, and real-time systems (Snowflake, Databricks, Kafka, DBT)
  • Define standards for data governance, reliability, performance, and cost optimization
  • Optimize storage formats and distributed data systems (Parquet, Delta Lake, Iceberg)

AI & LLM-Enabled Systems

  • Develop Retrieval-Augmented Generation (RAG) systems integrating structured and unstructured enterprise data
  • Design and implement agentic workflows using frameworks such as LangChain, LangGraph, LlamaIndex, n8n, or similar
  • Integrate LLM APIs (OpenAI, Anthropic, or similar) into secure, production-ready applications
  • Implement guardrails, validation layers, monitoring, and evaluation frameworks to mitigate hallucination, prompt injection, and data security risks

Backend & API Development

  • Build secure backend APIs (Python/FastAPI) to expose AI-powered capabilities
  • Ensure observability, monitoring, and cost controls across AI and data services
  • Contribute to microservices architecture and distributed system design

Qualifications

  • Bachelor's degree in Computer Science or equivalent practical experience
  • 8+ years of software or data engineering experience in production environments
  • Strong expertise in data modeling, distributed systems, and scalable cloud architectures
  • Hands-on experience with ETL/ELT frameworks and streaming technologies (Kafka, Spark, HEVO, Snowflake, DBT, etc.)
  • Advanced SQL skills and deep understanding of modern storage formats
  • Proficiency in Python and RESTful API development
  • Experience integrating LLM APIs into production applications
  • Strong understanding of system reliability, observability, and cost management in cloud environments

Desired Experience

  • Experience building RAG pipelines including embeddings, vector search, chunking strategies, and hybrid retrieval
  • Experience designing multi-agent or agentic AI workflows with orchestration frameworks
  • Knowledge of LLM evaluation, monitoring, and tracing tools (LangSmith or similar)
  • Experience with microservices architecture and distributed system design
  • Exposure to transportation, logistics, or supply chain domains
  • Active GitHub contributions or demonstrated passion for emerging AI and data technologies

Benefits

  • Medical, Dental, and Vision insurance
  • 401(k) with company match
  • Flexible Spending Accounts (FSA)
  • Company-paid Life and Disability insurance
  • Flexible Paid Time Off (PTO) and company holidays
  • Paid Parental Leave
  • Employee Assistance Program (EAP)
  • Opportunity to build cutting-edge AI solutions in a high-growth logistics technology company
  • Collaborative, high-impact team environment

Cargomatic is proud to be an Equal Opportunity Employer. We are committed to creating a diverse and inclusive workplace where all employees feel valued and empowered to succeed.

Similar jobs you might like

Technology

Motional

Senior Software Engineer - AI Data Applications

Senior

Hybrid

San Francisco, CA

🏢 Summary: Full Stack Engineer role on an AI Data Application team focused on accelerating ML dataset generation and data search applications to reduce development cycles for pipelines and models. The position involves building next-generation data curation and search tools, collaborating cross-functionally, and mentoring engineers. The goal is to enable scalable, production-ready systems supporting a driverless future. 🗂️ Requirements: BS or MS in Computer Science or related field, 4+ years of professional experience building web applications, Extensive experience building web applications for search and data curation, Strong programming skills in Typescript, Strong programming skills in Python, Strong knowledge of React, Strong experience building REST services, Strong experience building gRPC services, Strong knowledge of AWS (EKS, Lambda), Experience with Terraform 📃 Skills: Typescript, Python, React, REST, gRPC, AWS, EKS, Lambda, Terraform, Bazel 🏢 Description: Mission Summary: We are seeking an experienced full stack engineer to join our new AI Data Application team. This pivotal role will drive the development and execution of initiatives aimed at significantly accelerating our ML dataset generation and data search applications. The ultimate goal is to drastically reduce the development cycle for new pipelines, ML models and get us operationally prepared for a driverless future. What You'll Be Doing: Cross-functional Collaboration: - Collaborate closely with data mining, ML researchers, and other data platform teams to understand their needs and integrate solutions seamlessly. - Communicate complex technical concepts and strategies to both technical and non-technical stakeholders. Development: - Design and build the next generation of data curation, mining and search applications needed to power our next phase of growth as a company. - Mentor junior engineers and peers on best practices and adoption strategies. What We're Looking For Experience: - BS or MS in Computer Science or related field - 4+ years of professional experience in building web applications - Extensive experience with building web applications for search and data curation needs Technical Skills: - Strong programming skills in Typescript and Python - Strong knowledge of modern frontend technologies such as React - Strong knowledge of building REST and gRPC based services, ideally in Python - Strong knowledge of AWS ecosystem (EKS, Lambda, etc.) and Terraform Bonus Points (not required): - Prior experience in autonomous vehicles (AV) - Prior experience with Bazel based build systems Work Arrangement: We encourage a hybrid schedule with in-office time at one of our locations in Boston, Pittsburgh, or Las Vegas to support collaboration, or this role can be fully remote. Compensation & Benefits: The salary range for this role is $149,000—$198,500 USD. This role may include additional forms of compensation such as a bonus or company equity. Candidates are eligible to participate in a benefits program that includes medical, dental, vision, 401k with company match, health savings accounts, life insurance, pet insurance, and more.

Technology

Motional

Senior Software Engineer - AI Data Applications

Senior

Hybrid

Pittsburgh, PA

🏢 Summary: Full Stack Engineer role on an AI Data Application team focused on building next-generation data curation, mining, and search applications to accelerate ML dataset generation and pipeline development. The position involves close collaboration with ML researchers and data teams to deliver scalable web applications and backend services supporting autonomous vehicle initiatives. The role includes mentoring engineers and contributing to cloud-based infrastructure and service architecture. 🗂️ Requirements: BS or MS in Computer Science or related field, 4+ years of professional experience building web applications, Experience building web applications for search and data curation, Strong programming skills in Typescript, Strong programming skills in Python, Experience with React, Experience building REST services, Experience building gRPC services, Experience with AWS (EKS, Lambda), Experience with Terraform 📃 Skills: Typescript, Python, React, REST, gRPC, AWS, EKS, Lambda, Terraform, Bazel 🏢 Description: Mission Summary: We are seeking an experienced full stack engineer to join our new AI Data Application team. This pivotal role will drive the development and execution of initiatives aimed at significantly accelerating our ML dataset generation and data search applications. The ultimate goal is to drastically reduce the development cycle for new pipelines, ML models and get us operationally prepared for a driverless future. What You'll Be Doing: Cross-functional Collaboration: - Collaborate closely with data mining, ML researchers, and other data platform teams to understand their needs and integrate solutions seamlessly. - Communicate complex technical concepts and strategies to both technical and non-technical stakeholders. Development: - Design and build the next generation of data curation, mining and search applications needed to power our next phase of growth as a company. - Mentor junior engineers and peers on best practices and adoption strategies. What We're Looking For: Experience: - BS or MS in Computer Science or related field - 4+ years of professional experience in building web applications - Extensive experience with building web applications for search and data curation needs Technical Skills: - Strong programming skills in Typescript and Python - Strong knowledge of modern frontend technologies such as React - Strong knowledge of building REST and gRPC based services, ideally in Python - Strong knowledge of AWS ecosystem (EKS, Lambda, etc.) and Terraform Bonus Points (not required): - Prior experience in autonomous vehicles (AV) - Prior experience with Bazel based build systems We encourage a hybrid schedule with in-office time at one of our locations in Boston, Pittsburgh, or Las Vegas to support collaboration, or this role can be fully remote. The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. Candidates for certain positions are eligible to participate in the benefits program, which includes medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more. Salary Range $149,000—$198,500 USD

Technology

Motional

Senior Software Engineer - AI Data Applications

Senior

Hybrid

North Las Vegas, NV

🏢 Summary: Full Stack Engineer role focused on building AI-driven data curation, mining, and search applications to accelerate ML dataset generation and pipeline development. The position involves close collaboration with ML and data teams to design scalable web applications and backend services. The goal is to streamline development cycles and support advanced autonomous systems initiatives. 🗂️ Requirements: BS or MS in Computer Science or related field, 4+ years of professional experience building web applications, Extensive experience building web applications for search and data curation, Strong programming skills in Typescript, Strong programming skills in Python, Strong knowledge of React, Strong experience building REST services, Strong experience building gRPC services, Strong knowledge of AWS ecosystem (EKS, Lambda), Experience with Terraform 📃 Skills: Typescript, Python, React, REST, gRPC, AWS, EKS, Lambda, Terraform, Bazel 🏢 Description: Mission Summary: We are seeking an experienced full stack engineer to join our new AI Data Application team. This pivotal role will drive the development and execution of initiatives aimed at significantly accelerating our ML dataset generation and data search applications. The ultimate goal is to drastically reduce the development cycle for new pipelines, ML models and get us operationally prepared for a driverless future. What You'll Be Doing: Cross-functional Collaboration: Collaborate closely with data mining, ML researchers, and other data platform teams to understand their needs and integrate solutions seamlessly. Communicate complex technical concepts and strategies to both technical and non-technical stakeholders. Development: Design and build the next generation of data curation, mining and search applications needed to power our next phase of growth as a company. Mentor junior engineers and peers on best practices and adoption strategies. What We're Looking For Experience: BS or MS in Computer Science or related field 4+ years of professional experience in building web applications Extensive experience with building web applications for search and data curation needs. Technical Skills: Strong programming skills in Typescript and Python. Strong knowledge of modern frontend technologies such as React. Strong knowledge of building REST and gRPC based services, ideally in Python. Strong knowledge of AWS ecosystem (EKS, Lambda, etc) and Terraform. Bonus Points (not required): Prior experience in autonomous vehicles (AV) is a plus. Prior experience with Bazel based build systems. We encourage a hybrid schedule with in-office time at one of our locations in Boston, Pittsburgh, or Las Vegas to support collaboration, or this role can be fully remote. The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process. Salary Range $149,000—$198,500 USD Candidates for certain positions are eligible to participate in the benefits program. Benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.

Technology

Datadog

Senior Staff Software Engineer

Senior

On-site

New York, NY

272,000 - 340,000 USD/yr

🏢 Summary: Senior Staff Engineer role focused on leading the design and evolution of large-scale distributed systems and data infrastructure supporting high-growth, high-throughput observability platforms. The position combines deep hands-on technical contribution with cross-team architectural leadership and long-term technical strategy ownership. You will drive high-impact initiatives such as distributed storage engines, real-time streaming infrastructure, and large-scale system re-architecture. 🗂️ Requirements: BS/MS/PhD in scientific field or equivalent experience, 10+ years backend, infrastructure, or distributed systems engineering experience, 4+ years leading complex cross-team technical initiatives, Proven design and delivery of large-scale distributed systems, Expertise in distributed storage, event streaming, networking, data infrastructure, or observability, Experience optimizing performance and reliability in high-scale systems, Ability to define architecture across multiple teams, Experience with AI coding tools and validation of AI-generated code 📃 Skills: DistributedSystems, Backend, Infrastructure, DistributedStorage, EventStreaming, Networking, DataInfrastructure, Observability, SystemDesign, Architecture, PerformanceOptimization, Reliability, Scalability, AI 🏢 Description: About Datadog: We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale—trillions of data points per day—providing always-on alerting, metrics visualization, logs, and application tracing for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. The Opportunity: Datadog’s Senior Staff Engineers are technical leaders operating at the forefront of large-scale systems design, building the infrastructure that will support our next five years of growth and beyond. They do this in three major ways: As individual contributors, they bring world-class technical depth to build industry-leading systems in areas such as observability data platforms, distributed query engines, and real-time event streaming at global scale. As technical leaders, they apply broad architectural perspective and deep systems thinking to align design decisions across teams and domains. They work across complex, multi-team problem spaces to define long-term technical direction, drive large-scale initiatives forward, and ensure consistent execution. As engineering stewards, they play a key role in evolving our systems and engineering culture. They actively participate in Datadog’s senior technical community, bringing external insights and internal experience to elevate engineering standards and mentor the next generation of technical leaders. Examples of projects a Senior Staff Engineer may lead include designing and launching a new distributed data storage engine capable of handling hundreds of millions of records per second, building the real-time infrastructure behind a new observability product, or re-architecting a core service to support exponential growth in throughput and complexity. What You’ll Do: Be the technical owner of multiple critical systems or architecture areas, often spanning several teams or product lines. Drive the design and delivery of high-scale, high-impact projects, from vision to execution in production. Build consensus and alignment across stakeholders on key architectural decisions and long-term strategy. Deeply investigate and optimize performance, reliability, and efficiency in large-scale distributed systems. Collaborate with Staff Engineers, Directors, and VPs across the company to shape Datadog’s technical roadmap. Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction. Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups. Who You Are: You have a BS/MS/PhD in a scientific field or equivalent practical experience. You have 10+ years of backend, infrastructure, or distributed systems engineering experience. You have 4+ years of experience leading complex technical initiatives and cross-team projects.You have designed and delivered systems that are deeply technical, highly reliable, and serve critical business needs. You can navigate and make progress in ambiguous problem spaces, identifying the right problems to solve. You have exceptional communication skills, with the ability to align diverse stakeholders around a shared technical vision. You have deep expertise in one or more core systems domains—such as distributed storage, event streaming, networking, data infrastructure, or large-scale observability—and broad awareness of adjacent areas. You care about getting things right, not just getting them done, and you raise the bar for engineering quality around you. You have demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output Bonus: You’re motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled products Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development. Have a lot of influence on product direction and impact on the business . Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn Competitive global benefits Continuous professional development Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. #LI-HybridDatadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.The reasonably estimated yearly salary for this role at Datadog is:$272,000—$340,000 USD About Datadog: Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog: Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines: Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.