Senior Data Engineer

Quick Facts

• Role: Senior Data Engineer (Data/Search)

Description

Build and maintain data pipelines that power an AI-powered search and intelligence platform. You will automate ETL for research content, create embedding pipelines for semantic search, and develop document processing infrastructure for customer uploads (extraction, chunking, and citation anchoring). You will also improve search relevance, support AI agent queries with accurate structured results, and monitor pipeline performance and data quality.

Responsibilities

• Automate and extend ETL pipelines ingesting, transforming, and delivering research content to the platform
• Build embedding pipelines to enable semantic search across the content library
• Develop document processing and extraction capabilities for customer uploads, including text extraction, chunking, and citation anchor generation
• Improve search relevance using indexing strategies, ranking tuning, and retrieval optimization
• Build data infrastructure to support AI agent queries with accurate, well-structured results
• Monitor pipeline performance and data quality; identify and resolve issues before they impact users

Requirements

• 3+ years of experience in data engineering, search engineering, or a related field
• Experience building and maintaining ETL pipelines and working with data warehouses
• Familiarity with semantic search concepts and embedding-based retrieval
• Proficiency in Python and SQL
• Experience with document processing, text extraction, or content transformation
• Strong data quality mindset: correctness, completeness, and consistency

Benefits

• Hybrid/remote work model (about 1–2 days in the office per month)
• Opportunity to contribute to a globally respected market research and advisory firm
• Individualized culture with room to explore new areas outside your specialty
• Equal Opportunity Employer; employment eligibility verification required (E-Verify)