Senior Software Engineer, Identity Resolution

Quick Facts

• Role: Senior Software Engineer for Identity Resolution

Description

Design, develop, test, and support large-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large and diverse datasets. Build both real-time and batch identity-resolution workflows, including low-latency backend APIs. Collaborate with architects and cross-functional teams to deliver scalable, reliable, secure, high-performance solutions.

Responsibilities

• Develop and maintain software for large-scale Identity Resolution/Entity Resolution platforms
• Build systems for identity matching, linking, consolidation, and resolution across multiple datasets
• Implement real-time and batch identity-resolution workflows
• Create low-latency APIs for real-time identity lookup and resolution
• Build and optimize distributed data-processing applications with Apache Spark
• Develop and maintain Spark workloads using Scala and Python
• Write complex SQL for identity matching, analysis, and data transformation
• Work with Databricks to optimize and operate large-scale data-processing workloads
• Develop cloud-native solutions using AWS
• Translate solution designs into production-quality software
• Implement deterministic and probabilistic matching, fuzzy matching, normalization, identity stitching, and scoring
• Optimize application, Spark, SQL, and data pipelines for performance and scalability
• Troubleshoot distributed-processing, data-quality, and production performance issues
• Add automated tests/validation for match accuracy and reliability
• Implement monitoring, logging, metrics, and observability
• Participate in code reviews and improve engineering practices; mentor engineers
• Collaborate with architects, data engineers, product, and security stakeholders

Requirements

• 5+ years of professional software development experience with production systems
• Strong proficiency in Java and Python; strong proficiency in Scala
• Hands-on experience with Apache Spark and distributed data processing
• Advanced SQL proficiency (complex queries, transformations, query optimization)
• Experience building production workloads using Databricks
• Experience building cloud-based applications and services using AWS
• Experience in Identity Resolution/Entity Resolution/record linkage or similar matching systems
• Experience building REST APIs and backend services/microservices/distributed applications
• Experience building and optimizing high-throughput, low-latency services and APIs
• Strong distributed systems knowledge (concurrency, partitioning, caching, resiliency, scalability, fault tolerance)
• Experience optimizing Spark workloads (partitioning, joins, caching, memory utilization, execution performance)
• Knowledge of software design principles, data structures, algorithms, and design patterns
• Experience with automated testing, CI/CD, and modern delivery practices
• Git experience and collaborative workflows
• Strong analytical/troubleshooting/problem-solving skills
• Excellent written and verbal communication
• Ability to independently own complex tasks while collaborating
• Bachelor’s degree (CS/Software Engineering/Computer Engineering) or equivalent experience

Benefits

Not specified in the provided posting.