Senior Software Engineer - Husky Storage

Quick Facts

• Role: Senior Software Engineer (distributed storage / event platform)

Description

Work hands-on with a distributed storage system at petabyte scale to evolve an Event Platform for the AI era. Lead migration from a custom storage format toward open standards—Parquet, Arrow, and DataFusion—enabling on-prem solutions, complex analytical/batch workloads, and AI observability. Partner with Husky Ingestion, Metadata, Platform, and increasingly with Lakehouse (Iceberg-compatible boundary) to improve the service’s operation and scalability.

What You’ll Do

• Drive adoption by migrating the storage format to open source Parquet and re-imagine compaction on a format-agnostic, DataFusion-based substrate
• Deliver cost-reduction work: block-level inverted index compression, combining the database with external objects at the row level, and storage tiering/caching
• Scale the solution to enable customers to manage event versioning at scale using temporal-database techniques
• Play an influential role in operating and deciding how to best operate the service going forward
• Work across the write path (with Ingestion) and toward a cleaner Iceberg-based handoff to Lakehouse for batch/analytical workloads

Requirements

• Enthusiastic and experienced with large-scale distributed systems and/or storage engines
• Comfortable with improving and operating large distributed systems that customers rely on for critical business functions
• Strong fundamentals in columnar/file storage formats (Parquet, ORC, Arrow) or comparable systems

Bonus (preferred)

• Experience with Go, Java, or Rust; compaction; compression/encoding schemes (RLE, dictionary, delta, gorilla)
• Experience with object storage (S3/GCS/Azure Blob) at scale including caching and cost optimization
• Experience with Kafka and stream processing
• Experience with Kubernetes

Benefits

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
• Continuous professional development, product training, and career pathing
• Intradepartmental mentor and buddy program
• Inclusive culture and access to Inclusion Talks
• Free, global mental health benefits for employees and dependents age 6+
• Competitive global benefits
• Potential additional healthcare, dental, parental planning, mental health benefits, 401(k) plan and match, paid time off, fitness reimbursements, and discounted employee stock purchase plan

Compensation

Estimated yearly salary: $192,000 — $240,000 USD