Big Data Engineer

ERPA

20m ago • Remote

Senior

Remote

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Quick Facts

  • Role: Big Data Engineer

  • Work model: 100% remote (Contract to Hire)

  • Experience: 10+ years

  • Communication: 10/10 required

Description

You will design, build, and maintain large-scale data pipelines and streaming platforms. Work across Spark-based batch/stream processing, orchestrate workflows with Airflow, and move data using Kafka on Google Cloud Platform.

Responsibilities

  • Develop and optimize complex SQL queries for data processing

  • Build data pipelines integrating RESTful APIs

  • Implement batch and streaming data processing with Spark and Spark Streaming

  • Orchestrate jobs and workflows using Airflow

  • Use Kafka for event/data streaming

  • Perform data engineering work on GCP services such as BigQuery and Dataproc

  • Apply CI/CD practices using GitLab CI

Requirements

  • 10+ years of Big Data Engineering experience

  • 10/10 communication skills

  • Proficiency in Python and Airflow

  • Strong PySpark and Spark SQL skills

  • Experience with Spark Streaming

  • Experience with Scala

  • Experience with relational and NoSQL databases

  • Ability to write complex SQL queries

  • Experience with Apache Kafka

  • Hands-on Google Cloud Platform experience (BigQuery, Dataproc)

  • Experience working with RESTful APIs in data pipelines

  • CI/CD experience with GitLab CI

Benefits

  • 100% remote opportunity

  • Contract to hire position

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report