Data Engineer (ETL / Hadoop Ingestion)

Quick Facts

• Work model: Hybrid (3x/week in office: Gdynia/Gdańsk/Warsaw or Łódź)

• Contract: B2B (long-term cooperation)

• Rate: Up to 100 PLN net + VAT per hour

Description

We are seeking an experienced OPS Developer to take responsibility for ingesting data onto Hadoop using the ARC Ingestion Framework. You will work in an agile environment with hands-on experience in Linux, SQL, Git, and managing application/configuration setups. The role includes building ingestion configurations, supporting production sources, and resolving ingestion issues.

Responsibilities

• Prepare and test configurations for data ingestion sources

• Maintain existing data sources already ingested in production

• Collaborate with team members to ensure seamless operations

• Monitor and troubleshoot data ingestion issues

• Document processes and configurations for ingestion tasks

Requirements

• Unix/Linux expertise

• Proficiency in SQL

• Experience with Git

• Familiarity with Jenkins

• Strong rational thinking and troubleshooting skills

Nice to Have

• Testing experience

• Familiarity with Hadoop

• Knowledge of Robot Framework

• Experience with Jira, Confluence, Helix

• Basic knowledge of Python