Data Ingestion Operations Engineer

Quick Facts

• Role: Data Ingestion Operations Engineer

• Focus: Data ingestion configuration, testing, production maintenance, and troubleshooting

Description

You will prepare and test configurations for data ingestion using the ARC Ingestion Framework. The role involves ingesting data sources into Hadoop, maintaining already-ingested sources in production, and troubleshooting ingestion process and configuration issues while working in an Agile environment.

Responsibilities

• Prepare and test ARC Ingestion Framework configurations

• Ingest data sources into Hadoop

• Maintain production data sources

• Troubleshoot ingestion-related issues (processes and configurations)

• Work in an Agile environment

Requirements

• Hands-on experience with Unix/Linux

• Practical knowledge of SQL

• Experience with Git

• Familiarity with Jenkins

• Ability to troubleshoot technical issues

• Strong rational thinking and problem-solving skills

• Experience working in an Agile environment

• Experience working with different applications and configurations

• Very good command of English (spoken and written)

Nice to have

• Testing experience

• Familiarity with Hadoop

• Experience with Robot Framework

• Knowledge of Jira, Confluence, or Helix

• Basic Python knowledge

Benefits

• Private medical care

• Co-financing for the sports card

• Ongoing support of a dedicated consultant

• Employee referral program