Data Engineer (Kafka / Confluent Cloud)

Quick Facts

• Role: Data Engineer (Kafka / Confluent Cloud)

• Focus: Event-driven data platforms, Kafka/Confluent Cloud, data processing pipelines

Description

Build and maintain event-driven data platforms using Apache Kafka and Confluent Cloud. Design distributed data processing pipelines, implement data integration between systems, and develop Python and SQL-based data transformations. Monitor, diagnose, and resolve data flow issues while collaborating with architects, analysts, and developers on data-driven solutions.

Responsibilities

• Design, develop, and maintain solutions based on Apache Kafka and Confluent Cloud

• Create and evolve data processing pipelines in distributed environments

• Implement data integration processes between different systems

• Build and optimize Python scripts and applications

• Write, develop, and optimize SQL queries and data transformation processes

• Monitor, diagnose, and troubleshoot data flow problems

• Collaborate with architects, analysts, and developer teams to design data-driven solutions

• Participate in the design of event-driven architecture

Requirements

• Commercial experience working with Apache Kafka

• Practical knowledge of Confluent Cloud

• Very good Python knowledge

• Very good SQL knowledge

• Experience designing and maintaining data processing solutions

• Ability to solve problems independently and work in a team environment

Benefits

Not specified in the provided posting.