Senior Data Engineer / Data Architect (Azure Data Explorer, IoT Streaming) – Freelance

Quick Facts

• Role: Senior Data Engineer / Data Architect (Freelance)

• Focus: Azure Data Explorer + IoT streaming for environmental monitoring

• Scope: Take an IoT streaming proof of concept on Azure to production

Description

You will take over an existing proof of concept of a streaming IoT measurement pipeline on Azure and bring it into production. The pipeline covers ingestion through raw layers into read-optimized storage in Azure Data Explorer, including rollups and time-window aggregations. You will own production delivery end to end and optimize ADX models and queries for large data volumes.

Responsibilities

• Take over the PoC and bring it to production (data semantics are already defined)

• Build the stream processor from Event Hubs to Azure Data Explorer

• Design and schedule the cascade of rollups and time-window aggregations

• Implement reprocessing of data after configuration changes

• Model and optimize ADX tables, update policies, materialized views, retention policies, and queries for large data volumes

• Collaborate with PM, the ADX specialist, the client engineering team, and DevOps

Requirements

• At least 2–3 data pipeline projects taken from zero to production as architect or lead data engineer

• Azure Data Explorer in production in at least one of those projects

• Senior data engineering experience (around 5+ years)

• Experience with IoT streams and time-series data

• Broad, hands-on experience with Azure data services

• Independence to own a production pipeline end to end

• English level B2 or higher

• Strong collaboration/communication skills and attention to detail

Benefits

• Freelance, part-time opportunity

• Start in November; remote / Warsaw office (as stated in the posting)

• B2B compensation: 160–200 PLN net + VAT