Data Engineer (Databricks)

In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are looking for a Data Engineer to join a client project focused on building and optimizing modern data platforms on Azure and Databricks. The role involves designing, developing, and maintaining scalable data pipelines, processing large volumes of data, and supporting business-critical analytics solutions.Project information:Type of project: IT ServicesOffice location: WarsawWork model: Hybrid mode – 2 days per week in the office in WarsawBudget: 140 - 153 PLN net/ h - b2bProject length: till the end of 2026, possible to extend itOnly candidates with citizenship in the European Union and residence in PolandStart date: ASAPProject scope:Build and optimize modern data platforms on Azure and DatabricksDesign, develop, and maintain scalable data pipelinesBuild and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needsImplement data ingestion from multiple sources (databases, APIs, files, messaging/ event streams)Perform data transformation, validation, and quality checks across end‑to‑end data flowsCollaborate with Business Analysts and stakeholders to translate requirements into data solutionsSupport production environments, handle incident analysis, and contribute to performance optimizationEnsure compliance with data governance, security, and regulatory standardsCompetence demands:Min 4 YoE in Data Engineering2+ years of hands-on experience with Databricks and Delta Lake in production environments2+ years of experience developing and maintaining Azure Data Factory (ADF) pipelinesVery strong Python, Spark SQL, PySpark programming skillsExperience with Azure Data Lake Storage Gen2 (ADLS Gen2)Knowledge of Medallion architecture, dimensional modelsREST APIs, batch and streaming ingestionGitHub Copilot, CI/CD pipelines, Azure DevOps or similarStrong understanding of data quality, performance tuning, and scalabilityStrong understanding of data modeling, ETL/ELT processes, and modern data architecture principlesVery good English skillsNice to have:PostgreSQL integrationTime-series data processing (GPS/parameter data)Slowly Changing Dimensions (SCD) patternsSpark performance tuning (SLA-driven optimization)Adaptive Query Execution (AQE) configurationCDC (Change Data Capture) and incremental loadingSSIS migration patternsWe offer:Hybrid working modelDynamic and innovation-driven engineering environmentFull-time job agreement based on b2bPrivate medical care with dental care (covering 70% of costs)Multisport card (also for an accompanying person)Life insurance