Azure Databricks Architect

Quick Facts

• Role: Azure Databricks Architect (B2B/UZ)

• Project duration: 3–6 months (extension possible)

• Work mode: Remote

Description

Design and oversee an Azure Databricks–based data platform that meets business, technology, and infrastructure requirements. Lead implementations including infrastructure design and Unity Catalog configuration/development, and define architectural standards and best practices. Ensure quality, security, scalability, and performance while integrating external partners and automating data workflows with Apache Airflow, with a focus on Generative AI (GenAI) capabilities.

Responsibilities

• Architect an Azure Databricks data platform considering business, technological, and infrastructure constraints

• Drive and supervise Azure Databricks implementations (infrastructure design, Unity Catalog configuration and development)

• Define architectural standards, best practices, and the platform evolution roadmap

• Design and implement data management solutions for processing, storage, and sharing

• Identify and implement new platform functionalities and technologies, especially GenAI

• Design and implement data exchange and integration processes with external partners

• Design and develop orchestration and automation for data flows using Apache Airflow

• Collaborate with Data Engineering, Data Science, Cloud, and other technical teams

• Coordinate with business and technical stakeholders to translate requirements into architectural solutions and recommend optimal technical approaches

• Oversee quality, security, scalability, and performance of the designed solutions

• Support technical teams in architecture decisions and complex technical issue resolution

Requirements

• Several years of experience designing data architecture and solutions on Azure Databricks

• Hands-on experience delivering Azure Databricks platform implementations, including infrastructure and Unity Catalog configuration/management

• Strong knowledge of Databricks platform architecture and capabilities for production environments

• Experience designing and implementing data pipelines and data integration architectures

• Experience designing and implementing data exchange processes with external partners

• Practical knowledge of Apache Airflow and experience orchestrating/automating data processing

• Experience designing and implementing cloud solution architecture in Microsoft Azure

• Knowledge of data security concepts, access management, and governance in data environments

• Ability to analyze business requirements and translate them into scalable architectural solutions

• Experience leading technology initiatives and coordinating implementations with technical teams

• Strong communication and collaboration with both technical and business stakeholders

• Very good English enabling smooth communication in an international environment

Benefits

• Opportunity to help develop a modern Azure Databricks data platform

• Real influence on architecture and technology direction

• Work with modern Data Engineering, Cloud, and Generative AI technologies

• Chance to design and implement innovative integration and analytics solutions

• Collaboration with experienced technical and business teams

• Long-term project with the possibility of extension

• 100% remote work