Solution Architect (Databricks & Data Platform)

Quick Facts

• Role: Solution Architect focused on cloud data and application platform architecture (Databricks)

Description

Own and design a cloud-based data and application platform architecture, covering workspace strategy, data architecture layers, security, networking, compute and cost modeling, and production landing zones. Review existing cloud environments and recommend a platform path (modify existing, build new, or phased hybrid), producing decision records with risks, dependencies, and cost considerations. Lead architecture reviews and provide traceability from requirements to deliverables.

Responsibilities

• Review current cloud environments (subscriptions, networking, access/security models, workspace structure, compute patterns, storage, deployment, monitoring, cost controls)

• Recommend platform approach and produce written decision records and diagrams

• Define workspace and catalog structure and the boundary between environments and data domains

• Design data architecture (raw, cleaned, curated, serving layers, feature layer for models, ingestion, transformation, orchestration, semantic layer, reporting support)

• Establish naming, ownership, classification, lineage conventions, and access rules

• Define data security model (managed vs external tables, external locations and storage credentials, row filters, column masks, external-consumption scope)

• Design platform network model (customer-managed virtual network, private access to storage/control plane, remove public exposure)

• Build compute and cost model (cluster/warehouse types, policies, tags, spend forecasting, chargeback mechanism)

• Design production landing zone for external applications (isolated subscription, virtual network, private endpoints, separate tenant for external users, dedicated container registry and secrets store)

• Own application and integration architecture (service layer, data consumption, external authentication, perimeter protection, observability)

• Lead architecture reviews and maintain a requirements-to-deliverables traceability matrix

Requirements

• Databricks platform expertise at platform level (account/workspace split, metastores and catalogs, workspace strategy, environment isolation, practical permission model)

• Unity Catalog end to end (managed and external tables, external locations, row and column protection, lineage, system tables, sharing with external consumers)

• Platform compute and consumption model (cluster and warehouse types, serverless options, policies, pools, tagging, spend analysis and forecasting)

• Platform network isolation (customer-managed networking, private endpoints, removal of public access, storage-level restrictions, audit logging)

• Medallion architecture and semantic layer design for application and reporting consumption

• Ingestion approach selection (incremental file ingestion, streaming and declarative pipelines, change data handling, federated access without copying)

• Delivery and environment promotion (portable project bundles, source control integration, catalog parameterization, automated tests)

• Azure design depth (App Service, Front Door and WAF, Key Vault, Container Registry, App Insights, Log Analytics, Entra ID)

• Infrastructure as code, preferably Bicep

• External identity design (registration/invitation, MFA and conditional access, organization association, role-based access, account lifecycle, audit logging)

• Demonstrated practice of architecture reviews with written arguments for decisions

Benefits

• Own end-to-end platform and integration architecture across production and external consumption scenarios.