Senior Databricks Engineer

We’re looking for specialists open to cooperate on a B2B basis for a customer, Avanade Poland.

This role is available remotely within Poland or in a hybrid model from offices in Wroclaw and Krakow.

Position

As a Senior Databricks Engineer, you will work on projects across various domains and industries, focused mainly on Databricks and Azure cloud.

Responsibilities

• Design, build, and maintain scalable, efficient, and reliable data pipelines.
• Develop data architectures and ETL processes end to end.
• Collaborate with data scientists, analysts, and engineering teams to ensure data integration and optimization.
• Implement engineering best practices across data systems.
• Optimize data workflow performance and ensure the reliability of data solutions.
• Stay up to date with the latest developments in data engineering.
• Act as a Team Lead on the project when needed.
• Develop AI engineering skills.

Required skills

• Commercial experience with Databricks.
• Commercial experience with Azure cloud and services, including Azure Data Factory, Data Lake, SQL Database, and Azure Databricks.
• Commercial experience with Python and PySpark.
• Commercial experience with SQL.
• Knowledge of data engineering concepts, including ETL, data modeling, data warehousing, and data governance.
• Experience with Docker and Kubernetes.
• English at B2 level.

Nice to have

• Knowledge of OCR and related libraries, such as easyOCR.
• Experience in data science.