Data Engineering Lead

Senior • Remote

$160 - $210/

Wrocław, Poland , +1

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.

This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As a Data Engineering Lead, you will guide Avanade Data Engineering teams in building modern Data & AI solutions. You’ll work with clients from various domains and industries, being exposed to Microsoft technologies and AI solutions. Beside helping design and deliver scalable data platforms and state-of-the-art AI solutions, you will also act as a Team Manager for ~10-20 specialists.

What you’ll do:

Lead technical design and implementation of data pipelines, warehouses and integration solutions
End-to-end development of data architectures and ETL processes
Implementing data governance, data quality, and data security best practices across data systems
Collaborating with clients and internal teams to translate business needs into robust data solutions
Acting as both direct and indirect Team Manager for 10-20 specialists, providing them with mentoring and guidance
Staying up-to-date with the latest developments in data engineering & AI world
Explore and apply Machine Learning/AI solutions in projects

Tech stack:

During projects you will work with different tools, but the most core tech stack is:

Databricks, PySpark, Azure cloud and services (Data Lake, SQL Database, Azure Databricks, Data Factory), SQL, Python, MS Fabric, Azure OpenAI, Azure AI Foundry, Copilot Studio

Required skills:

For this role, you will need hands-on experience with:

Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
Databricks
Python and PySpark
SQL
Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
AI solutions: Azure OpenAI, Azure AI Foundry
Docker/Kubernetes
English (B2)

Nice to have:

Experience with MS Fabric
Knowledge of machine learning concepts and frameworks (e.g. MLflow, TensorFlow)
Knowledge/experience with LLMs and orchestration frameworks
Familiarity with GitHub Copilot, Copilot Studio, Cursor or similar tools

If you want to ask any questions before applying, feel free to reach out via LinkedIn!

MW Consulting

MW Consulting is a company that specializes in providing business-to-business (B2B) cooperation services, focusing on connecting skilled professionals with client companies. The company operates within various domains and industries, including aerospace, automotive, and retail, showcasing its versatility and broad industry reach. MW Consulting values modern project engagement and emphasizes the importance of technical best practices, mentorship, and feedback in its operations. The company is committed to facilitating remote and hybrid work arrangements, indicating a flexible and adaptive work culture. MW Consulting collaborates with Avanade Poland, highlighting its strategic partnerships and international connections.