Data Engineer (Databricks, Azure)

MW Consulting is seeking a skilled Data Engineer to join projects for our client, Avanade Poland. This is a fully remote position where you will work with modern data technologies to build scalable solutions for diverse industries.

Key responsibilities

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines.
• Developing end-to-end data architectures and ETL processes.
• Collaborating with data scientists, analysts, and engineering teams to ensure effective data integration and optimization.
• Applying best engineering practices across all data solutions.
• Optimizing data workflows and ensuring the reliability and performance of data systems.

Requirements

• Proven commercial experience with Databricks and Azure cloud services, including Azure Data Factory, Data Lake, and SQL Database.
• Strong proficiency in Python, PySpark, and SQL.
• Solid understanding of data engineering concepts such as ETL, data modeling, medallion architecture, and data governance.
• Experience with Terraform for infrastructure management.
• English language proficiency at a B2 level or higher.

What we offer

• Opportunity to work on complex projects for various domains and industries.
• Development of skills in AI Engineering and exploration of new technological opportunities.
• Professional growth within a collaborative and expert-driven environment.