Databricks Engineer

MW Consulting is seeking a skilled Databricks Engineer to join projects for our client, Avanade Poland. In this role, you will work on diverse industry projects, focusing on leveraging Databricks and Azure cloud technologies to build robust data solutions.

Key responsibilities

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines.
• End-to-end development of data architectures and complex ETL processes.
• Collaborating with data scientists, analysts, and engineering teams to ensure seamless data integration and optimization.
• Implementing best engineering practices across data systems to ensure high performance and reliability.
• Mentoring junior team members and staying current with the latest advancements in data engineering and AI technologies.

Requirements

• Strong commercial experience with Databricks and the Azure cloud ecosystem, including Azure Data Factory, Data Lake, and SQL Database.
• Proficiency in Python, PySpark, and SQL.
• Solid understanding of data engineering concepts such as ETL, data modeling, data warehousing, and data governance.
• Professional proficiency in English (B2 level).
• Experience with Docker, Kubernetes, or data science workflows is considered a significant advantage.

What we offer

• Opportunity to work on challenging, large-scale data projects across various industries.
• A fully remote work environment allowing for flexibility and professional growth.
• Access to advanced AI technologies and continuous development opportunities within a collaborative team.