Big Data Developer (heating industry)

About the project

For our client, an international leader in the heating industry, we are looking for an experienced developer who will contribute to designing, building, and operationalizing scalable data analytics solutions on Microsoft Azure and Databricks.

Our expectations

• Minimum 6 years in software development within data engineering or analytics environments.

• Expert level knowledge and experience with Python, Azure, Databricks, SQL.

• Experience with scalable data analytics solutions on Microsoft Azure and Databricks.

• Solid experience in production-grade Python engineering (packaging, modular architecture, and concurrency).

• Strong practical knowledge of advanced PySpark, distributed pipelines, and Delta Lake optimization.

• Hands-on experience productionizing Databricks solutions (Workflows, Jobs, and Asset Bundles).

• Proven proficiency in AI-assisted development (GitHub Copilot, specification-driven design) and basic MLflow.

• Active experience in DevOps, including CI/CD automation and build/test/release pipelines via GitHub Actions.

Key tasks

• Designing and building scalable, distributed data pipelines on Microsoft Azure and Databricks, with a focus on Delta Lake performance and optimization.

• Developing production-grade, modular Python applications, ensuring clean architecture, proper packaging, and effective concurrency.

• Productionizing Databricks solutions by setting up and managing end-to-end Workflows, Jobs, and Asset Bundles.

• Implementing specification-driven designs using AI-assisted development tools (like GitHub Copilot) to accelerate delivery, while tracking experiments with MLflow.

• Automating deploy, test, and release processes by building and maintaining robust CI/CD pipelines via GitHub Actions.