Azure Platform & Data Engineer

emagine Polska is looking for an experienced Azure Platform & Data Engineer to join a long-term project within the dairy industry. This role focuses on managing and enhancing Azure infrastructure while supporting data engineering workflows to ensure high performance and operational stability.

Key responsibilities

• Design, build, and maintain Azure-based platform services and infrastructure using Infrastructure-as-Code standards with Terraform.
• Manage Azure networking, storage, security, identity, and access management to ensure a secure environment.
• Oversee Databricks workspaces, including cluster configuration, access controls, and the establishment of best practices.
• Develop and maintain CI/CD pipelines in Azure DevOps to automate platform provisioning and deployment processes.
• Build and optimize ETL/ELT data ingestion and transformation pipelines using Azure Data Factory and Databricks.

Requirements

• Strong professional experience in Azure infrastructure management and networking.
• Proven proficiency with Terraform for infrastructure automation.
• Solid understanding of Azure security, IAM, and storage solutions.
• Experience with CI/CD practices using Azure DevOps, GitHub, or GitHub Actions.
• Proficiency in Pyspark and SQL for data processing tasks.

What we offer

• A fully remote working environment with a focus on long-term project stability.
• Opportunity to work on a diverse tech stack involving Azure, Databricks, and modern data engineering tools.
• Engagement in a project with a clear focus on platform architecture and automation.