Azure Platform & Data Engineer

emagine Polska is looking for an experienced Azure Platform & Data Engineer to join a long-term project within the dairy industry. This role focuses on managing and enhancing Azure infrastructure while actively contributing to data engineering workflows to ensure system reliability and efficiency.

Key responsibilities

• Design, build, and maintain Azure-based platform services and infrastructure using Infrastructure-as-Code standards.
• Manage Azure networking, security, identity, and access management to ensure a secure environment.
• Oversee Databricks workspaces, including cluster configuration, access controls, and operational standards.
• Develop and maintain CI/CD pipelines in Azure DevOps to automate platform provisioning and deployment.
• Build and optimize ETL/ELT processes using Azure Data Factory, Databricks, and Data Lake technologies.

Requirements

• Strong professional experience with Terraform and Azure infrastructure management.
• Solid understanding of Azure networking, storage solutions, and security/IAM principles.
• Proven experience with Azure DevOps, GitHub, and CI/CD pipeline development.
• Proficiency in PySpark and SQL for data transformation and pipeline development.
• Ability to troubleshoot complex infrastructure issues and drive automation across environments.

What we offer

• A fully remote working environment with a focus on long-term project stability.
• Opportunity to work on a diverse tech stack including Databricks, Azure Data Factory, and advanced cloud infrastructure.
• Engagement in a project with a clear focus on platform engineering, automation, and data architecture.