Azure Data Engineer with Databricks

Link Group is seeking a skilled Azure Data Engineer to join our team and contribute to the development of scalable data processing solutions. You will play a key role in designing and maintaining robust data pipelines while collaborating with cross-functional teams to deliver high-quality data platform solutions in a fully remote environment.

Key responsibilities

• Develop and implement scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets.
• Design, build, and maintain robust data pipelines integrating data from diverse sources such as databases, APIs, and streaming platforms.
• Collaborate with data scientists, cloud architects, and product owners to deliver end-to-end data platform solutions.
• Communicate and document technical work, ensuring performance and cost-efficiency in all design decisions.

Requirements

• Hands-on experience implementing solutions with data lakes and pipelines using Databricks and Azure Data Factory.
• Proficiency in SQL, PySpark, data modeling, and ELT/ETL design patterns.
• Experience with Python for data transformation, orchestration, and automation.
• Familiarity with advanced Databricks features like Unity Catalog, MLflow, and Jobs & Pipelines.
• Understanding of cloud data architecture, including Lakehouse concepts, Medallion architecture, and event-driven systems.
• Experience with CI/CD and DevOps practices for data workflows using Git and Azure DevOps.

What we offer

• Opportunity to work on complex, end-to-end data platform projects within a collaborative, multidisciplinary team.
• Full remote work flexibility, allowing you to contribute from anywhere.
• Engagement at all critical stages of project development, providing a comprehensive view of the business and technical landscape.