Data Engineer (Azure)

Motife is looking for a skilled Data Engineer to join a project for a US-based leader in background screening solutions. You will be part of a diverse, international team focused on building and scaling a robust Azure Data Analytics Platform to support mission-critical services for Fortune 100 clients.

Key responsibilities

• Build reusable, metadata-driven data pipelines and automate platform processes.
• Develop integrations with various data sources and extend shared ETL libraries.
• Create monitoring solutions for the Databricks platform and proactively address performance issues.
• Conduct code reviews and implement architecture improvements to ensure high-quality standards.
• Collaborate with infrastructure teams on cloud resources and maintain comprehensive documentation.

Requirements

• Strong experience with Python, PySpark, and SQL in production environments.
• Hands-on experience building robust data pipelines using Databricks Spark.
• Knowledge of Kafka or similar streaming platforms and Spark Structured Streaming.
• Familiarity with CDC concepts and Databricks Delta optimization techniques.
• Experience with CI/CD pipelines and Agile/Scrum methodologies.

What we offer

• 100% remote work model allowing for flexibility.
• Opportunity to work in an international setting with a focus on professional development.
• Engagement in a senior engineering team building secure and scalable data solutions.