Senior Data Engineer (Databricks Migration)

Sigma Software is seeking a Senior Data Engineer to join their Data Engineering Center of Excellence. You will play a key role in migrating a large-scale analytical platform from BigQuery to a modern Databricks Lakehouse architecture, working on complex retail data solutions.

Key responsibilities

• Design and implement scalable Lakehouse architectures using Databricks and Delta Lake.
• Analyze existing ETL/ELT workloads and define effective migration strategies.
• Develop and optimize data pipelines using PySpark to process large volumes of retail data.
• Implement data governance and security best practices using Unity Catalog.
• Collaborate with cross-functional teams to design and maintain medallion architecture layers.

Requirements

• 5+ years of professional experience in data engineering.
• Strong programming skills in Python and advanced SQL.
• Hands-on commercial experience with Databricks and Apache Spark (PySpark).
• Solid understanding of distributed data processing and cloud-based data platforms.
• Experience with orchestration tools like Airflow and CI/CD practices.
• Upper-Intermediate or higher level of English proficiency.

What we offer

• Opportunity to work on complex, enterprise-scale international projects.
• Environment focused on continuous learning and professional growth.
• Collaboration with a highly skilled team of engineering experts.
• Impactful work on modernizing large-scale data ecosystems.