Senior Databricks Engineer (Data Architecture & Design Focus)

Entrada AI is a specialized consulting partner and a strategic portfolio company of Databricks Ventures. We are seeking a Senior Data Engineer to join our team in a high-impact, design-centric role where you will focus on data craftsmanship, architectural integrity, and the development of refined data layers for Fortune 500 clients.

Key responsibilities

• Build and implement the Conformed Silver Layer, ensuring data is unified, schema-enforced, and ready for business logic.
• Translate complex business requirements into technical DWH structures such as Star Schemas and Medallion Gold tables.
• Develop and maintain reusable, metadata-driven PySpark frameworks to accelerate data onboarding.
• Optimize Spark job performance through advanced tuning of partitioning, bucketing, and caching strategies.
• Implement automated data quality gates to ensure integrity before data reaches end-users or machine learning models.

Requirements

• Minimum 5+ years of experience in Big Data with a strong focus on Data Design and DWH architecture.
• Expert-level proficiency in the Databricks ecosystem, specifically Delta Lake, PySpark, and Spark SQL.
• Deep understanding of Medallion Architecture and the nuances of data refinement.
• High level of comfort with modeling patterns like Star Schema, Snowflake, or Data Vault.
• Familiarity with Unity Catalog for managing data governance and access at scale.

What we offer

• Stable long-term cooperation via B2B or UoP contracts.
• Provision of high-end Apple hardware for your daily work.
• Comprehensive support for professional growth, including Databricks certification coverage.
• Direct collaboration with industry veterans, Databricks MVPs, and product teams.
• Opportunities to build your personal brand by presenting at industry conferences.