Senior Databricks Engineer (Data Architecture & Design Focus)

Location: 100% Remote
Contract: B2B or UoP (via Entrada AI Poland)

ABOUT ENTRADA AI
Entrada AI is a specialized consulting partner and a strategic portfolio company of Databricks Ventures. This is a rare distinction: Databricks invested in us because of our technical excellence, placing us in the "inner circle" of the ecosystem. For our engineers, this means direct access to product roadmaps, private previews, and the teams building the platform.

You will join a team of industry veterans and Databricks MVPs. We look for engineers who value clean architecture over quick fixes. We don't just maintain pipelines; we solve complex architectural challenges for Fortune 500 clients using features often before they are widely available.

Role Overview

We are seeking a Senior Data Engineer to join our team in a high-impact, design-centric role. This is not a traditional "plumbing" or pure ETL role; we are looking for a Senior Data Engineer who is an expert in data craftsmanship.

You will be the primary owner of our Conformed Silver Layer (which functions as our internal Gold Layer) and will be responsible for the feature engineering that drives all downstream business consumption. The successful candidate will have a deep passion for Data Design over simple ETL. You should be someone who thinks about the "ins and outs" of refined data—how it is modeled, how it is governed, and how it is "shipped" to the business and ML teams to ensure maximum value.

Key Responsibilities

• Build the Conformed Silver Layer: Hands-on engineering and implementation of the Conformed Silver Layer, ensuring all data is unified, schema-enforced, and ready for high-stakes business logic.

• Implement Refined Data Models: Translate complex business rules into technical DWH structures (Star Schemas, Medallion Gold tables). You aren't just moving data; you are engineering the way it is consumed.

• Feature Engineering: Develop and operationalize specific feature sets within the data platform to support downstream Data Science and ML workflows.

• Develop Generic Frameworks: Build and maintain reusable, metadata-driven ETL/ELT frameworks in PySpark to accelerate the onboarding of new data sources while keeping code clean and maintainable.

• Optimize for Downstream Shipping: Deeply tune Spark jobs (partitioning, bucketing, caching) to ensure that refined data layers are "shipped" to the business with minimum latency and maximum reliability.

• Data Quality Engineering: Implement automated reconciliation and validation gates at the Silver-to-Gold boundary to ensure data integrity before it reaches the end-user or model.

Required Skillset & Experience

• Experience: Minimum 5+ years in Big Data, with a proven track record where Data Design/DWH experience outweighs pure ETL experience.

• Databricks Mastery: Expert-level proficiency in the Databricks ecosystem, including Delta Lake, PySpark, and Spark SQL.

• Refined Data Expertise: Deep understanding of the Medallion Architecture and the nuances of moving data from Bronze to a truly "Conformed" Silver/Gold state.

• Modeling Proficiency: High level of comfort with various modeling patterns (Star Schema, Snowflake, or Data Vault) and a clear understanding of when to apply each.

• Infrastructure & Governance: Familiarity with Unity Catalog and managing data governance/access at scale.

• Communication: Fluent English (written and spoken), with the ability to explain complex data design decisions to both technical teams and business stakeholders.

You are a great fit if:

• You don't just move data; you design how it should look for the person using it.

• You prefer building generic, metadata-driven frameworks over writing "one-off" pipelines.

• You are familiar with the complexities of "post-Gold" consumption and how to architect for different organizational owners.

THE OFFER

• Competitive Salary: 160 - 210 PLN / hour based on your experience and skills.

• Stable Employment: Contract signed with our Polish entity (Entrada AI Poland). We are open to both Employees (UoP) and Independent Contractors (B2B) for long-term cooperation.

• 100% Remote: Full flexibility to work from anywhere in Poland.

• Apple Hardware: Macbook Air M4 15" provided.

• Referral Bonus: Bonus for bringing other top-tier engineers to the team.

• Professional Growth:

  • Databricks certification cost coverage.

  • Support on the path to becoming a Databricks Solution Architect Champion.

  • Opportunity to present at industry conferences (building your personal brand).

  • Direct collaboration with Databricks MVPs and product teams.

RECRUITMENT PROCESS

• Introductory Call (20 min): Short conversation with our Recruiter to discuss your background and expectations.

• Technical Interview (60 min): Deep dive into your technical skills with our engineering team.

• Optional Client Interview: Required only in specific cases.

• Decision & Offer: We aim to close the process efficiently.