Senior Databricks Engineer

Entrada is looking for a Senior Databricks Engineer to join our team and help design, build, and optimize scalable data solutions. You will play a key role in modernizing data architectures and ensuring high-performance data processing within a fully remote environment.

Key responsibilities

• Design and implement scalable data pipelines using Apache Spark and PySpark on the Databricks platform.
• Analyze and optimize complex Spark jobs to improve performance and cost-efficiency, utilizing features like the Photon engine.
• Lead the migration of legacy data warehouses to a modern Lakehouse architecture using Delta Lake.
• Enforce high code quality standards through rigorous code reviews and the implementation of CI/CD pipelines using Databricks Asset Bundles.
• Provide technical mentorship to team members and act as a trusted advisor for our clients.

Requirements

• Over 5 years of professional experience in Data Engineering with a focus on distributed systems.
• At least 3 years of hands-on experience with the Databricks platform and a deep understanding of Delta Lake internals.
• Proven production experience with cloud environments such as Azure or AWS.
• Advanced proficiency in Python and SQL, along with experience implementing Unity Catalog for modern data governance.
• Fluent English communication skills, enabling effective direct collaboration with international clients.

What we offer

• The opportunity to work on complex, high-impact data projects within a fully remote team.
• A collaborative environment that values technical excellence, knowledge sharing, and professional growth.
• Exposure to cutting-edge technologies and modern data architecture patterns.