Lead Data Engineer (Databricks)

ACAISOFT is seeking a Lead Data Engineer to join our team and collaborate with a major BioPharma organization. In this role, you will be instrumental in building scalable data pipelines that power AI discovery, analytics, and workflow automation, directly contributing to advancements in patient care.

Key responsibilities

• Build and operate data ingestion and processing capabilities for structured, semi-structured, and unstructured data.
• Implement metadata and data quality practices to ensure AI-ready data access across experiments and workflows.
• Collaborate with architects and AI engineers to ensure data is performant and trustworthy for downstream use cases.
• Lead architectural decisions and provide mentorship to junior and mid-level engineering team members.

Requirements

• Extensive experience as a Lead or Principal Data Architect in multinational environments.
• Deep expertise in Python, complex SQL, and production Spark on Databricks, including Delta Lake and Unity Catalog.
• Proven ability to manage the full data lifecycle, including ingestion, transformation, and enrichment.
• Strong background in handling heterogeneous data sources, including PostgreSQL and MongoDB, using CDC patterns.
• Solid understanding of data modeling across layered architectures to support performant access patterns.

What we offer

• Opportunity to work with modern technologies in a high-impact, product-focused environment.
• Private medical care and Multisport card benefits.
• Friendly, informal company culture with direct communication.
• Support for professional growth through challenging, large-scale projects.