DataArt is seeking a Senior Databricks Developer to join a project for an international private equity investor. You will be part of a collaborative team focused on delivering robust cloud-based data engineering solutions within the Microsoft Azure ecosystem, specifically utilizing Lakehouse architecture.
Key responsibilities
- Design and implement scalable data solutions using Azure Databricks.
- Develop complex ETL and ELT workflows for structured and unstructured data.
- Build high-performance data pipelines using PySpark and Spark SQL.
- Design and maintain Lakehouse architectures leveraging Delta Lake.
- Collaborate with architects and stakeholders to ensure data quality, security, and performance optimization.
Requirements
- At least 4 years of professional experience in Data Engineering.
- Minimum 3 years of hands-on experience with Azure Databricks.
- Strong proficiency in Python, SQL, and Apache Spark.
- Proven experience with Azure Data Factory and Azure Data Lake Storage Gen2.
- Solid understanding of data modeling principles and Git-based version control.
- Upper-intermediate or higher proficiency in English.
What we offer
- Up to 26 business days of vacation per year.
- 10 fully paid illness or special leave days annually without medical documentation.
- Comprehensive health and life insurance packages.
- Access to professional development resources including O’Reilly, LinkedIn Learning, and Udemy.
- Certification reimbursement for industry-recognized credentials.
- Internal psychological support services and English language classes.