Lead Data Engineer (Spark)

Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for global enterprises and pioneering startups. As a Lead Data Engineer, you will join a team of experts to design and develop innovative data-driven platforms, shifting your focus toward strategic system architecture, business consultation, and creative problem-solving.

Key responsibilities

• Design and develop scalable data management architectures and infrastructure for streaming and batch processing using Big Data technologies like Apache Spark and Iceberg.
• Implement data governance processes and best practices to ensure optimal performance and quality.
• Collaborate with Data Science teams on machine learning projects and predictive model building.
• Develop and organize data transformations using DBT and Apache Airflow.
• Translate complex business requirements into robust technical solutions.

Requirements

• 5+ years of commercial experience in developing or maintaining Big Data systems.
• Strong programming skills in Python, Java, or Scala with a focus on clean code and OOP.
• Proven expertise in cloud environments, preferably AWS.
• Familiarity with Big Data tools such as Spark, Airflow, Docker, Kubernetes, and Trino.
• Excellent communication skills with experience in direct client interaction and fluent English (C1).

What we offer

• Work in a supportive team of AI and Big Data enthusiasts on international projects.
• Opportunities for professional growth through career paths, sponsored training, and certifications.
• Flexible cooperation models with 20 fully paid days off.
• Access to medical and sports packages, well-being support, and full work equipment.
• Support for personal branding through conference speaking and content creation.