Data Engineer (Spark)

Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for global enterprises and startups. We are looking for a talented Data Engineer to join our team of experts and work on challenging international projects involving Big Data, cloud infrastructure, and advanced analytics.

Key responsibilities

• Develop and maintain high-performance data processing platforms ensuring scalability and reliability.
• Design and implement data pipelines for large-scale streaming and batch processing.
• Optimize data workflows using technologies such as Spark, Cloudera, and Airflow.
• Collaborate with cross-functional teams to integrate diverse data sources and ensure high data accuracy.
• Leverage cloud services to manage infrastructure and scale processing workloads effectively.

Requirements

• At least 3 years of commercial experience in developing or maintaining Big Data systems.
• Strong programming skills in Python, Java, or Scala with a focus on clean code and OOP.
• Hands-on experience with Spark, Airflow, Kafka, Docker, and data lake technologies like Iceberg.
• Solid understanding of dimensional data modeling and cloud deployment environments.
• Fluent English (C1 level) and previous experience in a consulting role with direct client interaction.

What we offer

• Work in a supportive team of passionate AI and Big Data enthusiasts.
• Engagement in international projects for top-tier global enterprises.
• Professional growth through career paths, knowledge-sharing, and sponsored training or certifications.
• Access to medical and sports packages, well-being support, and full work equipment.
• Opportunities to build your personal brand by speaking at conferences and contributing to our blog.