Data Engineer (Spark)

Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for global enterprises and startups. We are looking for a talented Data Engineer to join our team and work on challenging international projects involving Big Data, cloud infrastructure, and advanced data processing platforms.

Key responsibilities

• Develop and maintain high-performance data processing platforms ensuring scalability and reliability.
• Design and implement data pipelines for large volumes of data in streaming and batch modes.
• Optimize data workflows using technologies such as Spark, Cloudera, and Airflow.
• Collaborate with cross-functional teams to integrate diverse data sources and ensure high data accuracy.
• Leverage cloud services to manage infrastructure and scale processing workloads effectively.

Requirements

• At least 3 years of commercial experience in developing or maintaining Big Data systems.
• Strong programming skills in Python, Java, or Scala with a focus on clean code and OOP design.
• Hands-on experience with Spark, Airflow, Kafka, Docker, and data lake technologies like Iceberg.
• Excellent understanding of dimensional data modeling and cloud deployment environments.
• Fluent English (C1 level) and prior experience in a consulting role with direct client interaction.

What we offer

• Work in a supportive team of passionate AI and Big Data enthusiasts on global projects.
• Access to professional growth through career paths, sponsored training, and industry certifications.
• Comprehensive medical and sports packages, well-being support, and integration budgets.
• Full work equipment provided for optimal productivity in a fully remote environment.