Senior Data Engineer (Spark)

Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for global enterprises and pioneering startups. We are looking for a Senior Data Engineer to join our expert team and work on challenging, high-impact projects across various industries.

Key responsibilities

• Develop and maintain high-performance data processing platforms, ensuring scalability and reliability.
• Design and implement data pipelines for processing large volumes of data in both streaming and batch modes.
• Optimize data workflows using technologies such as Spark, Cloudera, and Airflow.
• Collaborate with cross-functional teams to integrate diverse data sources and ensure high availability of data processing.
• Write and maintain high-quality code in Python, Java, or Scala for data automation and processing tasks.

Requirements

• At least 3 years of commercial experience in implementing and maintaining Big Data systems.
• Strong programming skills in Python, Java, or Scala with a focus on clean code and OOP design.
• Hands-on experience with Big Data technologies like Spark, Airflow, Kafka, Docker, and Iceberg.
• Solid understanding of dimensional data modeling techniques and cloud environment deployments.
• Fluent English (C1 level) and previous experience in a consulting role with direct client interaction.

What we offer

• Work in a supportive team of passionate AI and Big Data enthusiasts on international projects.
• Access to professional development through career paths, language classes, and sponsored training or conferences.
• Comprehensive benefits including medical and sports packages, well-being support, and an integration budget.
• Full work equipment provided to ensure optimal productivity in a fully remote environment.