Big Data Engineer

EXPinIT is looking for a skilled Big Data Engineer to join our new Data Engineering Team. You will play a key role in designing, building, and evolving large-scale data integration solutions within our existing data platform, focusing on efficient data ingestion from diverse internal and external systems.

Key responsibilities

• Designing and developing robust data integration pipelines for complex data ecosystems.
• Ingesting data from multiple internal and external source systems into our Cloudera-based platform.
• Maintaining and evolving existing data integration solutions to ensure high performance and scalability.
• Collaborating with team members to optimize data flows and processing efficiency.

Requirements

• Proven professional experience working with Spark and Scala.
• Strong proficiency in Python and advanced SQL skills.
• Solid understanding of Linux environments and distributed data processing engines.
• Experience with Hadoop ecosystem components such as Hive, Oozie, and MapReduce.
• Expertise in version control systems like BitBucket and GIT.
• Practical experience with unit testing frameworks including JUnit 5, Mockito, and Spark testing.
• Advanced English communication skills.

What we offer

• Opportunity to work on large-scale data projects within a professional engineering team.
• Access to modern data processing technologies and a robust Cloudera platform.
• A fully remote work environment that supports professional growth and technical excellence.