Big Data Engineer

Micro1 is seeking a skilled Big Data Engineer to join our team and contribute to the development of next-generation AI systems. In this role, you will play a critical part in shaping how models learn and perform by building robust, scalable data architectures that handle complex, real-world inputs.

Key responsibilities

• Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
• Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
• Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
• Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
• Enforce data quality, security, and governance standards across all solutions.

Requirements

• Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
• Advanced proficiency in Python for data processing, automation, and integration.
• Deep understanding of relational and NoSQL databases, including optimization and management techniques.
• Experience with distributed data processing frameworks such as Hadoop, Spark, or Flink.
• Strong foundation in data modeling, ETL processes, and data warehousing principles.

What we offer

• The opportunity to work in a fully remote environment with a high degree of autonomy.
• Engagement in cutting-edge projects involving AI systems and large-scale data processing.
• Collaboration with cross-functional teams in a dynamic, global setting.