Mid Data Engineer

RemoDevs is seeking a skilled Mid Data Engineer to join a dynamic project focused on developing, maintaining, and optimizing robust data pipelines. This role is ideal for a professional with strong PySpark expertise who is looking to leverage their skills in a modern data processing environment.

Key responsibilities

• Develop and maintain complex data pipelines using PySpark and Apache Spark.
• Build and optimize data transformation processes to handle large-scale datasets efficiently.
• Integrate data from diverse sources while ensuring reliable and high-quality data delivery.
• Write, maintain, and optimize SQL queries to support data processing workloads.
• Utilize Databricks to develop, execute, and troubleshoot data processing tasks.

Requirements

• Strong, hands-on experience with PySpark and distributed data processing.
• Solid commercial background in Data Engineering at a mid-level.
• Proficiency in SQL and advanced data transformation techniques.
• Practical experience with Databricks and building ETL/ELT pipelines.
• Familiarity with cloud environments such as Azure, AWS, or GCP.
• Ability to work independently and solve complex technical challenges.

What we offer

• Opportunity to work on a hands-on project focused on real-world PySpark development.
• Exposure to modern data processing technologies and lakehouse architecture.
• A collaborative environment where you can further develop your engineering skills.
• Engagement in a project that prioritizes data pipeline optimization and performance.