Sowelo Consulting is seeking a motivated Senior Data Engineer to join an innovative AI and data solutions consultancy. In this role, you will design, develop, and maintain modern data solutions using Databricks, helping clients process, transform, and analyze data effectively within a fully remote environment.
Key responsibilities
- Collaborate with cross-functional teams to design and build scalable data pipelines and workflows in Databricks.
- Develop ETL/ELT processes using Databricks, Python, and SQL to ingest, transform, and prepare data.
- Optimize data workflows for higher performance, reliability, and cost-efficiency within cloud environments.
- Partner with data analysts and scientists to deliver clean, accessible data for analytics and reporting.
- Monitor pipelines, troubleshoot technical issues, and contribute to internal documentation and best practices.
Requirements
- 4+ years of hands-on experience in data engineering, data transformation, or analytics engineering.
- Strong proficiency in Python and SQL.
- Practical experience designing and maintaining data pipelines within the Databricks ecosystem.
- Working knowledge of public cloud environments such as Azure, AWS, or GCP.
- Strong focus on code quality, testing, and writing clean, maintainable software.
What we offer
- Deep-dive into modern Lakehouse architectures with a team specializing in high-performance cloud data.
- Work that directly powers enterprise AI, MLOps, and Generative AI initiatives.
- Total location independence with flexible working hours designed around trust and outcomes.
- Opportunity to solve complex data engineering challenges for top-tier enterprise clients.