Data Engineer

Develocraft is looking for a skilled Data Engineer to join a project focused on rebuilding the data platform for a leading UK automotive marketing company. You will play a key role in modernizing data infrastructure, replacing legacy processes with scalable, automated solutions that ensure high data integrity and performance.

Key responsibilities

• Re-engineer marketing data pipelines using a modern analytics stack, including dbt-based transformations and Redshift warehouse models.
• Take ownership of the production database estate, focusing on performance, security, and cost management while implementing CI/CD for database development.
• Build automated data-quality processes and migrate legacy workflows to AWS Transfer Family to eliminate manual data movement.
• Develop automated client onboarding processes, creating repeatable ingestion templates and validation mapping to accelerate client go-live times.
• Utilize AI tooling for query optimization, pipeline debugging, and comprehensive documentation to enhance overall system impact.

Requirements

• 3–5 years of hands-on experience in building data pipelines and managing production databases with end-to-end ownership.
• Expert-level SQL skills, including T-SQL and experience with columnar data warehouses like Redshift, Snowflake, or BigQuery.
• Proficiency in dbt, Python, and orchestration tools such as AWS Glue, Airflow, or Step Functions.
• Experience with Infrastructure as Code tools like Terraform or CloudFormation and a strong understanding of CI/CD pipelines.
• Proven track record in executing safe data migrations, including parallel runs and rigorous data validation checks.

What we offer

• Opportunity to work on a large-scale, complex data estate with modern cloud technologies.
• Full autonomy in designing and implementing scalable data architecture.
• Collaborative environment working with international stakeholders on high-impact automotive marketing products.