Senior Data Engineer (AI Consumer Intelligence Platform)

Kratos Growth is a rapidly growing consumer intelligence platform that provides actionable insights to leading global brands such as Coca-Cola, Unilever, and Bayer. We are looking for a Senior Data Engineer to architect and scale production data pipelines that power our advanced NLP and ML systems, processing billions of multilingual data points daily.

Key responsibilities

• Design, build, and maintain production data pipelines processing over 10 million text records daily across multiple languages.
• Architect scalable NLP data infrastructure using PySpark, Databricks, and Azure services.
• Integrate Large Language Model APIs into production pipelines for advanced text analysis and enrichment.
• Establish DataOps standards, including CI/CD, testing frameworks, and deployment automation.
• Implement observability and alerting for pipeline health, data quality, and system performance.

Requirements

• 5+ years of experience building and maintaining production ETL/ELT data pipelines.
• 2+ years of experience working with text and NLP data, including tokenization and multilingual processing.
• 4+ years of professional Python experience in production environments.
• Strong proficiency in SQL, including complex queries and performance optimization.
• Experience with Databricks, containerization, and Kubernetes deployment.

What we offer

• Opportunity to work with a modern tech stack and cutting-edge NLP/ML technologies at scale.
• High ownership and impact, with the ability to shape architectural decisions for a platform serving Fortune 500 clients.
• Clear path to technical leadership as a foundational team member in a high-growth environment.
• Fully remote work environment with a collaborative global team.