Data Engineer (Databricks & Agentic Automation)

AgileEngine is an Inc. 5000 company creating award-winning software for Fortune 500 brands and innovative startups. We are seeking a skilled Data Engineer to join our team and focus on developing scalable ETL/ELT pipelines while productionizing agentic workflows for data engineering automation.

Key responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering processes such as validation, troubleshooting, and execution.
• Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop reusable frameworks and components to support various business use cases and datasets.
• Implement robust data quality checks, monitoring, and production controls to ensure system reliability.

Requirements

• 5+ years of hands-on experience with Databricks and PySpark.
• Advanced SQL skills and deep understanding of modern data lakehouse architectures.
• Proven experience with GCP, specifically BigQuery, and ETL/ELT pipeline design.
• Strong analytical skills with a focus on performance optimization and production-grade solutions.
• Upper-intermediate proficiency in English.

What we offer

• Growth opportunities through mentorship, internal TechTalks, and a dedicated annual learning budget.
• A collaborative, people-first culture with zero micromanagement and global team exposure.
• Work on meaningful, modern projects using cutting-edge technologies.
• Access to local well-being programs and support tailored to your needs.