Data Platform Engineer

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups. We are currently seeking a Data Platform Engineer to join our team and help develop scalable ETL/ELT pipelines while productionizing agentic workflows for data engineering automation.

Key responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering processes such as validation, troubleshooting, and workflow execution.
• Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
• Implement data quality checks, monitoring, validation, and production controls.
• Optimize PySpark and SQL workloads for performance, reliability, and scalability.

Requirements

• 5+ years of strong hands-on experience with Databricks and PySpark.
• Advanced SQL and data-processing skills.
• Hands-on experience with GCP, particularly BigQuery.
• Experience with Delta Lake and modern data lakehouse architectures.
• Strong understanding of ETL/ELT, data pipeline design, and production-grade data solutions.
• Upper-intermediate English level.

What we offer

• Growth without limits through mentorship, internal TechTalks, and a dedicated annual learning budget.
• Flexibility to work 100% remotely with hours that support focus and autonomy.
• Meaningful, modern projects building impactful products alongside global teams.
• A collaborative culture with zero micromanagement where contributions are recognized.