Acaisoft is looking for a highly skilled Senior Data Engineer to join our team and work with a leading U.S. consumer insights provider. In this role, you will take full ownership of building and optimizing a Snowflake-based evaluation pipeline designed to assess the quality and value of large-scale financial datasets.
Key responsibilities
- Build and maintain a Snowflake-based evaluation pipeline to measure the accuracy of new datasets.
- Implement evaluation metrics such as correlation and mean absolute error to compare estimated revenue against reported results.
- Optimize Snowflake performance and compute costs through warehouse sizing, clustering, and query optimization.
- Develop automated processes for collecting, mapping, validating, and maintaining ground truth company revenue data.
- Implement data quality checks and monitoring to identify inconsistencies before they affect downstream reporting.
Requirements
- 6+ years of experience in Data Engineering, with Snowflake as a primary data platform.
- Proven hands-on experience optimizing Snowflake warehouses and storage for performance and cost efficiency.
- Experience building and optimizing pipelines processing very large datasets.
- Strong SQL and Python skills with the ability to own data pipelines end-to-end.
- Practical experience with data quality engineering, including validation, reconciliation, and monitoring.
What we offer
- A high-impact role within an ambitious and fast-growing software house.
- The opportunity to work on complex financial data analytics projects for a major U.S. client.
- Full ownership of technical decisions and pipeline development.
- A collaborative environment focused on delivering reliable, production-ready data solutions.