DataArt Poland is looking for a Senior Data Quality Engineer to join a project focused on migrating data and reporting to a modern platform built on Databricks and Microsoft Fabric. You will play a central role in ensuring data integrity and pipeline reliability for a major client in the financial services sector.
Key responsibilities
- Design and implement robust data testing and quality assurance frameworks.
- Build automated validation processes for data pipelines and data products.
- Manage source-to-target reconciliation between legacy systems and the new platform.
- Develop repeatable regression packs that run unattended to ensure system stability.
- Write unit tests integrated into CI/CD pipelines with quality gates to block releases.
- Validate reports, dashboards, and semantic models, including complex measure definitions.
Requirements
- 5+ years of experience in quality engineering with a focus on data or ETL processes.
- Strong proficiency in Python and SQL for building comprehensive test automation.
- Proven experience with pipeline validation, referential integrity, and business rule assertions.
- Experience with Azure DevOps and SQL Server environments.
- Strong English communication skills suitable for direct client interaction.
What we offer
- Opportunity to work on a high-impact platform modernization program.
- Access to mentoring and technical knowledge exchange within the company.
- Focus on product development within an agile, professional team environment.