emagine Polska is looking for an experienced Data Engineer to join their team in a fully remote capacity. You will be responsible for designing and maintaining robust data pipelines, ensuring high performance and data quality within a modern cloud-based environment.
Key responsibilities
- Design, build, and maintain Apache Airflow DAGs in Python to load data into S3 and Snowflake.
- Develop ingestion pipelines for data from various sources including APIs, databases, and files.
- Model and transform data using dbt to ensure efficient data structures.
- Optimize SQL queries and manage Snowflake performance and cost-effectiveness.
- Implement monitoring, alerting, and error handling to maintain pipeline reliability.
- Ensure data quality through rigorous testing and maintain comprehensive technical documentation.
Requirements
- Minimum 3 years of professional experience as a Data Engineer.
- Strong expertise in Apache Airflow, including TaskFlow API, XCom, and idempotent DAG design.
- Advanced proficiency in Python, with a focus on writing clean, testable code using pytest.
- Advanced SQL skills, including window functions, CTEs, and complex query optimization.
- Hands-on experience with Snowflake architecture, including warehouses, stages, and data loading.
- Proficiency in dbt, AWS S3 data lake organization, Git, and CI/CD practices.
- English language proficiency at a B2 level or higher.
What we offer
- Opportunity to work on complex data engineering projects in a fully remote environment.
- Collaboration with a professional team focused on modern data stack technologies.
- Exposure to advanced tools like Apache Iceberg, Delta Lake, and data observability platforms.