Svitla Systems is seeking a skilled Data Engineer to join a large-scale data platform modernization project for a global industry leader. You will work within a dedicated data engineering function to execute critical migrations and support the transition to a modern, high-performance data architecture.
Key responsibilities
- Execute the migration of approximately 1,000 datasets to Snowflake with Apache Airflow 3 orchestration.
- Migrate existing data pipelines from Apache Airflow 2 to Airflow 3 and transition pipelines from Hive to Iceberg.
- Manage Confluent connection migrations to new regions.
- Adapt and optimize data pipelines for Snowflake while maintaining high standards of data quality and reliability.
- Support ongoing workflow scheduling and monitoring within the Apache Airflow environment.
Requirements
- Minimum of 3 years of professional experience working with large-scale datasets, specifically using Airflow and Spark.
- Strong software engineering fundamentals with hands-on Python development expertise.
- Advanced SQL skills, including complex joins, window functions, and performance tuning.
- Proven experience with Snowflake data modeling and AWS S3 data lake management.
- Solid understanding of Apache Kafka, PySpark, and modern data formats like Iceberg and Parquet.
What we offer
- Engagement in challenging US and EU projects utilizing advanced technologies.
- Regular performance appraisals to support your professional growth and career progression.
- Generous time-off policy, including vacation, national holidays, and sick leave.
- Access to personalized learning programs, tech webinars, and community meetups.
- A supportive, friendly team environment with regular online corporate activities.