Software Mind is looking for a skilled Data Platform Engineer to join an international team supporting a global technology platform. You will play a key role in building and maintaining scalable data pipelines that process millions of records for clients worldwide, working in a dynamic, remote-first environment.
Key responsibilities
- Build and operate change-data-capture pipelines from PostgreSQL into Azure using Kafka Connect and Debezium.
- Deploy and scale connectors as stateful workloads on Kubernetes, managing configuration, networking, and resource tuning.
- Monitor and troubleshoot production pipelines, addressing connector failures, throughput issues, and recovery workflows.
- Automate platform processes using Python, including onboarding new data sources and pipeline orchestration.
- Integrate CDC streams with the broader Azure data stack, including Event Hubs, ADLS, and Databricks.
- Manage infrastructure as code to ensure reproducible environments and maintain data protection standards.
Requirements
- Solid commercial experience as a data or platform engineer with a focus on streaming or CDC pipelines.
- Practical knowledge of Kafka, including topics, partitions, consumer groups, and delivery semantics.
- Strong SQL and PostgreSQL skills, with a deep understanding of logical replication and replication slots.
- Proficiency in Python for automation, tooling, and building recovery scripts.
- Hands-on experience with Azure data services and working with Kubernetes to deploy and debug workloads.
- Understanding of CDC concepts such as initial snapshots, event ordering, and schema evolution.
What we offer
- Fully remote work environment with flexible employment options.
- Engagement in international projects with leading global clients.
- Access to internal and external training programs and language classes.
- Comprehensive private healthcare, insurance, and well-being initiatives.
- A non-corporate atmosphere that values openness, creativity, and professional growth.