[C3F] Data Platform Engineer

Software Mind is looking for a Data Platform Engineer to join an international project supporting a global technology platform. You will be responsible for building and operating change-data-capture pipelines, ensuring scalable data flow for a client that processes millions of screens annually across the globe.

Key responsibilities

• Build and operate change-data-capture pipelines from PostgreSQL into Azure using Kafka Connect and Debezium.
• Deploy and scale connectors as stateful workloads on Kubernetes (AKS), managing configuration, networking, and resource tuning.
• Monitor and troubleshoot production pipelines, addressing connector failures, throughput issues, and recovery workflows.
• Automate platform tasks using Python, including configuration-driven onboarding and monitoring.
• Integrate CDC streams with the Azure data stack, including Event Hubs, ADLS, and Databricks.

Requirements

• Solid commercial experience as a data or platform engineer with hands-on work on streaming or CDC pipelines.
• Practical Kafka knowledge, including topics, partitions, and Kafka Connect deployments.
• Strong SQL and PostgreSQL skills, with a deep understanding of logical replication and replication slots.
• Confident Python programming skills for automation, orchestration, and testing.
• Hands-on experience with Azure data services and working with Kubernetes for deploying and debugging workloads.

What we offer

• Fully remote work environment with flexible employment options.
• Engagement in international projects with leading global clients.
• Access to internal and external training programs and language classes.
• Comprehensive private healthcare, insurance, and well-being initiatives.
• A non-corporate atmosphere that values openness, passion, and creativity.