Senior Data Engineer

Sigma Software is seeking a Senior Data Engineer to join our team and lead high-impact, greenfield initiatives focused on building cutting-edge, AI-ready data platforms. You will play a pivotal role in designing modern cloud-native infrastructure, migrating legacy systems, and establishing the architectural foundation for advanced data solutions.

Key responsibilities

• Design and build scalable, cloud-native data platforms from greenfield to production.
• Implement near-real-time ingestion pipelines using event-driven patterns.
• Define and enforce platform standards, including Data Lake/Lakehouse principles and data contracts.
• Refactor and optimize existing Spark and PySpark scripts for performance and maintainability.
• Drive the adoption of AI tooling and agentic workflows within the data engineering team.

Requirements

• 5+ years of professional experience in Data Engineering.
• Strong Python and SQL development skills for pipeline development and optimization.
• Proficiency in Apache Spark/PySpark, including query optimization and performance tuning.
• Hands-on experience with Databricks or Snowflake and at least one major cloud provider.
• Solid understanding of ETL/ELT patterns, data modeling, and production-grade system requirements.

What we offer

• Opportunity to work on innovative, greenfield data projects in a fast-paced environment.
• Collaboration with cross-functional teams including Machine Learning and Data Science.
• Exposure to emerging technologies such as RAG pipeline design and LLM integration.
• A culture that values proactive problem-solving and technical thought leadership.