Senior Data Engineer (PySpark, NoSQL)

We are seeking a

with strong expertise in cloud-based NoSQL databases, Azure, and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on ensuring platform reliability, optimizing performance, and enabling scalable and efficient data operations within a production-grade environment.

Responsibilities

• Provide end-to-end support for NoSQL databases, including monitoring, troubleshooting, and performance tuning
• Design and optimize large-scale data pipelines using PySpark
• Work with distributed NoSQL technologies (e.g., Cosmos DB, Cassandra, DynamoDB, or other production-grade systems)
• Build and maintain scalable ETL/ELT workflows in Azure environments
• Troubleshoot and resolve production issues related to performance, latency, and availability
• Optimize Spark jobs (partitioning, execution plans, resource usage)
• Implement best practices for scalability, security, and data reliability
• Collaborate with cross-functional teams to support data-driven solutions
• Contribute to automation and operational improvements
• Maintain documentation and participate in production support rotations

Requirements

• 5+ years of experience as a Data Engineer or similar role
• Strong hands-on experience with PySpark in production (transformations, tuning, optimization)
• Solid experience with distributed NoSQL databases (e.g., Cosmos DB, Cassandra, DynamoDB, or similar)
• Strong understanding of Spark architecture and performance optimization
• Experience building scalable data pipelines in Azure
• Knowledge of NoSQL data modeling and cloud-based troubleshooting
• Strong analytical and problem-solving skills
• Ability to work effectively in high-availability environments
• Strong communication skills (English B2+)

Nice to have

• Experience with code generation, including non-AI and AI-assisted approaches
• Exposure to Data Science workflows
• Experience with Big Data platforms and distributed systems
• Knowledge of financial instruments and financial services data
• Hands-on experience with industry-standard LLMs (including GPT, Claude, or similar)

We offer/Benefits

• We gather like-minded people:
• Engineering community of industry professionals
• Friendly team and enjoyable working environment
• Flexible schedule and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities
• We provide growth opportunities:
• Outstanding career roadmap
• Leadership development, career advising, soft skills, and well-being programs
• Certification (GCP, Azure, AWS)
• Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
• English classes
• We cover it all:
• Stable income (Employment Contract or B2B)
• Participation in the Employee Stock Purchase Plan
• Benefits package (health insurance, multisport, shopping vouchers)
• Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
• Referral bonuses
• Corporate, social and well-being events

Please, note:

The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.

We will reach out to selected candidates exclusively.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.