DevOps with Agentic Systems knowledge (LLM Agents, Tool Calling)

ACAISOFT POLAND is seeking a skilled DevOps Engineer to join a project focused on AI evaluation and optimization. You will work with a leading provider of solutions for large language models, contributing to the development of advanced reinforcement learning environments and scalable evaluation systems that shape the future of AI.

Key responsibilities

• Build and maintain production agentic systems, including agent loop architecture, tool calling integrations, and state management.
• Develop infrastructure for task generation, synthetic data creation, and verifiable reward design.
• Create and maintain CI/CD processes while driving Infrastructure as Code practices using Terraform.
• Produce high-quality, production-level Python code that integrates seamlessly into client systems.
• Collaborate with customers on environment integrations to ensure smooth project delivery.

Requirements

• At least 5 years of experience in a DevOps role with a strong focus on infrastructure and reliability engineering.
• Proven experience in building and maintaining production-ready agentic systems, including tool calling and evaluation harnesses.
• Strong hands-on experience writing clean, scalable Python code.
• Proficiency with AWS, Kubernetes, and Terraform.
• Knowledge of relational, vector, and columnar databases.
• Availability to work during the 2:00 p.m. to 10:00 p.m. CEST time window.

What we offer

• Opportunity to work with modern technologies on innovative AI projects.
• Private medical care and Multisport card benefits.
• A friendly, informal atmosphere with direct communication across the company.
• Support for professional growth through challenging, high-impact technical tasks.