Platform Engineer with AWS AgentCore Evaluation

DataArt is seeking a skilled Platform Engineer to join a dynamic team focused on building a scalable evaluation and monitoring platform for AI agents. You will play a key role in developing automated deployment gates, online quality assessment tools, and robust observability solutions to ensure the reliability and performance of intelligent applications.

Key responsibilities

• Design and implement semantic discovery capabilities using vector embeddings, OpenSearch, or pgvector.
• Develop and maintain Python-based APIs for secure credential retrieval and secrets access.
• Integrate and manage HashiCorp Vault and AWS Secrets Manager within platform services.
• Build and optimize semantic indexing pipelines and search experiences.
• Implement monitoring, logging, and operational best practices for platform services.

Requirements

• 3+ years of experience in platform engineering or backend engineering.
• Hands-on experience with secrets management solutions such as HashiCorp Vault or AWS Secrets Manager.
• Experience implementing vector search, semantic search, or embedding-based search solutions.
• Proficiency in developing Python APIs for credential retrieval and access management.
• Knowledge of MCP server capabilities and semantic domain taxonomy design.

What we offer

• Up to 26 business days of vacation per year plus 10 fully paid illness/special days.
• Comprehensive health and life insurance coverage.
• Access to the MyBenefit platform including Multisport options and internal psychological support.
• Extensive professional development opportunities, including certification reimbursement and access to learning platforms like O’Reilly and Udemy.
• English language classes and a dedicated Tech Skills Mentoring Program.