Invisible Technologies is seeking an Agentic Audio Specialist to join a project dedicated to benchmarking advanced agentic audio models. This role focuses on evaluating and optimizing model performance for real-world customer support use cases, ensuring that AI systems meet high standards of clarity, efficiency, and natural conversational flow.
Key responsibilities
- Create and execute role-play evaluation scenarios simulating realistic customer service interactions in travel, finance, and telecommunications.
- Contribute to the development of diverse datasets used to assess conversational audio agents.
- Evaluate model performance across standardized qualitative and quantitative metrics.
- Ensure evaluations reflect real customer expectations regarding tone, flow, and coherence.
Requirements
- Strong verbal communication skills in a simulated customer support context with full English proficiency.
- Access to a high-quality microphone for clean, reliable audio input during evaluations.
- Basic computer programming literacy, including an understanding of JSON structures and simple logic.
- Ability to work effectively with structured prompts, evaluation rubrics, and technical guidelines.
- Device capable of running audio recording software and handling large technical documentation.
What we offer
- Opportunity to contribute to cutting-edge AI development and benchmarking projects.
- Flexible freelance contract structure suitable for experienced professionals.
- Engagement in a fully remote environment with global collaboration.