Invisible Technologies is seeking an Audio Specialist to join a project dedicated to assessing and benchmarking advanced agentic audio models. This role focuses on evaluating and optimizing model performance for real-world customer support use cases, ensuring high standards of quality and natural interaction.
Key responsibilities
- Create and execute role-play-based evaluation scenarios simulating realistic customer service interactions in travel, finance, and telecommunications.
- Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
- Evaluate model performance across a standardized set of qualitative and quantitative metrics.
- Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Requirements
- Strong verbal communication skills in a simulated customer support context.
- Full English proficiency across reading, listening, writing, and speaking.
- Access to a high-quality microphone to ensure clean, reliable audio input during evaluations.
- Basic computer programming literacy, including understanding of JSON structures and simple logic.
- Comfort working with structured prompts, evaluation rubrics, and technical guidelines.
What we offer
- Opportunity to work on cutting-edge AI model benchmarking projects.
- Flexible freelance engagement as an independent contractor.
- Exposure to advanced agentic audio technology and real-world AI training methodologies.