AI Evaluation Analyst

micro1 is seeking skilled AI Evaluation Analysts to contribute to a project focused on advancing the capabilities of frontier language models. In this fully remote role, you will leverage your domain expertise to create high-quality training data that directly influences how next-generation AI systems learn, reason, and interact with the world.

Key responsibilities

• Author detailed, task-based multi-turn conversations and rubrics that align with specific project requirements.
• Test and refine conversation drafts against large language models, iterating to ensure they meet quality and difficulty standards.
• Deliver comprehensive evaluation assets, including transcripts, target behaviors, and supporting evidence.
• Validate and calibrate outputs with team leads to ensure strict fidelity to evolving project specifications.
• Maintain high throughput and consistent output rates while working independently on assigned tasks.

Requirements

• Native-level written English with exceptional clarity, structure, and attention to detail.
• Strong critical thinking and analytical skills, particularly in writing-heavy or analysis-heavy domains.
• Demonstrated ability to interpret and apply highly detailed specifications without constant supervision.
• Prior experience in data annotation, prompt engineering, or technical writing is highly valued.
• A background in research, editorial work, or quality assurance is considered a significant plus.

What we offer

• The opportunity to operate at the forefront of AI development and shape future model behaviors.
• A fully remote work environment allowing for flexible, independent task completion.
• Engagement in a fast-paced project with immediate impact on frontier technology.