SWE-Bench AI Task Auditor - Freelance AI Trainer Project

Invisible Technologies is seeking experienced software engineering specialists to join a freelance project focused on auditing tasks for AI training and evaluation. You will play a critical role in ensuring that AI workflows are technically rigorous, practical, and highly accurate by evaluating complex software engineering benchmarks.

Key responsibilities

• Evaluate software engineering tasks to ensure they are technically accurate, realistic, solvable, and reproducible.
• Verify that tasks are supported by reliable tests and robust evaluation criteria.
• Perform technical audits of codebases to identify integration issues, test failures, or logic errors.
• Provide clear, actionable feedback to improve the quality and reliability of AI training data.

Requirements

• Demonstrable professional experience in software engineering, including complex codebase navigation and real-world application development.
• Deep technical knowledge relevant to SWE-Bench standards and software development lifecycles.
• Strong analytical and problem-solving skills to rigorously troubleshoot and evaluate complex technical scenarios.
• Ability to work independently as a freelance contractor in a fully remote environment.

What we offer

• The opportunity to contribute to the development of cutting-edge AI systems through expert-level technical auditing.
• A flexible, fully remote freelance contract that allows you to leverage your software engineering expertise.
• Engagement in a high-impact project that shapes the future of AI training and evaluation workflows.