Senior Python Engineer - LLM Code Evaluation

G2i is seeking a highly experienced Senior Python Engineer to join a specialized project focused on evaluating the quality of interactions with modern AI coding agents. This is a unique opportunity to leverage your engineering expertise to assess how models like OpenAI Codex and Claude Code perform in real-world development scenarios, focusing on reasoning, judgment, and developer experience.

Key responsibilities

• Evaluate AI-generated coding interactions end-to-end to determine if they reflect strong engineering judgment.
• Assess the quality of explanations and reasoning provided by AI models, ensuring they are useful and aligned with professional standards.
• Provide clear, opinionated feedback on what works, what fails, and what feels misleading in AI-assisted workflows.
• Help define the benchmarks for what constitutes high-quality interaction when using tools like Cursor.

Requirements

• Staff or Principal-level engineering experience with a deep background in Python or TypeScript/JavaScript.
• Hands-on experience using AI-assisted development tools such as OpenAI Codex, Claude Code, or Cursor.
• Ability to make subjective but rigorous judgments on code quality and engineering communication without needing to execute every line.
• A high bar for engineering excellence and the ability to provide direct, constructive feedback.

What we offer

• A flexible, fully remote engagement of 10–20 hours per week.
• The opportunity to shape the future of AI-assisted development by defining evaluation standards.
• Collaboration with a forward-thinking team focused on the intersection of AI and software engineering.