Note: The job is a remote job and is open to candidates in USA. G2i Inc. is seeking a senior software engineering professional to evaluate the quality of interactions produced by modern AI coding agents such as OpenAI Codex, Claude Code, and Cursor. The role focuses on assessing engineering judgment, reasoning, explanations, and overall usefulness of AI-generated coding interactions while providing clear, opinionated feedback and helping define what high-quality agent behavior looks like.
Responsibilities
- Evaluate AI-generated coding interactions end-to-end
- Judge whether outputs are: Useful; Correct (at a high level); Aligned with how a strong engineer would think
- Assess the quality of explanations and reasoning, not just code
- Distinguish between different levels of response quality (e.g. what makes something a •2 vs 4•)
- Provide clear, opinionated feedback on: What worked; What didn’t; What felt “off” or misleading
- Help define what •great• looks like when interacting with tools like Cursor
Skills
- We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code
- Staff / Principal-level engineer (or equivalent experience)
- Strong background in one of the below: + TypeScript / JavaScript + Python
- Hands-on experience using: + OpenAI Codex + Claude Code + Cursor
- Deep familiarity with modern AI-assisted dev workflows
- Able to evaluate code without needing to fully execute or deeply review every line
- Comfortable giving direct, opinionated feedback
- High bar for what “good engineering” looks like
- You should be comfortable making subjective but rigorous judgments
- Experience with tools like Cursor or similar AI-first IDEs
- Prior exposure to prompt design or evaluation workflows
- Experience mentoring senior engineers or defining engineering standards
Benefits
- Remote work arrangement
Company Overview