Note: The job is a remote job and is open to candidates in USA. RustLabs is hiring senior software engineers for contract work with frontier AI research teams. The role focuses on evaluating AI-generated code, developing quality rubrics, identifying bugs, and building scalable evaluation pipelines.
Responsibilities
- Designing and refining rubrics for AI-generated code
- Reviewing model outputs with a high bar for quality
- Catching subtle bugs others miss
- Turning that judgment into clear write-ups and scalable evaluation pipelines
Skills
- 5+ years of professional software engineering in Python (ideally building pipelines/infrastructure) or TypeScript / Go / JavaScript
- Hands-on experience with preference data, rubric creation, or AI/LLM evaluation
- Strong written communication: you can explain why something is good, not just that it is
- An up-to-date LinkedIn profile
- Experience at top-tier tech companies and/or a degree from a top university
- Experience working in large codebases (e.g. VS Code-scale projects)
Benefits
- Remote contract work (must live in the US or Canada; 4 hours/day overlap with US Pacific time)
Company Overview