Note: The job is a remote job and is open to candidates in USA. Surge AI partners with leading AI labs to build benchmarks and reinforcement learning environments for training and evaluating frontier models. The Senior Software Engineer will build agentic coding environments, design realistic software engineering tasks, evaluate model outputs, create tests and rubrics, and provide structured feedback to improve future models.
Responsibilities
- Build coding RL environments and benchmarks that test how agents perform on realistic software engineering tasks
- Design tasks based on real engineering work
- Review and red-team model output to surface meaningful failures
- Write the tests, rubrics, and success criteria that separate good work from slop
- Give structured feedback that improves future models
Skills
- Professional software engineering experience shipping real, scaled production systems
- Expertise in at least one common tech stack (TypeScript, Python, Ruby, PHP, Java, Rust, Go, or C++)
- Strong judgment about what "good code" and a "meaningful model failure" look like
- Comfort working independently, and giving direct, code-review-style feedback
- Availability for a meaningful commitment (most contributors work 20 to 40+ hours per week)
Benefits
- Fully remote, any time zone
- You choose when and where you work
- Paid first real task.
Company Overview
Company H1B Sponsorship