Note: The job is a remote job and is open to candidates in USA. CodeGeniusRecruit is seeking a Software Engineer to evaluate engineering knowledge work and model outputs. The role involves writing instruction specifications, creating solutions and challenging evaluation tasks, collaborating with researchers, and formalizing engineering judgment into teachable criteria.
Responsibilities
- Vet the quality of engineering knowledge work tasks and model outputs
- Write high-quality instruction specs and produce golden solutions to engineering problems
- Design challenging engineering tasks and evaluation sets
- Work with client researchers to maintain consistent standards
- Translate tacit engineering judgment into explicit, teachable criteria
Skills
- • Bachelor's degree or higher in computer science, software engineering, or a related discipline
- • Have strong relevant experience in building and shipping production software or engineered systems
- • Genuine specialization in at least one engineering area
- • Clear progression to a senior level with real ownership of systems and design decisions
- • Hands-on working use of large language models in professional work
Company Overview