Note: The job is a remote job and is open to candidates in USA. Mindrift connects specialists with project-based AI opportunities for leading technology companies, focusing on testing, evaluating, and improving AI systems. The role involves creating competitive-programming problems, implementing correct and deliberately incorrect solutions, designing robust test cases and checkers, and validating coding-model evaluation quality.
Responsibilities
- Write original algorithmic problems — clear statement, sound constraints, an intended solution
- Write correct solutions in C++ and Python
- Write realistic wrong solutions (common mistakes) to test against
- Build and harden test cases: generators, edge cases, stress and "hacking" tests
- Write checkers/interactors (testlib) for problems with more than one valid answer
- Confirm the quality bar: correct solutions pass, wrong ones fail, within time limits
Skills
- *Please submit your CV in English and indicate your level of English proficiency.*
- * Strong competitive programming background, shown by a public profile — a Codeforces rating (see levels below), OR an IOI / ICPC / national-olympiad record
- * Fluent contest C++ (STL, complexity); comfortable writing Python
- * Can explain why a solution is wrong and build an input that breaks it
- * Strong written English (C1+)
- * *Associate* — 1700–2100 (Expert / Candidate Master): easier problems
- * *Expert* — 2200–2600 (Master / Grandmaster): harder problems
- * *Senior / Reviewer* — 2600+ (Int'l Grandmaster) or IOI/ICPC medalist: hardest problems + quality review
- * IOI / ICPC alumni and top competitive programmers especially encouraged to apply
- * Experience setting or testing problems for real contests (Codeforces rounds, ICPC, national olympiads, online judges)
- * Testlib experience (checkers, validators, generators)
- * Experience creating data for LLM code benchmarks or similar RL / evaluation datasets
Company Overview