Note: The job is a remote job and is open to candidates in USA. Mindrift, powered by Toloka, connects domain experts with AI initiatives that shape how next-generation generative models learn and reason. The company is seeking former top-tier strategy consultants to create realistic consulting project environments, design structured tasks for AI agents, and develop evaluation frameworks for AI-generated outputs.
Responsibilities
- Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information
- Design structured consulting tasks for AI agents — break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more
- Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale
Skills
- Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:
- * Structuring ambiguous client problems into workable analytical plans
- * Building financial models, market analyses, or synthesized findings from messy inputs
- * Producing client-ready deliverables under time pressure
- * Forming and defending recommendations under uncertainty
- * 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
- * Strong structured problem-solving and hypothesis-driven thinking
- * Ability to translate vague problems into clear analytical steps and deliverables
- * High attention to logical consistency and output quality
- * Independent, self-directed working style
- * Clear written English (B2+)
Benefits
- Remote work arrangement
Company Overview