Note: The job is a remote job and is open to candidates in USA. The hiring company is not identified; Career Launch Recruitment Solutions states that it is an independent third-party agency, not the hiring company. The project-based contractor role involves designing realistic, multi-step finance and accounting benchmark tasks with objective grading criteria and supporting materials for evaluating AI systems.
Responsibilities
- Design multi-step tasks drawn from real finance and accounting work — FP&A analysis, financial reporting, audit procedures, reconciliations — with realistic reference files and clear instructions
- Define objective grading criteria so two qualified reviewers would reach the same verdict on the same output
- Build tasks that require judgment rather than lookup: ones where the right answer depends on reading the materials correctly
- Create or source the supporting materials each task needs: spreadsheets, GL extracts, financial statements, policy documents
- Flag tasks that turn out to be ambiguous or ungradable instead of submitting them anyway
- Deliver approved tasks on schedule and at the required quality level
Skills
- Strong English required (B2 advanced or C1 minimum)
- 5+ years of hands-on responsibility in FP&A, financial reporting, audit, reconciliations, or accounting — direct ownership of the work, not supervisory-only or adjacent exposure
- Experience creating or applying structured review standards: audit programs, review checklists, close checklists, grading rubrics, or training assessments
- Strong Excel capability and comfort reasoning across multiple documents at once
- CPA, CA, ACCA, CMA or equivalent
- Strong written English
- AI or LLM evaluation experience
Benefits
- Fully remote — no geographic restrictions.
Company Overview