Note: The job is a remote job and is open to candidates in USA. Dice is a company seeking a Content Evaluator/Reviewer to assess the relevance of documents for user queries. The role involves rating the relevance of various documents and evaluating the quality of assistant answers based on user intent.
Responsibilities
- Responsibility includes reviewing the query and document pairs, including any context provided by the system (such as when the query was issued and who did it), researching the problem trying to understand the user intent by using the product (search, including formulating queries for elastic search index in KQL), and then rating the document or other required artifact (e.g. assistant answer) according to the provided relevance rubric
Skills
- Understanding of English
- Ability to formulate search or chatgpt-like queries
Company Overview