Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking an LLM AI Quality Analyst specializing in personalization and Korean-language content. The role involves creating and evaluating conversational prompts, comparing AI responses, identifying quality issues, and providing clear feedback while following project guidelines.
Responsibilities
• Create and review conversational prompts based on personal context
• Assess responses for relevance, accuracy, naturalness, and appropriate use of context
• Compare responses side by side and determine which provides the better experience
• Identify unsupported assumptions, inaccurate information, awkward responses, and other quality issues
• Provide clear explanations and feedback to support consistent evaluations
• Follow project guidelines and maintain high-quality review standards
Skills
• Strong Korean reading and writing skills
• Strong analytical skills and attention to detail
• Ability to evaluate nuanced written responses objectively
• Good written English and the ability to explain decisions clearly
• Bachelor's degree or equivalent experience in Linguistics, Journalism, Computer Science, Policy, Law, Ethics, or a related field
• 1+ year of experience in content review, data annotation, quality evaluation, or a related analytical role is preferred
Benefits
• Flexible, up to 40 hours/week with a minimum 4-hour PST overlap
Company Overview
• Crossing Hurdles connects skilled professionals with opportunities across AI training platforms and high-growth companies. It was founded in 2019, and is headquartered in Gurugram, Haryana, IND, with a workforce of 51-200 employees. Its website is https://www.crossinghurdles.com.