Cherry Opal – Grader-Evaluator

Description

You’ll act as a language leader, meticulously analyzing each request to identify its core intent. Your mission is then to evaluate the perfect response – a response that not only satisfies the user’s needs but also leaves them feeling understood and empowered. This role is instrumental in training our AI model to deliver exceptional service to users.  

We need to analyze user requests to understand their intent and identify the information needed for the best possible response. Evaluate the clarity and completeness of user requests. Assess the quality of AI-generated responses based on various criteria, including accuracy, conciseness, and user satisfaction. Compare and rank multiple response options, selecting the one that best addresses the user’s needs. Quality is important. 

Purpose

This role is instrumental in training our AI model to deliver exceptional service to users.  

Main Requirements

• Language Proficiency: Native speaker of any of the languages on the list and a fluent in English.  Should be based in country  
• Annotation Skills: Expertise in data annotation/evaluation to accurately identify topics and task types.   
• Analytical and Creative Skills: We value detail-oriented, creative thinkers with an out of the box approach and the ability to empathize with user requirements.