OneForma by Centific
Remote

Cherry Opal - Grader-Evaluator

Annotation
LLM
Evaluation

Description:

You’ll act as a language leader, meticulously analyzing each request to identify its core intent. Your mission is then to evaluate the perfect response – a response that not only satisfies the user’s needs but also leaves them feeling understood and empowered. This role is instrumental in training our AI model to deliver exceptional service to users.  

We need to analyze user requests to understand their intent and identify the information needed for the best possible response. Evaluate the clarity and completeness of user requests. Assess the quality of AI-generated responses based on various criteria, including accuracy, conciseness, and user satisfaction. Compare and rank multiple response options, selecting the one that best addresses the user’s needs. Quality is important. 

Purpose: 

This role is instrumental in training our AI model to deliver exceptional service to users.  

Main Requirements: 

  • Language Proficiency: Native speaker of any of the languages on the list and a fluent in English.  Should be based in country  
  • Annotation Skills: Expertise in data annotation/evaluation to accurately identify topics and task types.   
  • Analytical and Creative Skills: We value detail-oriented, creative thinkers with an out of the box approach and the ability to empathize with user requirements. 

About OneForma

OneForma is a global digital and technology services company. We bring together data, intelligence and experiences to deliver human-centric solutions to complex business challenges.

OneForma is an equal opportunity employer and will not discriminate against any of our applicants on the grounds of race, gender, religion or cultural background.

You might also be interested in these…