OneForma by Centific
Freelance

LLM Evaluation and Grading

Back to Jobs
JudgingLLM Evaluation and Grading
  • Worldwide
  • Ongoing
  • Fixed rate per hour
Judging

Description:

This project will consist of three different approaches called “workflows”:

  • Workflow 1: Participants will evaluatethe quality of automatically generated translations, assigning grades from 0 to 6 (according to provided instructions).
  • Workflow 2: Participants will annotate errors by selecting spans of words with their corresponding issue type and severity.
  • Workflow 3: Participants will evaluate and/or decide if the responses generated by a LLM (large language model) are accurate and appropriate.

Purpose: This project is aimed at improving LLM engines, providing more accurate answers to the queries generated by users.

Main requirements:

  • Being a native speaker of one of the locales included in the table
  • Being fluent in English
  • Passing the required certifications

Click your language below to get started!

·       Chinese (China)

·       French (France)

·       German (Germany)

·       Italian (Italy)

 ·         ·       Japanese (Japan)

·       Korean (Korea)

·       Portuguese (Brazil)

·       Spanish (Latin America)

 

Other important information:

  • Participants can be based anywhere in the world but NOT in the following countries: Argentina, Bolivia, Brazil, Chile, Colombia, Ecuador, Mexico, Panama , United Kingdom, Venezuela.

About OneForma

OneForma is part of Centific, a global digital and technology services company. We bring together data, intelligence and experiences to deliver human-centric solutions to complex business challenges.

OneForma and Centific are an equal opportunity employer and will not discriminate against any of our applicants on the grounds of race, gender, religion or cultural background.

Apply for this job

You might also be interested in these…

See more jobs
Join today