Annotation Judging

Online Data Labeling And Search Evaluation Tasks

Complete short online tasks such as search evaluation, image labeling, and content review through UHRS. Open to applicants in eligible countries with a verified phone number and Microsoft account.

Germany · Japan Available in 3 countries Germany Japan United States

About This Project

OneForma is recruiting participants for the UHRS Crowd Labeling Tasks project. In this initiative, you complete small data annotation and evaluation tasks designed to support the development of artificial intelligence technologies. Participants work directly on the platform of a global AI developer and gain access to a variety of micro-tasks, including search relevance evaluation, image labeling, speech and text analysis, and product testing.

Why This Work Matters

The purpose of this project is to help expand and improve AI technologies by collecting and annotating high-quality training data through a global community of experts.

Requirements

  • Must currently reside in one of the eligible countries
  • Verified phone number
  • Microsoft account
  • Payoneer payment method
  • Ability to pass certification tests (Grammar, Reading, Listening)
  • Laptop or desktop computer with internet access

Similar Projects

AI/ML Training Annotation

E-Commerce Search Relevance Annotator

Review search queries and e-commerce products and judge how well they match. Remote annotation project, available in French, Spanish and Swedish.

Belgium · Canada Available in 8 countries Belgium Canada Colombia Mexico Morocco Sweden Tunisia United States Flexible freelance contract, with a minimum commitment of 3 hours of production work per day.
Languages Judging

Audio Transcription Quality Reviewer

Review long-form audio transcriptions for accuracy, check speaker labels, timestamps and segmentation, and flag audio issues against project guidelines. Remote, hourly work for native speakers across 31 locales.

Australia · Brazil Available in 31 countries Australia Brazil Canada China Denmark Finland France Germany Hong Kong India Indonesia Israel Italy Japan Malaysia Mexico Netherlands Norway Poland Portugal Saudi Arabia South Korea Spain Sweden Taiwan Thailand Turkey United Arab Emirates United Kingdom United States Vietnam Flexible; weekly task releases
Fixed rate per hour Apply
Annotation

Multilingual Search Relevance Contributor

Evaluate how well retrieved content matches a user's search intent and assign relevance scores against project guidelines. Remote annotation work supporting multilingual search across several European languages.

Remote

Equal Opportunity At OneForma

OneForma welcomes experts from every background. Eligibility and selection are based on the requirements of each project, without discrimination based on race, ethnicity, gender, religion, disability, age, sexual orientation, cultural background, or any other characteristic protected by applicable law.

Choose your language or location

Select the option that matches your language and location.