Judging LLM Prompt Authoring

Multilingual AI Response Evaluator And Prompt Writer

Evaluate AI responses, rewrite content so it sounds natural in your language, and create prompts that test model quality. Remote work for native French, Australian English, and Japanese specialists.

Australia · Canada Available in 5 countries Australia Canada France Japan United Arab Emirates Remote

About This Project

OneForma is looking for native language specialists to join Project Hermes, a remote AI improvement project focused on enhancing the quality of multilingual AI assistants.

As an AI Language Specialist, you will evaluate AI-generated responses, adapt content to sound natural and culturally appropriate for your language, write prompts, and improve AI outputs following detailed project guidelines. Your work will directly contribute to making AI assistants more accurate, helpful, and fluent for users around the world.

This is a remote project with a duration of approximately 2 months. A client-provided laptop will be supplied for project work.

Why This Work Matters

The purpose of this project is to improve the quality, accuracy, and naturalness of AI-generated content by using the expertise of native language specialists who can evaluate, adapt, and refine AI responses for their target audiences.

What You’ll Do

  • Evaluate AI-generated responses according to project guidelines.
  • Adapt content to ensure linguistic accuracy and cultural appropriateness.
  • Write prompts that help improve AI performance.
  • Edit and enhance AI-generated text for quality, fluency, and clarity.
  • Follow quality standards and complete assigned tasks within project timelines.

Requirements

  • Native speaker of one of the following languages:
    • French (France)
    • French (Canada)
    • English (Australia)
    • English (United Arab Emirates)
    • Japanese (Japan)
  • Must be based in: Brazil, Egypt, Germany, India, Italy, Mexico, Portugal, Turkey, United Arab Emirates (UAE), United Kingdom (UK), or the United States.
  • Excellent writing and editing skills in your native language.
  • Strong attention to detail and ability to follow written guidelines.
  • Comfortable working with AI-generated content.
  • Reliable internet connection.
  • Ability to work remotely using a client-provided laptop.

Similar Projects

Languages Judging

Audio Transcription Quality Reviewer

Review long-form audio transcriptions for accuracy, check speaker labels, timestamps and segmentation, and flag audio issues against project guidelines. Remote, hourly work for native speakers across 31 locales.

Australia · Brazil Available in 31 countries Australia Brazil Canada China Denmark Finland France Germany Hong Kong India Indonesia Israel Italy Japan Malaysia Mexico Netherlands Norway Poland Portugal Saudi Arabia South Korea Spain Sweden Taiwan Thailand Turkey United Arab Emirates United Kingdom United States Vietnam Flexible; weekly task releases
Fixed rate per hour Apply
Languages Transcription

Multilingual Podcast Transcription And Speech Annotator

Transcribe long-form podcast audio, label speakers, add timestamps, and review recording quality for multilingual speech models. Remote, hourly work across 36 language and location options.

Australia · Austria Available in 33 countries Australia Austria Brazil Canada Chile Denmark Finland France Germany Hong Kong India Indonesia Ireland Israel Italy Japan Malaysia Mexico Netherlands Poland Portugal Saudi Arabia South Korea Spain Sweden Switzerland Taiwan Thailand Turkey United Arab Emirates United Kingdom United States Vietnam Flexible; weekly task releases
Fixed rate per hour Apply
AI/ML Training Annotation

Multilingual AI Response And Rubric Evaluator

Evaluate multilingual AI reference responses and scoring rubrics, identify critical errors, and improve evaluation quality. Flexible remote work across seven selected language and location options.

Brazil · Indonesia Available in 7 countries Brazil Indonesia Malaysia Mexico Thailand United Kingdom Vietnam Flexible
Fixed rate per hour Apply

Equal Opportunity At OneForma

OneForma welcomes experts from every background. Eligibility and selection are based on the requirements of each project, without discrimination based on race, ethnicity, gender, religion, disability, age, sexual orientation, cultural background, or any other characteristic protected by applicable law.

Choose your language or location

Select the option that matches your language and location.