Handshake AIMultilingual & translation
Japanese AI Evaluation Specialist (Japan)
up to $30/hr
About this role, in Handshake AI's words
Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job — you'll use your Japanese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users. No prior AI training experience is required.
What you'll do
- Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
- Provide clear written feedback that helps AI better understand and personalize responses for individual users
- Complete tasks at your own pace with no set schedule or minimum hour requirement
Candidate background
Qualifications
- Ideal candidates meet all of the following:
- Location — Based in Japan and able to work remotely in an asynchronous, self-directed capacity
- Language — Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. Good working understanding of English (ideally B2 level) as the platform, instructions, and training materials will all be in English.
- Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
- Must have a Bachelor's degree or higher
- Strong written communication in Japanese, with good understanding of English
- Ability to work independently in a remote, asynchronous environment
Quoted from selected sections of Handshake AI's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Handshake AI's words
Posted by Handshake AI, reproduced here so you can judge the role before clicking. Original posting ↗
Opportunity Overview
Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job — you'll use your Japanese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users. No prior AI training experience is required.
This is an ongoing, project-based opportunity you can take on alongside your current role.
機会の概要
Handshakeでは、AIの回答をよりパーソナライズされたものにするため、日本在住の日本語話者を募集しています。これは従来の仕事とは異なります。日本語のスキルを活かして、AIが生成した回答を評価・ランク付けすることで、将来のモデルが個々のユーザーに合わせてより適切に回答できるよう貢献していただきます。AIに関する事前の経験は必要ありません。
本プロジェクトは継続的なプロジェクトベースの機会であり、現在のお仕事と並行して取り組むことができます。
What You'll Do
• Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
• Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
• Provide clear written feedback that helps AI better understand and personalize responses for individual users
• Complete tasks at your own pace with no set schedule or minimum hour requirement
業務内容
• Handshakeのアノテーションプラットフォーム上で、AIツールを実際に使った経験を活かしてタスクを行う
• AIが生成した回答を比較・評価し、率直な好みとその理由を共有する
• AIが個々のユーザーをより深く理解し、回答をパーソナライズできるよう、わかりやすい文章でフィードバックを提供する
• 決まったスケジュールや最低稼働時間はなく、ご自身のペースでタスクを進める
Qualifications
Ideal candidates meet all of the following:
• Location — Based in Japan and able to work remotely in an asynchronous, self-directed capacity
• Language — Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. Good working understanding of English (ideally B2 level) as the platform, instructions, and training materials will all be in English.
• Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
応募資格
以下のすべてを満たす方が理想的です。
• 所在地 :日本在住で、非同期かつ自主的なリモートワークが可能な方
• 言語 :日本語の読み書きと会話が流暢で、自分の考えを明確に説明できる高い文章力をお持ちの方。また、プラットフォーム、指示書、トレーニング資料はすべて英語であるため、英語の実務的な理解力(目安としてCEFR B2レベル)をお持ちの方
• 判断力 :2つのAI生成回答の違いがわずかであっても、自分なりの好みを持ち、その理由を説明できる方
Required for all applicants
• Must have a Bachelor's degree or higher
• Strong written communication in Japanese, with good understanding of English
• Ability to work independently in a remote, asynchronous environment
全応募者に必須の条件
• 学士号以上の学位をお持ちであること
• 日本語での優れた文章力と、英語の十分な理解力
• リモートかつ非同期の環境で自律的に業務を進められること
Working with Handshake AIPay, getting started and work, from Handshake AI's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid weekly through Stripe. Handshake says it usually sends payouts by Wednesday afternoon for the previous Monday to Sunday week, and a payment can often take 48 hours to process and appear. Some projects set their own schedule. Non-US tax residents face 30% US withholding unless they certify the work was done outside the US. ai-support.joinhandshake.com/articles/32263614087575, ai-support.joinhandshake.com/articles/33238954868759, ai-support.joinhandshake.com/articles/39964143294615
- Before your first paid task
- Its pages give different answers on who can join. Its AI page says you must be based in the US, its help center says people outside the US can join by invitation only, and some of its postings ask for Indian work authorization or a base in Canada. Identity verification, tax details and a payout method come before paid work, and a failed assessment usually cannot be retaken. joinhandshake.com/ai, ai-support.joinhandshake.com/articles/37145099086743, joinhandshake.com/ai/opportunities/physics-expert-india, joinhandshake.com/ai/opportunities/ai-evaluation-speciali..., ai-support.joinhandshake.com/articles/32244754462615, ai-support.joinhandshake.com/articles/36935929970711, ai-support.joinhandshake.com/articles/41129932721431
- How much work
- Applying does not guarantee a project, and there is no fixed timeline for an invitation. Projects can start, pause or end at short notice. ai-support.joinhandshake.com/articles/32244169079703, ai-support.joinhandshake.com/articles/33238954868759, ai-support.joinhandshake.com/articles/38150760132119
- Contract
- Contractor, under an agreement with Handshake AI Solutions, LLC that says you are not an employee. joinhandshake.com/legal/contractor-agreement
Read on the pages linked above on 24 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Multilingual & translation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Handshake AI's posting. How we count.
Pay across the field: Multilingual & translation
Across 803 roles in this field with a stated hourly rate in US dollars, on 20 platforms, the middle half pays $20 to $45 an hour at the top of the range, and the median is $30. This role's top rate, $30, is in the middle half. Of the 97 distinct rates we count, 45 are lower and 44 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 360 | $20 to $65 · median $65 |
| SME Careers | 73 | $15 to $60 · median $35 |
| Mercor | 66 | $22 to $100 · median $50 |
| Prolific | 50 | $18 to $30 · median $26 |
| RWS TrainAI | 47 | $10 to $36.45 · median $20 |
Other open roles in Japanese
34 roles with a stated hourly rate in US dollars also ask for Japanese, on 9 platforms. Their top rates run from $18 to $85 an hour, with a median of $40.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 10 | $65 |
| Alignerr | 9 | $35 to $40 |
| Prolific | 4 | $18 to $30 |
| Mercor | 3 | $40 to $85 |
| Rise Data Labs | 3 | $40 to $45 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 14 Oct 2026, and still on Handshake AI's list when we last read it on 21 Nov 2026.
- The listed pay has not changed since then.
- Posted by Handshake AI
- First seen by AIPayList
- Last seen live
- Listing ID
- 11652444
Pay as the source states it: “Up to $30/hr”.
This role has 2 listings with the same title and pay. This page shows one of them. The full country list is on the main listing.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More Japanese roles
Related field, different requirements. Check each role's own page before you apply.