Handshake AIRating & model evaluation
Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer
up to $200/hr
About this role, in Handshake AI's words
We are looking for highly experienced individuals with backgrounds in intelligence, defense, cyber operations, counterintelligence, counterterrorism, and related fields to join our AI research community.
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Handshake AI's words
Posted by Handshake AI, reproduced here so you can judge the role before clicking. Original posting ↗
Overview
We are looking for highly experienced individuals with backgrounds in intelligence, defense, cyber operations, counterintelligence, counterterrorism, and related fields to join our AI research community.
Your role will be to simulate and evaluate how malicious actors might leverage large language models (LLMs) to plan and enhance acts of violence, terrorism, targeted assassinations, special operations, or tactical-level attacks. Fellows will engage in red teaming exercises, evaluating and interpreting LLM-generated outputs from jailbreaking attempts, and determining whether those outputs constitute credible, material threats in real-world scenarios.
This is a high-impact position ideal for professionals who want to apply their government or military background to anticipate national security risks in the age of AI.
Details
Overview:
• The position is remote and asynchronous - work independently from wherever you are.
• Flexible hours and the ability to work remotely, with a commitment of approximately 10 to 20 hours per week.
• Learn new skills while contributing to the changing world of AI across various disciplines.
• Placement into a project will be dependent on project availability.
• Project work includes and is not limited to evaluating highly actionable guidance, including procedural instructions, readily executable tactics, and domain-specific knowledge that could impact national security.
Who Should Apply:
We are seeking seasoned professionals with firsthand operational, analytic, or planning experience in the national security, defense, or intelligence communities. Candidates should be comfortable reviewing sensitive or graphic content for security relevance and applying real-world judgment in ambiguous scenarios.
You likely have experience such as:
• Former analyst, operator, or planner within:
• U.S. Intelligence Community (CIA, NSA, DIA, NCTC, NGA, ODNI)
• Federal Law Enforcement (FBI, U.S. Marshals, DHS, HSI)
• Special Operations or Counterterrorism units (JSOC, SOCOM, CENTCOM, etc.)
• Cyber operations (offensive/defensive cyber, information warfare)
• Military or IC background in:
• Counterterrorism (CT), Counterintelligence (CI), asymmetric warfare, unconventional operations, threat finance
• Tactical or operational planning, targeting, wargaming, red teaming
Preferred Background and Education:
While experience is paramount, we also welcome candidates with advanced academic training from elite defense or public policy institutions.
Good Candidates Come From:
• Military Graduate Programs (SAMS, JAWS, NDU, etc.)
• Security-Focused Civilian Graduate Programs (MPP, MPA or MA Security Studies, etc.)
• Undergraduate education from service academies, particularly when paired with real-world operational assignments.
Why Join Us:
• Contribute to cutting-edge safety research with direct national security implications
• Help inform the next generation of AI threat detection and response frameworks
• Contribute to efforts that safeguard the broader public and enhance the safety of communities across the U.S.
• Collaborate with top-tier experts in AI, cybersecurity, and policy
• Flexible remote work with autonomy and intellectual challenge
• Generous hourly compensation for high-impact, mission-driven work
Apply Today to Be Considered for Upcoming Opportunities:
Submitting your application now ensures you’re added to our candidate pool for upcoming projects. You may be matched with a project shortly after applying, or it may take some time depending on availability. In either case, applying today puts you one step closer to future opportunities as they arise.
Qualifications
We are seeking seasoned professionals with firsthand operational, analytic, or planning experience in the national security, defense, or intelligence communities. Candidates should be comfortable reviewing sensitive or graphic content for security relevance and applying real-world judgment in ambiguous scenarios.
Working with Handshake AIPay, getting started and work, from Handshake AI's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid weekly through Stripe. Handshake says it usually sends payouts by Wednesday afternoon for the previous Monday to Sunday week, and a payment can often take 48 hours to process and appear. Some projects set their own schedule. Non-US tax residents face 30% US withholding unless they certify the work was done outside the US. ai-support.joinhandshake.com/articles/32263614087575, ai-support.joinhandshake.com/articles/33238954868759, ai-support.joinhandshake.com/articles/39964143294615
- Before your first paid task
- Its pages give different answers on who can join. Its AI page says you must be based in the US, its help center says people outside the US can join by invitation only, and some of its postings ask for Indian work authorization or a base in Canada. Identity verification, tax details and a payout method come before paid work, and a failed assessment usually cannot be retaken. joinhandshake.com/ai, ai-support.joinhandshake.com/articles/37145099086743, joinhandshake.com/ai/opportunities/physics-expert-india, joinhandshake.com/ai/opportunities/ai-evaluation-speciali..., ai-support.joinhandshake.com/articles/32244754462615, ai-support.joinhandshake.com/articles/36935929970711, ai-support.joinhandshake.com/articles/41129932721431
- How much work
- Applying does not guarantee a project, and there is no fixed timeline for an invitation. Projects can start, pause or end at short notice. ai-support.joinhandshake.com/articles/32244169079703, ai-support.joinhandshake.com/articles/33238954868759, ai-support.joinhandshake.com/articles/38150760132119
- Contract
- Contractor, under an agreement with Handshake AI Solutions, LLC that says you are not an employee. joinhandshake.com/legal/contractor-agreement
Read on the pages linked above on 24 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Handshake AI's posting. How we count.
Pay across the field: Rating & model evaluation
Across 173 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $25 to $60 an hour at the top of the range, and the median is $40. This role's top rate, $200, is in the top quarter. Of the 52 distinct rates we count, 52 are lower and 0 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 98 | $15 to $150 · median $50 |
| Rise Data Labs | 15 | $40 to $50 · median $45 |
| micro1 | 11 | $15 to $115 · median $45 |
| Alignerr | 9 | $120 |
| RWS TrainAI | 7 | $10 to $21 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 5 Sep 2026, and still on Handshake AI's list when we last read it on 25 Oct 2026.
- The listed pay has not changed since then.
- Posted by Handshake AI
- First seen by AIPayList
- Last seen live
- Listing ID
- intelligence-expert-(bachelor-s-master-s-and-phds)-ai-trainer-copy
Pay as the source states it: “Up to $200/hr”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.