BraintrustRating & model evaluation
Quality Analyst - AI Training (US)
$23/hr
About this role, in Braintrust's words
We’re looking for detail-oriented Quality Analysts to evaluate and compare chatbot responses and help improve AI systems.
What you'll do
- Compare responses for accuracy, relevance, completeness, clarity and adherence to evaluation guidelines.
- Identify subtle errors, inconsistencies and missing information, and provide clear, structured feedback and final assessments.
- Apply review guidelines consistently, document findings and work with quality teams to resolve questions or escalate complex cases.
- Meet project quality, productivity and turnaround expectations.
Candidate background
What this role asks for
- 3+ yrs experience
- Quality Assurance
- Data Annotation
Read from the posting's own words: show the exact sentences
- 3+ yrs experience: “…productivity and turnaround expectations. What you’ll bring • 3+ years of experience in quality assurance, data annotation, content evaluation, testing or a similar role. •…”
- Quality Assurance: “listed by the platform under required skills: Quality Assurance”
- Data Annotation: “listed by the platform under required skills: Data Annotation”
Quoted from selected sections of Braintrust's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Braintrust's words
Posted by Braintrust, reproduced here so you can judge the role before clicking. Original posting ↗
We’re looking for detail-oriented Quality Analysts to evaluate and compare chatbot responses and help improve AI systems.
What you’ll do
• Compare responses for accuracy, relevance, completeness, clarity and adherence to evaluation guidelines.
• Identify subtle errors, inconsistencies and missing information, and provide clear, structured feedback and final assessments.
• Apply review guidelines consistently, document findings and work with quality teams to resolve questions or escalate complex cases.
• Meet project quality, productivity and turnaround expectations.
What you’ll bring
• 3+ years of experience in quality assurance, data annotation, content evaluation, testing or a similar role.
• Strong analytical, critical-thinking and problem-solving skills, with excellent written and verbal communication.
• Attention to detail and the ability to follow detailed evaluation guidelines, work independently and manage multiple tasks.
• Comfort working with AI tools, chatbots and online platforms.
• Experience with chatbot evaluation, LLM testing or data-quality projects is a plus.
Engagement Fully remote for contributors based in the United States. Expected project duration is 16 weeks, with an immediate start. You must be available for 8 hours per day, five days per week, including weekends as required, with two weekdays off and at least four hours of overlap with Pacific Time. Actual workload is project-dependent.
Working with BraintrustPay, getting started and work, from Braintrust's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Through a processor such as Stripe or Wise. On hourly contracts you invoice through Braintrust and payment starts within 30 days, or later if the client has not paid. Its AI training page says gig tasks are paid weekly. usebraintrust.com/site-service-fees-terms, usebraintrust.com/ai-training
- Before your first paid task
- A profile and a short AI interview, usually under an hour, then ID verification and skills validation. Certification takes 1 to 2 days, and matching starts after it. usebraintrust.com/for-talent
- How much work
- No guaranteed minimum or regular pay. Its terms say Braintrust does not introduce talent to clients or find projects for them. usebraintrust.com/talent-terms, usebraintrust.com/terms
- Contract
- Independent contractor. Each project is a contract directly between you and the client, under terms with Freelance Labs, Inc. usebraintrust.com/talent-terms, usebraintrust.com/terms
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Braintrust's posting. How we count.
Pay across the field: Rating & model evaluation
Across 173 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $28 to $65 an hour at the top of the range, and the median is $45. This role's top rate, $23, is in the bottom quarter. Of the 52 distinct rates we count, 10 are lower and 42 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 98 | $15 to $150 · median $50 |
| Rise Data Labs | 15 | $40 to $50 · median $45 |
| micro1 | 11 | $15 to $115 · median $45 |
| Alignerr | 9 | $120 |
| Handshake AI | 7 | $15 to $200 · median $60 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 23 Oct 2026, and still on Braintrust's list when we last read it on 25 Oct 2026.
- The listed pay has not changed since then.
- Posted by Braintrust
- First seen by AIPayList
- Last seen live
- Listing ID
- 18056
Pay as the source states it: “USD 23 hourly”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.