BraintrustRating & model evaluation
AI Personalization Evaluator - Canada
$13/hr
About this role, in Braintrust's words
Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in Canada, outside Quebec, who can review AI responses carefully and explain what works and what does not.
What you'll do
- Evaluate AI-generated answers for relevance, accuracy and appropriate use of context.
- Compare responses, identify unsupported assumptions or missed information, and provide clear written feedback.
- Follow project guidelines for consistent, confidential evaluation work.
Candidate background
What this role asks for
- Data Analysis
Read from the posting's own words: show the exact sentences
- Data Analysis: “listed by the platform under required skills: Data Analysis”
Quoted from selected sections of Braintrust's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Braintrust's words
Posted by Braintrust, reproduced here so you can judge the role before clicking. Original posting ↗
Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in Canada, outside Quebec, who can review AI responses carefully and explain what works and what does not.
What you’ll do
• Evaluate AI-generated answers for relevance, accuracy and appropriate use of context.
• Compare responses, identify unsupported assumptions or missed information, and provide clear written feedback.
• Follow project guidelines for consistent, confidential evaluation work.
Important account-access requirement
• This project requires you to connect eligible Google apps to Gemini and grant the permissions needed for personalized evaluations. These may include Gmail, Google Drive, Google Calendar and Google Photos. The evaluation may use information from your connected account history. Please consider the access and consent requirements before applying. Shortlisted candidates will receive the project’s consent and onboarding details before participation.
What we’re looking for
• Currently resident in Canada.
• Bachelor’s degree or equivalent practical experience in any field.
• Active use of Google apps with enough account history to support personalized evaluation tasks.
• Strong analytical judgment, attention to detail and written communication.
• Desktop or laptop computer and reliable internet access.
• AI evaluation, annotation, content review or quality assurance experience is helpful but not required.
Engagement and pay
• Remote contractor assignment for up to 16 weeks.
• Plan for 20 hours per week, with potential for up to 40 hours depending on project needs, and four hours of daily overlap with Pacific Time.
• $13.00 per hour.
• Shortlisted applicants may be invited to complete an interest form.
Working with BraintrustPay, getting started and work, from Braintrust's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Through a processor such as Stripe or Wise. On hourly contracts you invoice through Braintrust and payment starts within 30 days, or later if the client has not paid. Its AI training page says gig tasks are paid weekly. usebraintrust.com/site-service-fees-terms, usebraintrust.com/ai-training
- Before your first paid task
- A profile and a short AI interview, usually under an hour, then ID verification and skills validation. Certification takes 1 to 2 days, and matching starts after it. usebraintrust.com/for-talent
- How much work
- No guaranteed minimum or regular pay. Its terms say Braintrust does not introduce talent to clients or find projects for them. usebraintrust.com/talent-terms, usebraintrust.com/terms
- Contract
- Independent contractor. Each project is a contract directly between you and the client, under terms with Freelance Labs, Inc. usebraintrust.com/talent-terms, usebraintrust.com/terms
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Braintrust's posting. How we count.
Pay across the field: Rating & model evaluation
Across 161 roles in this field with a stated hourly rate in US dollars, on 13 platforms, the middle half pays $30 to $65 an hour at the top of the range, and the median is $45. This role's top rate, $13, is in the bottom quarter. Of the 47 distinct rates we count, 0 are lower and 46 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 98 | $15 to $150 · median $50 |
| Rise Data Labs | 15 | $40 to $50 · median $45 |
| micro1 | 10 | $15 to $150 · median $45 |
| Alignerr | 9 | $120 |
| Handshake AI | 6 | $15 to $200 · median $60 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 24 Sep 2026, and still on Braintrust's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by Braintrust
- First seen by AIPayList
- Last seen live
- Listing ID
- 17896
Pay as the source states it: “USD 13 hourly”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.