micro1Rating & model evaluation
Gmail & Google Calendar AI Assistant Evaluator
up to $30/hr
About this role, in micro1's words
micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.
What you'll do
Key Responsibilities
- Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
- Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
- Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
Show all 7 itemsHide the other 4 in Key Responsibilities
- Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
- Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
- Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
- Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
Candidate background
What this role asks for
- Gmail
- Google Calendar
- AI Usage
- Scheduling
- Emails
- Google Meetings
Read from the posting's own words: show the exact sentences
- Gmail: “listed by the platform under required skills: Gmail”
- Google Calendar: “listed by the platform under required skills: Google Calendar”
- AI Usage: “listed by the platform under required skills: AI Usage”
- Scheduling: “listed by the platform under required skills: Scheduling”
- Emails: “listed by the platform under required skills: Emails”
- Google Meetings: “listed by the platform under required skills: Google Meetings”
Quoted from selected sections of micro1's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in micro1's words
Posted by micro1, reproduced here so you can judge the role before clicking. Original posting ↗
Role Title: Gmail & Google Calendar AI Assistant Evaluator
Role Type: Contractor, Remote
Location: United States only
micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.
Key Responsibilities:
• Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
• Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
• Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
• Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
• Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.
Required Skills and Qualifications:
• Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.
• Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.
• Regular experience coordinating with others over email or text — setting up meetups, following up on threads, or confirming shared plans and payments.
• Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.
• Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.
• Exceptional attention to detail and accuracy when reviewing AI-generated output.
• Strong written communication skills for clear reporting and timely updates on progress and challenges.
• Demonstrated time management and self-organization for independent, remote project participation.
Preferred Qualifications:
• Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
• Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.
• Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.
Working with micro1Pay, getting started and work, from micro1's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid in US dollars twice a month through Deel, usually landing around the 5th and the 20th. Nothing is paid until Deel's identity check is done. library.micro1.ai/working/faqs, library.micro1.ai/working/payroll-policy
- Before your first paid task
- An AI interview with micro1's recruiter Zara, then your profile, ID verification, a KarmaCheck background check and the Deel contract. Some pipelines add a quiz or test task. micro1.ai/experts, micro1.ai/ai-interview-guide, library.micro1.ai/getting-started/next-steps-after-certif..., library.micro1.ai/working/faqs, library.micro1.ai/working/what-to-expect
- How much work
- Certification makes you eligible but does not guarantee placement. micro1's FAQ puts the usual commitment at about 15 to 20 hours a week, depending on the client. micro1.ai/experts, library.micro1.ai/working/faqs
- Contract
- Independent contractor, with the contract issued through Deel. library.micro1.ai/policies/understanding-your-expert-agre..., library.micro1.ai/working/deel
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
Alex's experience on micro1A personal account, not a promise about your project
Alexruns this site and has worked on micro1 himself. Written 31 Aug 2026.
- Every interview I took used an AI interviewer, and some included a timed business exercise of around 25 minutes.
- On later applications, interview reuse on micro1 was often partial, and I still answered questions about one to three additional skills.
- I entered a requested rate for the job. One listing showed about $180 an hour. I requested about $160 and received the rate I entered. Those amounts are approximate, and this describes my application, not proof that a lower request caused acceptance.
- Onboarding and setup came to about 2 hours, with clear materials. Of the three platforms I worked on, it was the easiest transition into work. That is an estimate from my projects, not a platform average.
- On my micro1 project, Hubstaff showed time and mouse or keyboard activity, not screenshots, app names or website history. That describes what I saw, not every possible setup.
- I was paid for hours logged, once every 14 days, and I have not experienced late or incorrect payments. That was my arrangement.
One person's applications, not a promise about yours.
What happens after you apply, first-handHow does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from micro1's posting. How we count.
Pay across the field: Rating & model evaluation
Across 162 roles in this field with a stated hourly rate in US dollars, on 13 platforms, the middle half pays $30 to $65 an hour at the top of the range, and the median is $45. This role's top rate, $30, is in the middle half. Of the 47 distinct rates we count, 11 are lower and 32 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 98 | $15 to $150 · median $50 |
| Rise Data Labs | 15 | $40 to $50 · median $45 |
| micro1 (this platform) | 9 | $15 to $150 · median $45 |
| Alignerr | 9 | $120 |
| Handshake AI | 7 | $15 to $200 · median $60 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 26 Sep 2026, and still on micro1's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by micro1
- First seen by AIPayList
- Last seen live
- Listing ID
- 313b5b7a-a6a8-4acf-9842-017d8506a037
Pay as the source states it: “micro1 job record, ideal_hourly_rate: $15–$30/hr”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.