AlignerrRating & model evaluation
AI Data Quality Analyst
up to $120/hr
About this role, in Alignerr's words
AI is only as good as the feedback it receives — and that's where you come in. We're looking for sharp, detail-oriented people to review and evaluate AI-generated outputs across text, images, and structured data. Your assessments directly influence how AI models learn, improve, and respond to real-world users.
What you'll do
- Review AI-generated responses across a variety of content types — text, images, and structured data
- Evaluate outputs for factual accuracy, relevance, clarity, and consistency
- Rate content quality using clear rubrics and structured guidelines
Show all 6 itemsHide the other 3 in What you'll do
- Identify errors, hallucinations, and areas where AI responses fall short
- Write clear, actionable feedback that guides model improvement
- Work across diverse topics and content categories
Candidate background
Who You Are
- Detail-oriented with strong analytical and critical thinking skills
- Comfortable reading, evaluating, and critiquing written content
- Able to follow structured guidelines and apply them consistently
- Self-motivated and reliable — you can manage your own time and meet deadlines
- Clear and concise written communicator in English
- No AI, data, or technical background required — if you can spot when something's off, you're qualified
Nice to Have
Show all 3 itemsHide these 3 items in Nice to Have
- Experience in editing, research, quality assurance, or fact-checking
- Familiarity with rubric-based evaluation or content moderation
- Background in any subject-matter area (science, law, finance, culture, etc.)
Quoted from selected sections of Alignerr's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Alignerr's words
Posted by Alignerr, reproduced here so you can judge the role before clicking. Original posting ↗
AI Data Quality Analyst
About the Role
AI is only as good as the feedback it receives — and that's where you come in. We're looking for sharp, detail-oriented people to review and evaluate AI-generated outputs across text, images, and structured data. Your assessments directly influence how AI models learn, improve, and respond to real-world users.
This is a fully remote, flexible contract role open to candidates from all professional backgrounds. No prior AI experience needed — just a keen eye for quality and a commitment to accuracy.
- Organization: Alignerr - Type: Hourly Contract - Location: Remote - Commitment: 10–40 hours/week
What You'll Do
* Review AI-generated responses across a variety of content types — text, images, and structured data * Evaluate outputs for factual accuracy, relevance, clarity, and consistency * Rate content quality using clear rubrics and structured guidelines * Identify errors, hallucinations, and areas where AI responses fall short * Write clear, actionable feedback that guides model improvement * Work across diverse topics and content categories
Who You Are
* Detail-oriented with strong analytical and critical thinking skills * Comfortable reading, evaluating, and critiquing written content * Able to follow structured guidelines and apply them consistently * Self-motivated and reliable — you can manage your own time and meet deadlines * Clear and concise written communicator in English * No AI, data, or technical background required — if you can spot when something's off, you're qualified
Nice to Have
* Experience in editing, research, quality assurance, or fact-checking * Familiarity with rubric-based evaluation or content moderation * Background in any subject-matter area (science, law, finance, culture, etc.)
Why Join Us
* Meaningful impact: Your feedback directly improves AI systems used by millions of people * Work on the cutting edge: Contribute to AI research projects with leading labs and research teams * Full flexibility: Work when you want, as much as you want — 10 to 40 hours per week * Fully remote: No commute, no office — work from anywhere in the world * Autonomy: Manage your own schedule and work independently * Variety: Every project brings new topics, formats, and challenges * Growth potential: Strong performers are considered for ongoing and extended contracts
Working with AlignerrPay, getting started and work, from Alignerr's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Billed weekly, Monday to Sunday, with approved work paid by the following Friday, according to Labelbox's help center. Payment goes through Stripe Connect or PayPal depending on your location, with one provider per country. intercom.help/labelbox/en/articles/13600616-alignerr-paym..., alignerr.com/process
- Before your first paid task
- Sign up, apply, verify your identity, set up billing and onboard. Some jobs add a Zara AI interview or domain assessments. alignerr.com/process
- How much work
- Time to your first project depends on demand and your skills, and there is no minimum number of hours. alignerr.com/faqs
- Contract
- Independent contractor, under terms with ALIGNERR LLC. alignerr.com/faqs, alignerr.com/privacy
Read on the pages linked above on 24 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Alignerr's posting. How we count.
Pay across the field: Rating & model evaluation
Across 162 roles in this field with a stated hourly rate in US dollars, on 13 platforms, the middle half pays $30 to $65 an hour at the top of the range, and the median is $45. This role's top rate, $120, is in the top quarter. Of the 48 distinct rates we count, 42 are lower and 5 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 98 | $15 to $150 · median $50 |
| Rise Data Labs | 15 | $40 to $50 · median $45 |
| micro1 | 10 | $15 to $150 · median $45 |
| Alignerr (this platform) | 8 | $120 |
| Handshake AI | 7 | $15 to $200 · median $60 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 27 Aug 2026, and still on Alignerr's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by Alignerr
- First seen by AIPayList
- Last seen live
- Listing ID
- 012bd84c-5066-48d2-ad84-318e4ad52b09
Pay as the source states it: “$40-120/hr”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.