Sepal AIRating & model evaluation
Generalist Reviewer – Research & AI Training Quality
$80/hr
About this role, in Sepal AI's words
The Generalist Reviewer is responsible for evaluating task submissions used in research and large language model (LLM) training. This role focuses on quality assurance, guideline fidelity, and structured feedback, ensuring that submitted work meets defined standards for accuracy, clarity, safety, and compliance. Generalist Reviewers apply consistent judgment across a wide range of task types and domains, relying on documented rubrics rather than personal preference. This role is ideal for professionals with experience in quality review, auditing, evaluation, compliance, instructional assessment, or editorial QA.
Candidate background
What this role asks for
- 3+ yrs experience
Read from the posting's own words: show the exact sentences
- 3+ yrs experience: “…- Bachelor’s degree or equivalent professional experience - 3+ years of experience in one or more of the following: -- Quality assurance or quality control -- Content…”
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Sepal AI's words
Posted by Sepal AI, reproduced here so you can judge the role before clicking. Original posting ↗
Role Overview The Generalist Reviewer is responsible for evaluating task submissions used in research and large language model (LLM) training. This role focuses on quality assurance, guideline fidelity, and structured feedback, ensuring that submitted work meets defined standards for accuracy, clarity, safety, and compliance. Generalist Reviewers apply consistent judgment across a wide range of task types and domains, relying on documented rubrics rather than personal preference. This role is ideal for professionals with experience in quality review, auditing, evaluation, compliance, instructional assessment, or editorial QA.
Key Responsibilities - Review task submissions against detailed written guidelines, rubrics, and policy requirements - Assess work for: -- Accuracy and completeness -- Adherence to task instructions -- Compliance with safety, privacy, and content standards -- Internal consistency and logical reasoning - Identify errors, omissions, and guideline deviations with precision - Provide clear, actionable, and professional written feedback to contributors - Apply evaluation standards consistently across high volumes of work - Flag potential compliance, safety, or integrity issues promptly - Document review decisions in required systems with appropriate rationale - Maintain confidentiality and data handling standards at all times
Required Qualifications - Bachelor’s degree or equivalent professional experience - 3+ years of experience in one or more of the following: -- Quality assurance or quality control -- Content review or editorial evaluation -- Compliance, audit, or policy enforcement -- Instructional design review or assessment scoring - Demonstrated ability to follow complex written guidelines precisely - Strong written communication skills with a professional, neutral tone - High attention to detail and consistency - Ability to make objective decisions under ambiguity
Preferred Qualifications - Experience reviewing work for research, training data, or evaluation programs - Familiarity with rubric-based scoring or structured evaluation frameworks - Background in trust & safety, content moderation, or regulated industries - Experience working with confidential or sensitive information
Key Competencies - Judgment and consistency - Written feedback quality - Compliance awareness - Time management and reliability - Professional discretion
Expectations - Strict adherence to confidentiality and data protection requirements - Consistent application of guidelines across all reviews - Willingness to update evaluation approach as standards evolve - Professional, unbiased, and respectful communication at all times
Logistics - Pay range: $80/hour - Employment type: Contract, flexible hours (part-time and full-time options). - Location requirements: Remote (U.S. and Canada only)
How does the pay compare?Across Rating & model evaluation roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Sepal AI's posting. How we count.
Pay across the field: Rating & model evaluation
Across 156 roles in this field with a stated hourly rate in US dollars, on 19 platforms, the middle half pays $30 to $75 an hour at the top of the range, and the median is $45. This role's top rate, $80, is in the top quarter. Of the 69 distinct rates we count, 52 are lower and 17 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Meridial (Invisible) | 44 | $15 to $65 · median $30 |
| micro1 | 28 | $15 to $140 · median $45 |
| Prolific | 18 | $20 to $216 · median $40 |
| Alignerr | 11 | $120 |
| Innodata | 11 | $15 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 15 Nov 2026, and still on Sepal AI's list when we last read it on 21 Nov 2026.
- The listed pay has not changed since then.
- Posted by Sepal AI
- Not stated
- First seen by AIPayList
- Last seen live
- Listing ID
- 0d019ada-e260-49ae-a458-e1471554f038
Pay as the source states it: “Pay range: $80/hour”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.