SME CareersDomain experts
Finance & Accounting Specialist – Rubric Design
up to $100/hr
About this role, in SME Careers' words
In this hourly, remote contractor role, you will work as a Finance & Accounting Subject Matter Expert (SME) to create realistic professional tasks, evaluate AI-generated financial work, and design detailed rubrics defining what a high-quality professional response should contain.
What you'll do
Responsibilities
- Create professional finance tasks: Develop challenging financial, accounting, valuation, investment, audit, or analytical problems.
- Design scoring rubrics: Define the calculations, assumptions, reasoning, and professional considerations expected in strong responses.
- Evaluate financial outputs: Review AI-generated analyses for accuracy, methodology, logic, and completeness.
Show all 9 itemsHide the other 6 in Responsibilities
- Assess professional judgment: Determine whether assumptions and conclusions are reasonable and sufficiently supported.
- Identify material errors: Detect incorrect calculations, accounting treatment, valuation logic, financial interpretation, or risk analysis.
- Critique peer rubrics: Review criteria for ambiguity, missing components, duplication, excessive subjectivity, or technical errors.
- Develop reference content: Produce high-quality analyses, solutions, critiques, and explanations.
- Support AI training: Generate tasks, rubrics, evaluations, preferences, and reference-answer pairs suitable for RL and SFT.
- Maintain professional standards: Ensure outputs reflect appropriate finance and accounting conventions and terminology.
Candidate background
Requirements, 5 of 12 shown
- Bachelor’s degree or higher in Finance, Accounting, Economics, Business, Applied Mathematics, or a related discipline.
- Relevant professional certifications such as CPA, CFA, ACCA, ACA, CMA, FRM, or equivalent are strongly preferred where applicable.
- Strong professional proficiency in English, minimum C1.
- 3+ years of professional experience in finance, accounting, investment analysis, corporate finance, financial reporting, audit, consulting, risk, or a related field.
- Strong knowledge of professional methodologies, calculations, assumptions, and analytical standards relevant to your specialty.
The other 7 may also decide whether you qualify.
Show all 12 itemsHide the other 7 in Requirements
- Ability to create realistic professional finance or accounting tasks that require judgment rather than simple factual recall.
- Strong ability to design detailed rubrics covering accuracy, methodology, assumptions, completeness, materiality, reasoning quality, and professional presentation.
- Ability to distinguish between calculation errors, methodological errors, unsupported assumptions, and reasonable professional differences.
- Comfortable critiquing rubrics created by other finance or accounting experts.
- High attention to detail when reviewing numerical accuracy, financial logic, terminology, assumptions, reconciliations, and conclusions.
- Experience with training, examination writing, audit review, investment committee review, financial QA, research review, or professional assessment is strongly preferred.
- Prior experience with AI evaluation, model benchmarking, annotation, RLHF, or rubric-based scoring is preferred.
Quoted from selected sections of SME Careers' posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in SME Careers' words
Posted by SME Careers, reproduced here so you can judge the role before clicking. Original posting ↗
In this hourly, remote contractor role, you will work as a Finance & Accounting Subject Matter Expert (SME) to create realistic professional tasks, evaluate AI-generated financial work, and design detailed rubrics defining what a high-quality professional response should contain.
You will develop challenging questions and work products involving areas such as financial analysis, accounting, corporate finance, investment analysis, valuation, financial modeling, reporting, audit, risk, or related disciplines. You will assess whether AI outputs use appropriate assumptions, methodologies, calculations, professional judgment, and supporting reasoning.
A major focus of this role is rubric design and evaluation writing. You will translate professional finance and accounting judgment into structured criteria covering accuracy, methodology, completeness, materiality, assumptions, calculations, risk considerations, and quality of reasoning. You may also critique and improve rubrics developed by other experts.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your expertise directly helps improve the world’s premier AI models by making financial outputs more accurate, rigorous, and professionally useful.
Responsibilities
• Create professional finance tasks: Develop challenging financial, accounting, valuation, investment, audit, or analytical problems.
• Design scoring rubrics: Define the calculations, assumptions, reasoning, and professional considerations expected in strong responses.
• Evaluate financial outputs: Review AI-generated analyses for accuracy, methodology, logic, and completeness.
• Assess professional judgment: Determine whether assumptions and conclusions are reasonable and sufficiently supported.
• Identify material errors: Detect incorrect calculations, accounting treatment, valuation logic, financial interpretation, or risk analysis.
• Critique peer rubrics: Review criteria for ambiguity, missing components, duplication, excessive subjectivity, or technical errors.
• Develop reference content: Produce high-quality analyses, solutions, critiques, and explanations.
• Support AI training: Generate tasks, rubrics, evaluations, preferences, and reference-answer pairs suitable for RL and SFT.
• Maintain professional standards: Ensure outputs reflect appropriate finance and accounting conventions and terminology.
Requirements
• Bachelor’s degree or higher in Finance, Accounting, Economics, Business, Applied Mathematics, or a related discipline.
• Relevant professional certifications such as CPA, CFA, ACCA, ACA, CMA, FRM, or equivalent are strongly preferred where applicable.
• Strong professional proficiency in English, minimum C1.
• 3+ years of professional experience in finance, accounting, investment analysis, corporate finance, financial reporting, audit, consulting, risk, or a related field.
• Strong knowledge of professional methodologies, calculations, assumptions, and analytical standards relevant to your specialty.
• Ability to create realistic professional finance or accounting tasks that require judgment rather than simple factual recall.
• Strong ability to design detailed rubrics covering accuracy, methodology, assumptions, completeness, materiality, reasoning quality, and professional presentation.
• Ability to distinguish between calculation errors, methodological errors, unsupported assumptions, and reasonable professional differences.
• Comfortable critiquing rubrics created by other finance or accounting experts.
• High attention to detail when reviewing numerical accuracy, financial logic, terminology, assumptions, reconciliations, and conclusions.
• Experience with training, examination writing, audit review, investment committee review, financial QA, research review, or professional assessment is strongly preferred.
• Prior experience with AI evaluation, model benchmarking, annotation, RLHF, or rubric-based scoring is preferred.
Location: Remote
How does the pay compare?Across Domain experts roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from SME Careers's posting. How we count.
Pay across the field: Domain experts
Across 698 roles in this field with a stated hourly rate in US dollars, on 18 platforms, the middle half pays $65 to $130 an hour at the top of the range, and the median is $100. This role's top rate, $100, is in the middle half. Of the 260 distinct rates we count, 124 are lower and 110 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr | 149 | $24 to $200 · median $80 |
| micro1 | 136 | $28 to $400 · median $110 |
| AfterQuery | 88 | $45 to $175 · median $100 |
| Handshake AI | 79 | $30 to $300 · median $85 |
| Mercor | 78 | $55 to $450 · median $120 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 6 Oct 2026, and still on SME Careers's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by SME Careers
- Not stated
- First seen by AIPayList
- Last seen live
- Listing ID
- ab48ef6c-9e35-4351-9f56-4ffa47f2a18a
Pay as the source states it: “Up to $100/hr”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.