TeracCoding & software eval
SWE Coding Benchmarks & RL Environments
$75/hr
About this role, in Terac's words
We're running a paid study to review and verify programming tasks used for testing AI agents. We need experienced software engineers to evaluate coding harnesses and assess the quality of realistic coding challenges.
Candidate background
What we're looking for
- Solid professional software engineering experience, backend and frontend.
- You've built and debugged real systems, and you care about testing them well.
- Clear written communication, and comfort working independently from written docs.
- 10–20+ hours a week, starting soon.
Quoted from selected sections of Terac's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Terac's words
Posted by Terac, reproduced here so you can judge the role before clicking. Original posting ↗
We're running a paid study to review and verify programming tasks used for testing AI agents. We need experienced software engineers to evaluate coding harnesses and assess the quality of realistic coding challenges.
Remote · Contract · $45-75/hr, paid weekly · 10–20+ hrs/week
We build coding tasks used to train and evaluate frontier AI coding agents. We're looking for experienced software engineers to design them.
What the work involves
• Writing realistic engineering tasks on full-stack web apps: the kind of problem a real team has in its backlog, on codebases that grow as each task builds on the last.
• Writing the tests that decide whether a solution is correct.
• Going beyond the UI: new services and APIs, a backend in another language (Go, Rust, Java), gRPC, rate limiting — drawing on systems you've actually built.
• Sharing what you've seen work in other projects and flagging what should change in ours.
The apps are TypeScript (React, Node, SQLite, Playwright). Use AI tools as much as you like to write code and tests.
What we're looking for
• Solid professional software engineering experience, backend and frontend.
• You've built and debugged real systems, and you care about testing them well.
• Clear written communication, and comfort working independently from written docs.
• 10–20+ hours a week, starting soon.
How it works
A short screener, a brief AI interview, and a paid work trial on the codebase you'd keep working on. US and Canada preferred for timezone overlap; exceptional candidates elsewhere are welcome. LinkedIn and GitHub required.
Working with TeracPay, getting started and work, from Terac's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid through Virtual Incentives: PayPal, Venmo, a prepaid Visa card or direct cashout in the US, PayPal elsewhere. A payout starts once a submission is approved, and cashing out needs a $12.50 balance and a verified ID. terac.com/docs/experts/policies/payout-policy, terac.com/docs/experts/how-to/payments, terac.com/whats-new/2026-05-31-may-2026-updates
- Before your first paid task
- A verified government ID through Persona before you can apply, then a screening step for each study: a short form, an AI voice interview or a file upload. A study you are screened out of is not paid. terac.com/docs/experts/how-to/apply, terac.com/docs/experts/policies/rewards
- How much work
- Terac guarantees no number of opportunities and no earnings. Manually reviewed applications hear back in 1 to 5 business days. terac.com/docs/experts/policies/terms, terac.com/docs/experts/support/faq
- Contract
- Independent contractor, with Terac Inc. of California. terac.com/legal/terms-of-service
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Coding & software eval roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Terac's posting. How we count.
Pay across the field: Coding & software eval
Across 393 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $65 to $120 an hour at the top of the range, and the median is $95. This role's top rate, $75, is in the middle half. Of the 140 distinct rates we count, 45 are lower and 92 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr | 137 | $50 to $400 · median $100 |
| micro1 | 46 | $35 to $350 · median $110 |
| Handshake AI | 43 | $47 to $125 · median $80 |
| Meridial (Invisible) | 34 | $22 to $150 · median $60 |
| Mercor | 33 | $60 to $200 · median $105 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 19 Sep 2026, and still on Terac's list when we last read it on 13 Oct 2026.
- Posted by Terac
- First seen by AIPayList
- Last seen live
- Listing ID
- -fZWSNqITNTSiEMh
Pay as the source states it: “Terac listing record, advertisedRate 75.00 USD HOURLY”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.