TeracCoding & software eval
Brazil & Argentina Software Engineers: Coding Tasks for AI Evaluation
$40/hr
About this role, in Terac's words
We are developing a suite of coding tasks and environments to evaluate the performance of AI agents. We need experienced software developers to review and verify realistic programming tasks and evaluation harnesses.
What you'll do
What you would do
- Review realistic programming tasks designed for AI evaluation
- Assess the accuracy and structure of various evaluation harnesses
- Walk us through your thought process while checking code validity
- Provide actionable feedback on how to improve task complexity and realism
Candidate background
What this role asks for
- Software Engineering
- AI Evaluation
- Code Review
- Test Automation
Read from the posting's own words: show the exact sentences
- Software Engineering: “listed by the platform under required skills: Software Engineering”
- AI Evaluation: “listed by the platform under required skills: AI Evaluation”
- Code Review: “listed by the platform under required skills: Code Review”
- Test Automation: “listed by the platform under required skills: Test Automation”
Quoted from selected sections of Terac's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Terac's words
Posted by Terac, reproduced here so you can judge the role before clicking. Original posting ↗
We are developing a suite of coding tasks and environments to evaluate the performance of AI agents. We need experienced software developers to review and verify realistic programming tasks and evaluation harnesses.
What We're Researching
We're running a paid study on the effectiveness of coding tasks used to evaluate AI agents. Our team is building a comprehensive suite of programming environments designed to test complex software capabilities. We want to ensure these evaluation frameworks are realistic, accurate, and properly calibrated. How It Works
You will review a series of proposed coding tasks and assess their suitability for testing AI agents. We will ask you to verify the logic of the evaluation harnesses and provide feedback on their realistic application. You will share your screen to walk through the environments and point out potential flaws or improvements. The session involves a mix of code review, technical discussion, and direct feedback on the task structures. Who This Is For
We are looking for software engineers based in Brazil and Argentina with strong technical backgrounds. You should have direct experience building, reviewing, or testing evaluation harnesses and programming tasks. We welcome backend developers, full-stack engineers, and quality assurance automation specialists.
What you would do
• Review realistic programming tasks designed for AI evaluation
• Assess the accuracy and structure of various evaluation harnesses
• Walk us through your thought process while checking code validity
• Provide actionable feedback on how to improve task complexity and realism
Who this is for
• Professional experience as a software engineer or developer
• Located in Brazil or Argentina
• Familiarity with building or verifying coding tasks and test environments
• Comfortable discussing technical architectures and evaluation frameworks
Working with TeracPay, getting started and work, from Terac's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid through Virtual Incentives: PayPal, Venmo, a prepaid Visa card or direct cashout in the US, PayPal elsewhere. A payout starts once a submission is approved, and cashing out needs a $12.50 balance and a verified ID. terac.com/docs/experts/policies/payout-policy, terac.com/docs/experts/how-to/payments, terac.com/whats-new/2026-05-31-may-2026-updates
- Before your first paid task
- A verified government ID through Persona before you can apply, then a screening step for each study: a short form, an AI voice interview or a file upload. A study you are screened out of is not paid. terac.com/docs/experts/how-to/apply, terac.com/docs/experts/policies/rewards
- How much work
- Terac guarantees no number of opportunities and no earnings. Manually reviewed applications hear back in 1 to 5 business days. terac.com/docs/experts/policies/terms, terac.com/docs/experts/support/faq
- Contract
- Independent contractor, with Terac Inc. of California. terac.com/legal/terms-of-service
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Coding & software eval roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Terac's posting. How we count.
Pay across the field: Coding & software eval
Across 393 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $65 to $120 an hour at the top of the range, and the median is $95. This role's top rate, $40, is in the bottom quarter. Of the 141 distinct rates we count, 8 are lower and 130 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr | 137 | $50 to $400 · median $100 |
| micro1 | 46 | $35 to $350 · median $110 |
| Handshake AI | 43 | $47 to $125 · median $80 |
| Meridial (Invisible) | 34 | $22 to $150 · median $60 |
| Mercor | 33 | $60 to $200 · median $105 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 2 Oct 2026, and still on Terac's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by Terac
- First seen by AIPayList
- Last seen live
- Listing ID
- 6iC1ggB7S3drHEp8
Pay as the source states it: “Terac listing record, advertisedRate 40.00 USD HOURLY”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.