AlignerrCoding & software eval
Python Insfrastructure Engineer - Model Evaluation
up to $75/hr
About this role, in Alignerr's words
What if your Python expertise could directly shape how the world's most advanced AI models are built, tested, and improved? We're looking for a senior Python engineer to design and build the data pipelines, evaluation harnesses, and annotation tooling that sit at the heart of cutting-edge AI development.
What you'll do
- Design, build, and optimize high-performance Python systems supporting AI data pipelines and model evaluation workflows
- Develop full-stack tooling and backend services for large-scale data annotation, validation, and quality control
- Build and maintain evaluation harnesses that integrate with ML inference frameworks
Show all 8 itemsHide the other 5 in What you'll do
- Improve reliability, performance, and safety across existing Python codebases
- Instrument systems with observability and metrics collection to monitor reliability and model performance
- Identify bottlenecks and edge cases in data and system behavior, and implement scalable fixes
- Collaborate with data, research, and engineering teams to support model training and evaluation workflows
- Participate in synchronous design reviews to iterate on architecture and implementation decisions
Candidate background
Who You Are
- Native or fluent English speaker with clear written and verbal communication skills
- Full-stack developer with a strong systems programming background
- 3–5+ years of professional experience writing production-grade Python
- Experienced building evaluation harnesses for ML models and integrating with inference frameworks
- Solid background in observability, metrics collection, and monitoring for production systems
- Self-motivated and reliable — able to commit 20–40 hours per week
Nice to Have
Show all 4 itemsHide these 4 items in Nice to Have
- Prior experience with data annotation, data quality, or evaluation systems
- Familiarity with AI/ML workflows, model training, or benchmarking pipelines
- Experience with distributed systems or developer tooling
- Background in MLOps or AI infrastructure
Quoted from selected sections of Alignerr's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Alignerr's words
Posted by Alignerr, reproduced here so you can judge the role before clicking. Original posting ↗
Python Infrastructure Engineer — Model Evaluation (AI Training)
About the Role
What if your Python expertise could directly shape how the world's most advanced AI models are built, tested, and improved? We're looking for a senior Python engineer to design and build the data pipelines, evaluation harnesses, and annotation tooling that sit at the heart of cutting-edge AI development.
This is a fully remote, flexible contract role working alongside leading AI research labs on real production systems. If you're a strong Python engineer who wants to do meaningful, high-impact work at the frontier of AI — this is the role for you.
- Organization: Alignerr - Type: Hourly Contract - Location: Remote - Commitment: 20–40 hours/week
What You'll Do
* Design, build, and optimize high-performance Python systems supporting AI data pipelines and model evaluation workflows * Develop full-stack tooling and backend services for large-scale data annotation, validation, and quality control * Build and maintain evaluation harnesses that integrate with ML inference frameworks * Improve reliability, performance, and safety across existing Python codebases * Instrument systems with observability and metrics collection to monitor reliability and model performance * Identify bottlenecks and edge cases in data and system behavior, and implement scalable fixes * Collaborate with data, research, and engineering teams to support model training and evaluation workflows * Participate in synchronous design reviews to iterate on architecture and implementation decisions
Who You Are
* Native or fluent English speaker with clear written and verbal communication skills * Full-stack developer with a strong systems programming background * 3–5+ years of professional experience writing production-grade Python * Experienced building evaluation harnesses for ML models and integrating with inference frameworks * Solid background in observability, metrics collection, and monitoring for production systems * Self-motivated and reliable — able to commit 20–40 hours per week
Nice to Have
* Prior experience with data annotation, data quality, or evaluation systems * Familiarity with AI/ML workflows, model training, or benchmarking pipelines * Experience with distributed systems or developer tooling * Background in MLOps or AI infrastructure
Why Join Us
* Work directly on cutting-edge AI projects alongside leading research labs * Fully remote and flexible — structure your work week around your life * Freelance autonomy with the depth and consistency of meaningful, long-term technical work * Make a tangible impact on how next-generation AI models are evaluated and improved * Potential for ongoing work and contract extension as new projects launch
Working with AlignerrPay, getting started and work, from Alignerr's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Billed weekly, Monday to Sunday, with approved work paid by the following Friday, according to Labelbox's help center. Payment goes through Stripe Connect or PayPal depending on your location, with one provider per country. intercom.help/labelbox/en/articles/13600616-alignerr-paym..., alignerr.com/process
- Before your first paid task
- Sign up, apply, verify your identity, set up billing and onboard. Some jobs add a Zara AI interview or domain assessments. alignerr.com/process
- How much work
- Time to your first project depends on demand and your skills, and there is no minimum number of hours. alignerr.com/faqs
- Contract
- Independent contractor, under terms with ALIGNERR LLC. alignerr.com/faqs, alignerr.com/privacy
Read on the pages linked above on 24 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Coding & software eval roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Alignerr's posting. How we count.
Pay across the field: Coding & software eval
Across 393 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $65 to $120 an hour at the top of the range, and the median is $95. This role's top rate, $75, is in the middle half. Of the 141 distinct rates we count, 45 are lower and 92 are higher.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr (this platform) | 136 | $50 to $400 · median $100 |
| micro1 | 46 | $35 to $350 · median $110 |
| Handshake AI | 43 | $47 to $125 · median $80 |
| Meridial (Invisible) | 34 | $22 to $150 · median $60 |
| Mercor | 33 | $60 to $200 · median $105 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 27 Aug 2026, and still on Alignerr's list when we last read it on 13 Oct 2026.
- The listed pay has not changed since then.
- Posted by Alignerr
- First seen by AIPayList
- Last seen live
- Listing ID
- 08dbfeab-50a2-4769-9edd-be08356ca2d7
Pay as the source states it: “$50-75/hr”.
Platforms sometimes change a rate after posting. Every listing here is re-read at least once a day and corrected when its source moves, so a difference you see on the platform is usually a change made since the last read. How freshness works.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.