TuringCoding & software eval
MLE Bench – ML Engineers
Pay not published
About this role, in Turing's words
We are looking for experienced Machine Learning Engineers (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on work with production-grade ML codebases, model training and evaluation pipelines, and deployment-oriented workflows to help assess and improve the capabilities of advanced AI systems.
Candidate background
Requirements
- Minimum 3+ years of overall experience as a Machine Learning Engineer or Software Engineer (ML-focused) .
- Strong proficiency in Python for machine learning and data workflows.
- Hands-on experience with model training, evaluation, and inference pipelines .
- Solid understanding of machine learning fundamentals (supervised/unsupervised learning, evaluation metrics, optimization).
- Experience working with ML frameworks (e.g., PyTorch, TensorFlow, JAX, or similar).
- Ability to understand, navigate, and modify complex, real-world ML codebases .
- Experience writing readable, reusable, and maintainable production-quality code .
- Strong problem-solving and debugging skills.
- Excellent spoken and written English communication skills .
Quoted from selected sections of Turing's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Turing's words
Posted by Turing, reproduced here so you can judge the role before clicking. Original posting ↗
About Turing
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L
Role Overview
We are looking for experienced Machine Learning Engineers (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on work with production-grade ML codebases, model training and evaluation pipelines, and deployment-oriented workflows to help assess and improve the capabilities of advanced AI systems.
The ideal candidate is comfortable bridging research and engineering, working deeply with models, data, and infrastructure in realistic ML environments.
What does day-to-day life look like?
• Work with real-world ML codebases to support MLE Bench–style evaluation tasks .
• Build, run, and modify model training, evaluation, and inference pipelines .
• Prepare datasets, features, and metrics for ML benchmarking and validation.
• Debug, refactor, and improve production-like ML systems for correctness and performance.
• Evaluate model behavior, failure modes, and edge cases relevant to benchmark tasks.
• Write clean, reproducible, and well-documented Python code for ML workflows.
• Participate in code reviews to ensure high standards of engineering quality.
• Collaborate with researchers and engineers to design challenging, real-world ML engineering tasks for AI system evaluation.
Requirements
• Minimum 3+ years of overall experience as a Machine Learning Engineer or Software Engineer (ML-focused) .
• Strong proficiency in Python for machine learning and data workflows.
• Hands-on experience with model training, evaluation, and inference pipelines .
• Solid understanding of machine learning fundamentals (supervised/unsupervised learning, evaluation metrics, optimization).
• Experience working with ML frameworks (e.g., PyTorch, TensorFlow, JAX, or similar).
• Ability to understand, navigate, and modify complex, real-world ML codebases .
• Experience writing readable, reusable, and maintainable production-quality code .
• Strong problem-solving and debugging skills.
• Excellent spoken and written English communication skills .
Perks of Freelancing With Turing
• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details
• Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
• Engagement Type: Contractor assignment (no medical/paid leave)
• Duration of Contract: 3 months (adjustable based on engagement)
• Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico
Evaluation Process
• Technical Interview with live coding challege (60 mins)
Working with TuringPay, getting started and work, from Turing's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid monthly, around the 5th, straight to your bank account, or inside Deel on projects run through Deel. Its help articles disagree on whether that is the 5th calendar day or business day. help.turing.com/articles/9691407757-project-onboarding, help.turing.com/articles/6582454854-what-if-i-haven-t-rec..., help.turing.com/articles/1226770947-project-offboarding
- Before your first paid task
- A short application, with tests on some roles. Turing's review article says an interview is typically required for all roles. Onboarding covers the terms, ID verification with a driver's license or passport, and tax and payment details. help.turing.com/articles/2020987592-apply-for-jobs-at-turing, help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/9691407757-project-onboarding
- How much work
- Review takes from 48 hours to 6 weeks after you finish applying, and the client makes the final choice. No reply within 6 weeks usually means you were not selected. help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/2020987592-apply-for-jobs-at-turing
- Contract
- Depending on the project, the engagement rests on Turing's Terms of Service and a Service Agreement, on Deel, or on a partner that provides the contract. help.turing.com/articles/6582454854-what-if-i-haven-t-rec...
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Coding & software eval roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Turing's posting. How we count.
Pay across the field: Coding & software eval
Across 394 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $65 to $120 an hour at the top of the range, and the median is $95.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr | 137 | $50 to $400 · median $100 |
| micro1 | 46 | $35 to $350 · median $110 |
| Handshake AI | 43 | $47 to $125 · median $80 |
| Meridial (Invisible) | 34 | $22 to $150 · median $60 |
| Mercor | 33 | $60 to $200 · median $105 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 19 Sep 2026, and still on Turing's list when we last read it on 13 Oct 2026.
- Posted by Turing
- First seen by AIPayList
- Last seen live
- Listing ID
- 60735
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.