TuringDomain experts
Engineering Expert
Pay not published
About this role, in Turing's words
We are seeking experienced AI Evaluation Engineers (Engineering Simulation & Design) to author and validate "model-breaking," simulation-based engineering design problems to train and evaluate state-of-the-art AI agents. Operating across major engineering disciplines—including Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics—you will create complex, multi-constraint tasks where AI agents must interpret requirements, navigate trade-offs, configure open-source simulation tools, diagnose failures, and iterate toward valid solutions. You will analyze agent execution logs, expose systemic reasoning gaps, and build automated, objective graders to elevate frontier model performance.
Candidate background
What this role asks for
- Classical Mechanics
- Electrical Networks
Read from the posting's own words: show the exact sentences
- Classical Mechanics: “listed by the platform under required skills: Classical Mechanics”
- Electrical Networks: “listed by the platform under required skills: Electrical Networks”
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Turing's words
Posted by Turing, reproduced here so you can judge the role before clicking. Original posting ↗
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview
We are seeking experienced AI Evaluation Engineers (Engineering Simulation & Design) to author and validate "model-breaking," simulation-based engineering design problems to train and evaluate state-of-the-art AI agents. Operating across major engineering disciplines—including Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics—you will create complex, multi-constraint tasks where AI agents must interpret requirements, navigate trade-offs, configure open-source simulation tools, diagnose failures, and iterate toward valid solutions. You will analyze agent execution logs, expose systemic reasoning gaps, and build automated, objective graders to elevate frontier model performance.
Job Requirements:
• Education & Expertise: Relevant degree in Electrical, Mechanical, Aerospace, with 5+ years of hands-on engineering design experience.
• Simulation Tooling: Proficiency with at least one domain-relevant open-source simulation package (e.g., ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, Gmsh) combined with strong Python scripting skills.
• AI Evaluation & Failure Diagnostics: Hands-on experience with modern LLMs/coding agents and evaluation concepts (pass@k, failure-mode analysis, nondeterministic behavior), with the ability to audit trajectory logs and isolate core reasoning/tool-use failures.
• Domain Rigor & Precision: Uncompromising attention to physical plausibility, unit consistency, boundary conditions, convergence criteria, and technical documentation.
• Availability & Commitment: Talent must have weekend on-call availability (part-time engagement is acceptable).
• Technical Infrastructure: Personal desktop/laptop equipped with a stable, high-speed internet connection in a remote setup.
Job Responsibilities:
• Model-Breaking Problem Design: Author original, self-contained engineering design tasks with competing constraints, explicit optimization targets, validated reference solutions, and objective autograders.
• Environment & Simulation Integration: Build, run, and validate problem environments using open-source simulation tools and custom Python test benches.
• Trajectory Analysis & Failure Mode Taxonomy: Evaluate coding agent outputs and execution logs across repeated trials to identify systemic failure modes (e.g., misinterpreting simulator feedback, premature design convergence, physically impossible geometries).
• Difficulty Calibration & Benchmark Refinement: Iteratively refine problem difficulty based on empirical model performance data without introducing ambiguity or missing information.
• Cross-Functional Collaboration: Partner with AI researchers, pod leads, and domain experts to integrate high-rigor benchmarks into the model evaluation pipeline.
Domains:
• Electrical Engineering
• Mechanical Engineering
• Aerospace Engineering
Education & Experience
• Bachelor or higher degree from relevant engineering domain is a must for this position.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is required.
Offer Details:
• Commitments Required: Upto 40 hours per week with 4 hours of overlap with PST.
• Engagement type: Contractor
• Engagement Length: upto 12 weeks
Evaluation Process -
• Candidates will be require to submit a Job Interest Form & assessment .
• Talents finalized in assessment will go through delivery interview & proceeded further accordingly.
Working with TuringPay, getting started and work, from Turing's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid monthly, around the 5th, straight to your bank account, or inside Deel on projects run through Deel. Its help articles disagree on whether that is the 5th calendar day or business day. help.turing.com/articles/9691407757-project-onboarding, help.turing.com/articles/6582454854-what-if-i-haven-t-rec..., help.turing.com/articles/1226770947-project-offboarding
- Before your first paid task
- A short application, with tests on some roles. Turing's review article says an interview is typically required for all roles. Onboarding covers the terms, ID verification with a driver's license or passport, and tax and payment details. help.turing.com/articles/2020987592-apply-for-jobs-at-turing, help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/9691407757-project-onboarding
- How much work
- Review takes from 48 hours to 6 weeks after you finish applying, and the client makes the final choice. No reply within 6 weeks usually means you were not selected. help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/2020987592-apply-for-jobs-at-turing
- Contract
- Depending on the project, the engagement rests on Turing's Terms of Service and a Service Agreement, on Deel, or on a partner that provides the contract. help.turing.com/articles/6582454854-what-if-i-haven-t-rec...
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Domain experts roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Turing's posting. How we count.
Pay across the field: Domain experts
Across 1482 roles in this field with a stated hourly rate in US dollars, on 25 platforms, the middle half pays $65 to $125 an hour at the top of the range, and the median is $93.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| micro1 | 256 | $14 to $400 · median $105 |
| Handshake AI | 190 | $30 to $300 · median $85 |
| Mercor | 166 | $35 to $350 · median $120 |
| Alignerr | 162 | $20 to $200 · median $80 |
| AfterQuery | 131 | $45 to $200 · median $100 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 11 Nov 2026, and still on Turing's list when we last read it on 21 Nov 2026.
- We saw Turing list this same title 1 time before, the first on 19 Sep 2026. That listing had left our list before this one appeared.
- Posted by Turing
- First seen by AIPayList
- Last seen live
- Listing ID
- 119170
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.