TuringCoding & software eval
Domain Expert – Python
Pay not published
About this role, in Turing's words
This role is part of a project supporting leading LLM companies. The primary objective is to help these foundational LLM companies improve their Large Language Models.
Candidate background
Requirements
- 5+ years of overall work experience, with at least 3 years of relevant experience in Python and 2+ years in CUDA/C++.
- Strong hands-on experience with Python , especially in scientific computing using PyTorch and NumPy .
- Solid understanding of CUDA programming concepts and C++ fundamentals.
- Demonstrated ability to analyze CUDA kernels and accurately reproduce them in Python.
- Familiarity with GPU computation, parallelism, and performance-aware coding practices.
- Strong debugging skills and attention to numerical consistency when porting logic across languages.
- Experience evaluating AI-generated code or participating in LLM tuning is a plus.
- Ability to communicate technical feedback clearly and constructively.
- Fluent in conversational and written English communication skills.
Quoted from selected sections of Turing's posting. The full posting may state other conditions. Read the full posting
A closer look
More context, when you need it.
Full job descriptionThe original posting, in Turing's words
Posted by Turing, reproduced here so you can judge the role before clicking. Original posting ↗
About Turing:
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.
Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview: This role is part of a project supporting leading LLM companies. The primary objective is to help these foundational LLM companies improve their Large Language Models.
We support companies in enhancing their models by offering high-quality proprietary data. This data can be used as a basis for fine-tuning models or as an evaluation set to benchmark the performance.
In an SFT data generation workflow, you might have to put together a prompt that contains code and questions, then elaborate model responses, and translate the provided CUDA/C++ code into equivalent Python code using PyTorch and NumPy to replicate the algorithm's behavior.
For RLHF data generation, you may need to create a prompt or use one provided by the customer, ask the model questions, and evaluate the outputs generated by different versions of the LLM, comparing it and providing feedback, which is then used in fine-tune processes.
Please note that this role does not involve building or fine-tuning LLMs.
What does day-to-day look like:
• Translate CUDA/C++ code into equivalent Python implementations using PyTorch and NumPy , ensuring logical and performance parity.
• Analyze CUDA kernels and GPU-accelerated code for structure, efficiency, and function before translation.
• Evaluate LLM-generated translations of CUDA/C++ code to Python, providing technical feedback and corrections.
• Collaborate with prompt engineers and researchers to develop test prompts that reflect real-world CUDA/PyTorch tasks.
• Participate in RLHF workflows, ranking LLM responses and justifying ranking decisions clearly.
• Debug and review translated Python code for correctness, readability, and consistency with industry standards.
• Maintain technical documentation to support reproducibility and code clarity.
• Propose enhancements to prompt structure or conversion approaches based on common LLM failure patterns.
Requirements:
• 5+ years of overall work experience, with at least 3 years of relevant experience in Python and 2+ years in CUDA/C++.
• Strong hands-on experience with Python , especially in scientific computing using PyTorch and NumPy .
• Solid understanding of CUDA programming concepts and C++ fundamentals.
• Demonstrated ability to analyze CUDA kernels and accurately reproduce them in Python.
• Familiarity with GPU computation, parallelism, and performance-aware coding practices.
• Strong debugging skills and attention to numerical consistency when porting logic across languages.
• Experience evaluating AI-generated code or participating in LLM tuning is a plus.
• Ability to communicate technical feedback clearly and constructively.
• Fluent in conversational and written English communication skills.
Perks of Freelancing With Turing:
• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details:
• Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week)
• Engagement type : Contractor assignment (no medical/paid leave)
• Duration of contract : 3 months; [expected start date is next week]
Location : India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico
Evaluation Process (approximately 75 mins): Two rounds of interviews (60 min technical + 15 min cultural & offer discussion)
Working with TuringPay, getting started and work, from Turing's own pages
What the platform publishes in general. These are not extra terms confirmed for this particular role.
- Getting paid
- Paid monthly, around the 5th, straight to your bank account, or inside Deel on projects run through Deel. Its help articles disagree on whether that is the 5th calendar day or business day. help.turing.com/articles/9691407757-project-onboarding, help.turing.com/articles/6582454854-what-if-i-haven-t-rec..., help.turing.com/articles/1226770947-project-offboarding
- Before your first paid task
- A short application, with tests on some roles. Turing's review article says an interview is typically required for all roles. Onboarding covers the terms, ID verification with a driver's license or passport, and tax and payment details. help.turing.com/articles/2020987592-apply-for-jobs-at-turing, help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/9691407757-project-onboarding
- How much work
- Review takes from 48 hours to 6 weeks after you finish applying, and the client makes the final choice. No reply within 6 weeks usually means you were not selected. help.turing.com/articles/9179629201-how-long-does-the-app..., help.turing.com/articles/2020987592-apply-for-jobs-at-turing
- Contract
- Depending on the project, the engagement rests on Turing's Terms of Service and a Service Agreement, on Deel, or on a partner that provides the contract. help.turing.com/articles/6582454854-what-if-i-haven-t-rec...
Read on the pages linked above on 23 Sep 2026. Platforms change these terms, so check the linked page before you rely on one.
How does the pay compare?Across Coding & software eval roles, not this role alone
From our own daily reads of every open listing on the platforms we follow, not from Turing's posting. How we count.
Pay across the field: Coding & software eval
Across 394 roles in this field with a stated hourly rate in US dollars, on 14 platforms, the middle half pays $65 to $120 an hour at the top of the range, and the median is $95.
| Platform | Roles | Top of range, per hour |
|---|---|---|
| Alignerr | 137 | $50 to $400 · median $100 |
| micro1 | 46 | $35 to $350 · median $110 |
| Handshake AI | 43 | $47 to $125 · median $80 |
| Meridial (Invisible) | 34 | $22 to $150 · median $60 |
| Mercor | 33 | $60 to $200 · median $105 |
Sources and listing historyWhere this information comes from
This listing's history
- First seen here on 8 Oct 2026, and still on Turing's list when we last read it on 13 Oct 2026.
- Posted by Turing
- First seen by AIPayList
- Last seen live
- Listing ID
- 111539
Turing posts this role once per country: 6 listings with the same title and pay. We treat them as one role, open in 11 countries.
Keep exploring
More like this
Related field, different requirements. Check each role's own page before you apply.