Back to roles
Turing logo
Turing

Technology, Information and Internet · Posted 1d ago

Software Engineer, AI Code Evaluation

Review how AI coding agents handle real repositories and turn your judgment into training signal

Within a regionAnywhere in North America, LATAM or India, as long as you like

Open to engineers based in North America, Latin America or India, with some Pacific Time overlap.

How long can you stay where you're going?
  • Work on frontier AI models
  • Short, roughly 3-month contract

The role

Turing needs experienced engineers to evaluate AI coding agents, review their code and write the rubrics and preference data that improve the models. It's a roughly three-month contract with at least 6 hours of Pacific Time overlap.

What you'll do

  • 1Evaluate AI-generated code and agent behavior across real-world repositories
  • 2Identify technical errors, weak approaches and recurring model failure modes
  • 3Compare model outputs and explain why one solution is better
  • 4Create rubrics and preference data used to improve coding models
  • 5Build pipelines supporting data generation and evaluation workflows

What they're looking for

Must-haves

  • Hands-on software engineering in substantial real-world codebases
  • Strong in Python, TypeScript/JavaScript, Go or another major language
  • Strong code-review skills and technical judgment
  • Clear written communication
  • Experience using modern LLMs or AI coding tools

Nice to have

  • Experience with LLM evaluation or coding agents
  • Background in RLHF, preference data or post-training
  • Experience with rubric design

Skills and platforms

  • Python
  • TypeScript
  • JavaScript
  • Go
  • Software Engineering
  • Code Review
  • LLM
  • AI Coding Tools
  • RLHF
  • Preference Data
  • Rubric Design
  • Data Generation
  • Technical Judgment
  • Communication
  • Coding Agents

The company

Turing logo

Turing

Technology, Information and Internet

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

Summarised by Jobs That Travel from Turing's listing.

Similar roles

Browse all roles
Gramian Consulting logo

Gramian Consulting

IT Services and IT Consulting

1d ago

Computational Life Sciences & Scientific Python Specialist

Review and solve research-grade biology problems in Python to sharpen AI systems

Within a region

Flexible schedule

Pay not listed

Contract / freelance · Remote · Brazil, Argentina, Asia-Pacific and 9 more

Async: no set hours

Gramian Consulting logo

Gramian Consulting

IT Services and IT Consulting

1d ago

Mechanical Engineering & Simulation Specialist

Build and check mechanical simulations that train AI models, on hours you choose

Anywhere

Choose your own hours

Pay not listed

Contract / freelance · Remote · Worldwide

Async: no set hours

Aptura logo

Aptura

Technology, Information and Internet

4d ago

FP&A AI Research Contributor

Turn your FP&A Excel expertise into tasks that test how well AI does analyst work

Anywhere

Own schedule

Pay not listed

Contract / freelance · Remote · Worldwide

Async: no set hours

Jobs That Travel Pro

See all 659 roles

Including 10 more in Engineering, all checked for where you can live. Applying stays free.

Elitebrain.ai logoGramian Consulting logoPatronus AI logoSphere logoHalcyon logoLaw Offices of Sabrina Li, P.C. logo

Elitebrain.ai, Gramian Consulting and 20 more employers hiring

From $4.08 a month · 14-day money-back guarantee

Already Pro? Sign in