AI Quality Reviewer

About the work

Hatch organises expert AI trainers to work on AI training projects for frontier AI labs. This project runs for four weeks with a small team, and there's a strong chance of further work for people who do well.

AI Trainers on this project write tasks that ask an AI model to produce a real file, such as a spreadsheet, a slide deck, or a document, and that are hard enough for the model to get part of it wrong. They then write the scoring guide used to grade the output.

As a Reviewer you check that work before it goes to the client. You decide whether the task is genuinely hard, whether the scoring guide tests what the task actually asked for, and whether each item can be answered with a clear pass or fail. Where the work falls short, you write the feedback that fixes it.

Reviewers set the standard for the whole project, so consistency matters as much as judgement. You'll calibrate against the other reviewers before the trainers start submitting, and stay calibrated through the four weeks.

What you'll do

• Review and score trainer submissions against a defined standard

• Write feedback specific enough for a trainer to act on straight away

• Hold a consistent bar with the other reviewers on the project

• Flag patterns you see across submissions so the training can be adjusted

Who we're looking for

• You've done AI training or data annotation work before, and you can name the provider and the project.

• You've reviewed, graded, or led other trainers on that kind of work, and you can name where.

• You write excellent English in your own voice.

• You're confident building slide decks, formatted documents, or spreadsheets.

• Your attention to detail is extremely high. You notice the small inconsistency most people read straight past.

• You follow written instructions precisely and hold others to the same standard without being difficult about it.

• You're reliable, ask questions when you're unsure, and take feedback well.

Requirements for the role

• You have the right to work in Australia

• You are based in Victoria, NSW, Queensland, Western Australia, Tasmania, the Northern Territory or South Australia

• You are available to work 15-20 hours per week

• You are able to start in the week beginning Monday 24 August

• You have access to your own computer

How it works

Apply, complete a short assessment, then start in the week beginning Monday 24 August if you're successful.