Skip to main content
After your organization assigns you to a project, work appears in the portal. Know which work type you accepted before you start; review, RLHF, and writing have different quality bars.

Where work appears

Work types

  • Review and audit: examine agent trajectories, scores, failures, and policy-sensitive cases against the project rubric. Read Reviewing agent runs first.
  • RLHF evaluations: judge model outputs with pairwise preferences, rankings, grades, safety flags, and short rationales. Read RLHF evaluations before the first labeling session.
  • Domain writing for RL environments: author scenarios, goals, and success criteria in your specialty that become environment tasks. Read Domain writing before you draft.
Projects may include calibration items (gold questions) so your org can measure agreement. Treat them the same as live work.

Accept and submit

1

Read the brief

Check domain fit, work type, the rubric or style guide, and the deadline.
2

Accept only if in-domain

Decline if the specialty is wrong. That keeps your org’s task banks and datasets clean.
3

Complete in the project UI

Follow the onboarding doc linked on the assignment. Use only allowed references.
4

Submit for review

Submissions may be spot-checked by project leads or cross-raters before approval.
After you accept, finish by the deadline or release the task early. Repeated abandonments reduce future assignments on that engagement.