Where work appears
Work types
- Review and audit: examine agent trajectories, scores, failures, and policy-sensitive cases against the project rubric. Read Reviewing agent runs first.
- RLHF evaluations: judge model outputs with pairwise preferences, rankings, grades, safety flags, and short rationales. Read RLHF evaluations before the first labeling session.
- Domain writing for RL environments: author scenarios, goals, and success criteria in your specialty that become environment tasks. Read Domain writing before you draft.
Accept and submit
1
Read the brief
Check domain fit, work type, the rubric or style guide, and the deadline.
2
Accept only if in-domain
Decline if the specialty is wrong. That keeps your org’s task banks and datasets clean.
3
Complete in the project UI
Follow the onboarding doc linked on the assignment. Use only allowed references.
4
Submit for review
Submissions may be spot-checked by project leads or cross-raters before approval.

