Skip to main content

Trust Score & Worker Levels

Your trust score reflects the quality and consistency of your labeling. It affects which tasks you're offered and how your labels are weighted in consensus.

Trust Score

Your trust score is a value between 0.0 and 1.0:

RangeMeaning
0.90 – 1.00Excellent — your labels consistently match consensus
0.70 – 0.89Good — occasional disagreements, generally reliable
0.50 – 0.69Fair — noticeable accuracy issues, review your labeling approach
Below 0.50At risk — continued low scores may lead to suspension

How It's Calculated

Your trust score is based on your consensus agreement rate — how often your labels match the final consensus label on completed tasks.

  • Only tasks with resolved consensus count (tasks still pending don't affect your score)
  • Your score is calculated after a minimum of 5 completed tasks (before that, it shows as 1.0)
  • Recent tasks are weighted more heavily than older ones

What Affects Your Score

ActionEffect
Label matches consensus↑ Score increases
Label disagrees with consensus↓ Score decreases
Consistent accuracy over time↑ Gradual improvement
Streak of disagreements↓ Faster decline
tip

The best way to maintain a high trust score is to label carefully and consistently. Don't rush, and skip tasks you're not confident about.

Worker Levels

Your level is based on your completed task count and trust score:

LevelBadgeRequirements
Newcomer🌱0–9 completed tasks
Apprentice🔵10+ tasks, trust ≥ 0.60
Reliable🟢50+ tasks, trust ≥ 0.70
Expert200+ tasks, trust ≥ 0.80
Master👑500+ tasks, trust ≥ 0.90

Level Benefits

Higher levels may unlock:

  • Priority task access — first access to newly submitted tasks
  • Higher-value tasks — tasks with larger per-label payouts
  • Increased task volume — more tasks available at once
info

Levels are displayed in your worker app profile. Your current level and progress toward the next level are visible on the Dashboard.

Task Streaks

Completing tasks on consecutive days builds a streak. Streaks are displayed on your Dashboard and contribute to your sense of progress.

  • Streaks reset if you miss a calendar day
  • Streaks are cosmetic — they don't directly affect your trust score or pay
  • They're tracked locally on your device

Improving Your Trust Score

If your trust score drops:

  1. Slow down — rushing is the most common cause of low accuracy
  2. Review your History — look for patterns in which task types you disagree on
  3. Re-read task instructions — each task type has specific criteria
  4. Focus on task types you're strong at — accuracy on familiar tasks rebuilds trust faster
  5. Take breaks — fatigue leads to careless labels