Skip to main content

Trust Score & Worker Levels

Your trust score reflects the quality and consistency of your labeling. It affects which tasks you're offered and how your labels are weighted in consensus.

Trust Score​

Your trust score is a value between 0.0 and 1.0:

RangeMeaning
0.90 – 1.00Excellent — your labels consistently match consensus
0.70 – 0.89Good — occasional disagreements, generally reliable
0.50 – 0.69Fair — noticeable accuracy issues, review your labeling approach
Below 0.50At risk — continued low scores may lead to suspension

How It's Calculated​

Your trust score is based on your consensus agreement rate — how often your labels match the final consensus label on completed tasks.

  • Only tasks with resolved consensus count (tasks still pending don't affect your score)
  • Your score is calculated after a minimum of 5 completed tasks (before that, it shows as 1.0)
  • Recent tasks are weighted more heavily than older ones

What Affects Your Score​

ActionEffect
Label matches consensus↑ Score increases
Label disagrees with consensus↓ Score decreases
Consistent accuracy over time↑ Gradual improvement
Streak of disagreements↓ Faster decline
tip

The best way to maintain a high trust score is to label carefully and consistently. Don't rush, and skip tasks you're not confident about.

Worker Levels​

Your level is based on your completed task count and trust score:

LevelBadgeRequirements
Newcomer🌱0–9 completed tasks
Apprentice🔵10+ tasks, trust ≥ 0.60
Reliable🟢50+ tasks, trust ≥ 0.70
Expert⭐200+ tasks, trust ≥ 0.80
Master👑500+ tasks, trust ≥ 0.90

Level Benefits​

Higher levels may unlock:

  • Priority task access — first access to newly submitted tasks
  • Higher-value tasks — tasks with larger per-label payouts
  • Increased task volume — more tasks available at once
info

Levels are displayed in your worker app profile. Your current level and progress toward the next level are visible on the Dashboard.

Task Streaks​

Completing tasks on consecutive days builds a streak. Streaks are displayed on your Dashboard and contribute to your sense of progress.

  • Streaks reset if you miss a calendar day
  • Streaks are cosmetic — they don't directly affect your trust score or pay
  • They're tracked locally on your device

Improving Your Trust Score​

If your trust score drops:

  1. Slow down — rushing is the most common cause of low accuracy
  2. Review your History — look for patterns in which task types you disagree on
  3. Re-read task instructions — each task type has specific criteria
  4. Focus on task types you're strong at — accuracy on familiar tasks rebuilds trust faster
  5. Take breaks — fatigue leads to careless labels