DataAnnotation.tech: My $10,000 Experience

Personal Experience (Sept 2023 – Aug 2024): I earned over $10,000 here while managing full-time caregiving duties. Work involves RLHF (Reinforcement Learning from Human Feedback), providing A/B comparative evaluations of AI chatbots to teach them “what a good, safe, and accurate answer looks like.” You rank responses based on reasoning, logic, and multi-criteria rubrics, identifying logic weaknesses and providing detailed written feedback. They claim a $20/hr base, though simpler projects occasionally dip to $18/hr.

Onboarding & Qualifications: Unlike platforms that just automatically assign you tasks, DA relies on a dedicated “Qualifications” dashboard. To access new project pools, you must voluntarily take these tests as they appear. Some pay your hourly rate, while others are unpaid. However, for many projects, you simply read the comprehensive guidelines provided and dive straight into the work.

The Un-Pausable Timers: A critical note on flexibility: the task timer is not pausable. The stated timer is a strict maximum limit, not a suggestion. If you are frequently interrupted and regularly get close to the maximum allowed time for tasks, you risk being flagged during a routine worker purge, as they analyze patterns of efficiency over time.

Strict Monitoring & Silent Firings: The platform has incredibly strict, zero-tolerance monitoring. Because iPad browsers frequently reload background tabs (deleting your unsaved work) and I was managing constant interruptions, I drafted answers in an external Notes app and pasted them in. Ultimately, I was let go—likely because getting close to the maximum time limit often enough made me a target during a routine purge, or because pasting my own text triggered anti-bot detectors. Crucially, they never explicitly warn you against drafting in external apps, leading many to make this innocent mistake unknowingly. If flagged, you face a permanent, silent firing (the “empty dashboard”) with no explanation and no appeal process.

The Community: Unlike Stellar, DataAnnotation has no internal support forum. They do utilize a Slack channel for active workers, but be warned: the day I was let go, I was instantly removed from Slack without notice. Workers are entirely reliant on community subreddits like r/DataAnnotationTech to figure out if the site is down or to decode why their dashboard is suddenly empty.

Looking for other AI training opportunities? Most other platforms require a strong resume to get noticed. These expert resume services can help you stand out to recruiters at Outlier, Invisible, and Mindrift.