Video Caption Auditor Expert
Mercor · $20–$30/hr · Remote · Worldwide · Accounting & Finance
About the role
We're looking for detail-oriented annotators to join a short-term, fast-moving project reviewing captions on egocentric (first-person) video — footage recorded from a head-mounted camera showing someone's hands performing everyday tasks like cooking, cleaning or crafting. You'll audit whether a written caption accurately describes what happens in a short video segment, and give each caption a clear verdict. The project is already underway, so we're prioritising people who can start quickly.
What You'll Do
For each video segment and its caption, you'll decide:
- Approve — the caption accurately describes the action
- Reject — the caption has an error, rated Major or Minor, with the reason(s), for example:
- Wrong main verb (e.g. "wring" when the person is rubbing)
- A main action that is added, missing or out of order
- Wrong object or tool, or the wrong / swapped hand (left vs. right)
- Exclude — the footage itself is unusable (corrupted, badly mounted camera, broken segment boundaries)
- You'll follow a detailed written guideline with clear rules and examples, and judge only what is visible in each segment.
Who We're Looking For
- Excellent attention to detail and patience for careful, repetitive visual review
- Reliable left/right reasoning from the camera wearer's point of view
- Strong English reading comprehension and a precise sense of word meaning (e.g. the difference between "wipe", "rub" and "scrub")
- Ability to learn a detailed guideline quickly and apply it consistently
- Good judgment on ambiguous cases
- Nice to have: prior experience in video annotation, data labelling, content moderation, QA, or AI training/evaluation work.
Why Join Us?
- Contribute to Cutting-Edge AI Development: Play a direct role in improving how advanced AI models understand and interpret real-world human actions through first-person video.
- Flexible, Remote Work: Work from anywhere while contributing to a structured, high-impact AI annotation project.
- Clear Guidelines and Expectations: Benefit from detailed instructions, practical examples, and well-defined evaluation criteria to help you deliver high-quality work.
- Apply Your Attention to Detail: Put your observational skills, language comprehension, and critical thinking to work on meaningful AI evaluation tasks.
- Opportunity for Future Projects: Strong performance may open doors to additional AI training, annotation, and evaluation opportunities.
- Quick Onboarding: Join an active project with an accelerated onboarding process, allowing qualified candidates to begin contributing promptly.