Apply on Employer SiteApply Now
CleraPosted Nov 15, 2026
Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)
remotecontractRemotesenior$104k–$250kH1B: no
Clera Senior rater and reviewer evaluating expert-level AI model outputs and calibrating other graders. Responsible for ranking, rating, fact-checking, and reviewing model answers in specialized fields.
Responsibilities
- Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems.
- Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales.
- Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance.
- Fact-check detailed claims against primary sources and verify accuracy.
- Assess answers against content policies, style guides, and edge cases.
- Review other raters' work, calibrate standards, and develop or refine grading guidelines.
- Assess search relevance and share feedback in live sessions.
Qualification
Experience leadingAn advanced degree
Required
- At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field.
- Native or near-native written English proficiency.
- Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
- Experience leading, reviewing, or mentoring other raters or reviewers.
- An advanced degree, professional license, or deep working expertise in the domain you evaluate.
- Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus.
Preferred
Company
Clera
View company pageSource: ashby
Active within the past hour
Remote-friendly