Masterclass Freelance AI Project Reviewer at MasterClass evaluates learner submissions against detailed rubrics and provides constructive feedback. Collaborates with product and learning design teams to ensure fair and accurate assessments.
Responsibilities
As a freelance AI Project Reviewer, you will be responsible for evaluating learner submissions against detailed rubrics for a new product. You will apply consistent judgment to determine pass/fail outcomes and provide clear, constructive feedback to help learners improve. Working alongside our product and learning design teams, you’ll help calibrate and validate assessment approaches to ensure fair, accurate, and valuable feedback for our members.
This is a temporary role with flexible engagement based on project needs. ~20 hours per week.
Review and evaluate projects against detailed rubrics, providing consistent pass/fail judgments.
Write clear, actionable feedback that helps learners understand areas for improvement.
Collaborate with the learning design and product team to refine rubrics and assessment criteria.
Compare human and AI assessment outcomes to identify areas for calibration.
Document reasoning behind evaluation decisions to support assessment consistency
Qualification
5+ years of experience in assessmentYou’re a Great Fit If YouExperience as Mentor
Required
5+ years of experience in assessment, evaluation, or educational feedback roles.
Proven ability to consistently apply detailed rubrics across multiple submissions.
Strong written communication skills with the ability to articulate reasoning clearly.
Experience providing constructive feedback to support learner growth.
Ability to work independently while maintaining high standards.
Willingness to refrain from using AI during evaluations and written rationales.
Experience in roles such as Mentor or Coach in educational settings, Educational Evaluator or Teaching Assistant (TA), Consultant in AI or learning design, or Instructor with experience in grading and providing feedback.
You’re a Great Fit If You:
Are passionate about education and committed to helping learners succeed.
Have a keen eye for detail and take pride in maintaining high standards in evaluation.
Enjoy collaborating with cross-functional teams to enhance assessment quality.
Are comfortable making nuanced judgments while ensuring consistency.
Preferred
Experience as Mentor, Coach, Educational Evaluator, Teaching Assistant, Consultant in AI or learning design, or Instructor with grading experience