Position: Rubric Academy Fellowship

Type: Fellowship (One-time, Paid)

Compensation: $50–$150 (one-time stipend)

Location: Remote

Duration: 3–5 hours, self-paced

Requirements

* Independent professional with deep subject-matter expertise in any domain

* Strong analytical thinking and ability to articulate how quality is evaluated in your field

* High professional integrity and reliance on personal judgment and domain standards

* Comfortable working independently in a self-guided learning environment

* Interest in understanding how AI evaluation and benchmarking systems are designed

* Ability to engage thoughtfully with conceptual frameworks related to prompts, rubrics, and evaluation quality

* No prior AI experience required

Role Responsibilities

* Complete a self-guided, paid Academy covering core concepts used in AI evaluation

* Learn the principles behind prompt design and how context shapes AI outputs

* Understand the concept of a “Golden Response” and how experts define ideal outcomes in their domain

* Review how evaluation rubrics and scoring systems are structured in AI benchmarking environments

* Optionally complete a practice task demonstrating applied understanding of the concepts

* Decide whether to opt in for eligibility for Mercor’s specialized, high-paying expert opportunities

* Maintain full autonomy over how professional judgment and expertise are applied

Application process: (Takes 20 min)

* Upload resume

* 15 min interview

* Submit form

Engineering Specialist | Remote