We Love AI JobsEngineering Specialist | Remote
Crossing HurdlesThe Engineering Specialist role at Crossing Hurdles offers a unique opportunity to engage with AI evaluation systems from anywhere in the United States. This paid fellowship allows professionals to work independently while enhancing their understanding of prompt design and evaluation quality in AI, and it may lead to specialized, high-paying opportunities based on performance.
Skills & Expertise
Key Responsibilities
Complete a self-guided, paid Academy on AI evaluation concepts.
Learn principles of prompt design and context in AI outputs.
Review how evaluation rubrics are structured in AI benchmarking.
Full Description
Position: Rubric Academy Fellowship
Type: Fellowship (One-time, Paid)
Compensation: $50–$150 (one-time stipend)
Location: Remote
Duration: 3–5 hours, self-paced
Requirements
* Independent professional with deep subject-matter expertise in any domain
* Strong analytical thinking and ability to articulate how quality is evaluated in your field
* High professional integrity and reliance on personal judgment and domain standards
* Comfortable working independently in a self-guided learning environment
* Interest in understanding how AI evaluation and benchmarking systems are designed
* Ability to engage thoughtfully with conceptual frameworks related to prompts, rubrics, and evaluation quality
* No prior AI experience required
Role Responsibilities
* Complete a self-guided, paid Academy covering core concepts used in AI evaluation
* Learn the principles behind prompt design and how context shapes AI outputs
* Understand the concept of a “Golden Response” and how experts define ideal outcomes in their domain
* Review how evaluation rubrics and scoring systems are structured in AI benchmarking environments
* Optionally complete a practice task demonstrating applied understanding of the concepts
* Decide whether to opt in for eligibility for Mercor’s specialized, high-paying expert opportunities
* Maintain full autonomy over how professional judgment and expertise are applied
Application process: (Takes 20 min)
* Upload resume
* 15 min interview
* Submit form