Back to jobs

Remote | Professional Domain Expert (Health/Med) — $50–$75/hour

24-MAG
San Francisco, CA
Contract
Applications go directly to the hiring team

Full Description

We are sharing a specialised part-time consulting opportunity for experienced health and medical professionals with strong backgrounds in clinical practice, health-related advisory work, evidence-based decision-making, and practical real-world domain judgment.

This role supports an exciting collaboration with a leading frontier AI research laboratory focused on improving the quality, accuracy, and safety of AI-generated responses across health and medical subjects.

Selected professionals will assess AI-generated responses across health and medical topics, helping improve the reliability of advanced AI systems in high-stakes contexts where inaccurate guidance can create serious practical risk. This opportunity is especially well-suited to professionals with real-world practitioner or advisory experience who can evaluate factual accuracy, clinical correctness, reasoning quality, and practical usefulness with strong domain judgment.

Key Responsibilities

Professionals in this role may contribute to:

Prompt Writing & Real-World Scenario Design

Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance across health and medical contexts

Help ensure that evaluation tasks reflect practical, real-world usage scenarios

Contribute domain-informed examples that support high-quality model assessment workflows

AI Response Evaluation & Quality Review

Evaluate AI-generated responses for factual accuracy, clinical correctness, and practical usefulness

Identify fabricated claims, incorrect references, or misleading reasoning across model outputs

Help maintain strong standards for quality and reliability in health and medical AI evaluation tasks

Structured Scoring & Written Justification

Score and rank multiple model responses using structured rubrics across defined dimensions

Provide written justifications with specific evidence for each evaluation

Apply professional judgment consistently across high-stakes domain review workflows

Ideal Profile

Strong candidates may have:

A Master's degree or higher in Health or a relevant professional field

Professional experience applying health or medical expertise in a practitioner or advisory capacity

Familiarity with industry-specific standards, regulations, or clinical guidelines

Strong written communication and critical reasoning skills

Comfort evaluating both factual correctness and practical usefulness in domain-specific responses

The ability to apply structured judgment across high-quality evaluation tasks

Preferred Qualifications

Experience with direct patient care, clinical support, health advisory work, care coordination, or related health-focused professional functions

Familiarity with healthcare standards, clinical workflows, and evidence-based guidance expectations

Ability to assess nuanced health and medical responses for both accuracy and practical reliability

Comfort working within structured rubrics and written evaluation workflows

Why This Opportunity

Contribute specialised health and medical expertise to a cutting-edge AI collaboration

Help improve how advanced AI systems respond to real-world health and medical questions

Work on high-impact evaluation tasks with strong practical relevance and clear real-world value

Flexible remote work with structured expectations and competitive hourly compensation

Contract Details

Independent contractor role

Fully remote with flexible scheduling

Hourly compensation of $50–$75 per hour

Expected commitment of approximately 20 hours per week

Application process includes resume submission and a Model Response Evaluation assessment

Projects may be extended, shortened, or concluded early depending on project needs and performance

Weekly payments via Stripe or Wise

Work will not involve access to confidential or proprietary information from any employer, client, or institution

Please note: We are unable to support H1-B or STEM OPT candidates at this time

Start date: Immediate

About The Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise across real-world workflows, structured evaluation, model training support, and domain-specific content validation.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy

Applications go to the hiring team directly