Remote | Professional Domain Expert (Health/Med) — $50–$75/hour
24-MAGFull Description
We are sharing a specialised part-time consulting opportunity for experienced health and medical professionals with strong backgrounds in clinical practice, health-related advisory work, evidence-based decision-making, and practical real-world domain judgment.
This role supports an exciting collaboration with a leading frontier AI research laboratory focused on improving the quality, accuracy, and safety of AI-generated responses across health and medical subjects.
Selected professionals will assess AI-generated responses across health and medical topics, helping improve the reliability of advanced AI systems in high-stakes contexts where inaccurate guidance can create serious practical risk. This opportunity is especially well-suited to professionals with real-world practitioner or advisory experience who can evaluate factual accuracy, clinical correctness, reasoning quality, and practical usefulness with strong domain judgment.
Key Responsibilities
Professionals in this role may contribute to:
Prompt Writing & Real-World Scenario Design
Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance across health and medical contexts
Help ensure that evaluation tasks reflect practical, real-world usage scenarios
Contribute domain-informed examples that support high-quality model assessment workflows
AI Response Evaluation & Quality Review
Evaluate AI-generated responses for factual accuracy, clinical correctness, and practical usefulness
Identify fabricated claims, incorrect references, or misleading reasoning across model outputs
Help maintain strong standards for quality and reliability in health and medical AI evaluation tasks
Structured Scoring & Written Justification
Score and rank multiple model responses using structured rubrics across defined dimensions
Provide written justifications with specific evidence for each evaluation
Apply professional judgment consistently across high-stakes domain review workflows
Ideal Profile
Strong candidates may have:
A Master's degree or higher in Health or a relevant professional field
Professional experience applying health or medical expertise in a practitioner or advisory capacity
Familiarity with industry-specific standards, regulations, or clinical guidelines
Strong written communication and critical reasoning skills
Comfort evaluating both factual correctness and practical usefulness in domain-specific responses
The ability to apply structured judgment across high-quality evaluation tasks
Preferred Qualifications
Experience with direct patient care, clinical support, health advisory work, care coordination, or related health-focused professional functions
Familiarity with healthcare standards, clinical workflows, and evidence-based guidance expectations
Ability to assess nuanced health and medical responses for both accuracy and practical reliability
Comfort working within structured rubrics and written evaluation workflows
Why This Opportunity
Contribute specialised health and medical expertise to a cutting-edge AI collaboration
Help improve how advanced AI systems respond to real-world health and medical questions
Work on high-impact evaluation tasks with strong practical relevance and clear real-world value
Flexible remote work with structured expectations and competitive hourly compensation
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Hourly compensation of $50–$75 per hour
Expected commitment of approximately 20 hours per week
Application process includes resume submission and a Model Response Evaluation assessment
Projects may be extended, shortened, or concluded early depending on project needs and performance
Weekly payments via Stripe or Wise
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Start date: Immediate
About The Platform
This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.
Experts contribute to improving advanced AI systems by providing specialised expertise across real-world workflows, structured evaluation, model training support, and domain-specific content validation.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy