Psychiatry Expert

This role is for one of our clients

Compensation: $150 per hour

We are seeking board-certified psychiatrists to support an expert evaluation project with a leading AI research organization.

The project focuses on assessing how effectively advanced AI systems reason through complex psychiatric scenarios. As a Psychiatry Expert, you will use your clinical expertise to develop challenging, expert-level diagnostic and reasoning tasks, establish authoritative reference answers, and identify common weaknesses in AI-generated clinical reasoning.

Psychiatrists from a range of practice settings are welcome, with particular interest in professionals with specialized expertise in psychiatry subspecialties.

Requirements

Key Responsibilities

• Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems.

• Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning.

• Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations.

• Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns.

• Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks.

• Collaborate directly with AI research teams and other subject-matter experts.

• Apply current clinical knowledge and professional judgment consistently when evaluating model outputs.

Required Qualifications

• Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program. Current trainees do not qualify.

• Medical degree: MD or DO. International medical degrees from recognized institutions are also eligible.

• Active board certification in psychiatry, such as:

• ABPN

• FRCPC

• MRCPsych

• FRANZCP

• Recognized national equivalent

• Board-eligible or lapsed certifications do not meet the requirement.

• Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action.

• 3+ years of independent clinical practice after residency, either currently or within the past two years. Residency and fellowship training do not count toward this requirement.

• Current or recent practice in an accredited or government-licensed clinical setting, including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations.

• Must be based in the United States, United Kingdom, Europe, or Australia. US-based candidates are preferred.

• Psychiatry must be the primary area of professional practice.

Preferred Qualifications

The following qualifications are valued but are not mandatory:

• 10+ hours per week of direct patient care, currently.

• Specialized expertise in one or more of the following areas:

• Addiction Psychiatry

• Child & Adolescent Psychiatry

• Forensic Psychiatry

• Geriatric Psychiatry

• Consultation-Liaison Psychiatry

• Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice.

• Experience developing or administering OSCEs, including examiner or assessment-development experience.

• Current or recent faculty appointment within a psychiatry department.

• Experience reviewing, evaluating, grading, or developing clinical or medical educational content.

Role Responsibilities

As part of the engagement, you may be asked to:

• Develop clinically challenging psychiatric scenarios for AI evaluation.

• Produce authoritative answers with transparent and well-structured clinical reasoning.

• Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases.

• Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment.

• Identify recurring failure modes in AI reasoning and communicate them clearly to research teams.

• Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards.

Screening Process

Qualified candidates will complete a 20–30 minute structured interview.

The screening conversation will focus on your clinical background, independent practice experience, psychiatric specialization, and relevant subspecialty expertise.

Engagement Details

• Role: Psychiatry Expert

• Work Arrangement: Fully Remote

• Engagement Type: Independent Contractor

• Location Eligibility: US, UK, Europe, or Australia

• Projects may be extended, shortened, or concluded based on project requirements and performance.

• Payments are made weekly based on services rendered through available payment platforms.

• The engagement does not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.

• H-1B and STEM OPT candidates are not currently supported.