Mercor
This role evaluates AI model outputs for clinical accuracy, safety, and alignment with medical standards. It involves scoring diagnoses, case reasoning, and care recommendations, writing structured feedback, flagging failure modes that compromise patient safety, and collaborating asynchronously with AI researchers to improve model performance.
Key Responsibilities
- • Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards.
- • Score diagnoses, case reasoning, and care recommendations against expert judgment.
- • Write structured feedback on clarity, safety, and clinical rigor.
- • Flag failure modes that compromise patient safety.
- • Collaborate asynchronously with AI researchers to improve model performance.
Required
- • 2+ years of clinical practice in the US.
- • Practice across primary care, internal medicine, public health, hospital-based, or mental health specialties.
- • MD or DO from a reputable medical school.
- • Sharp attention to detail and clear written communication.
- • Located in the US, UK, or Canada.
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Physician (Generalist)
Type: Contract
Compensation: $150/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week
Role Responsibilities
- Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical standards.
- Score diagnoses, case reasoning, and care recommendations against expert judgment.
- Write structured feedback on clarity, safety, and clinical rigor.
- Flag failure modes that compromise patient safety.
- Collaborate asynchronously with AI researchers to improve model performance.
Must-Have
- 2+ years of clinical practice in the US.
- Practice across primary care, internal medicine, public health, hospital-based, or mental health specialties.
- MD or DO from a reputable medical school.
- Sharp attention to detail and clear written communication.
- Located in the US, UK, or Canada.
- Immediate
- Upload your resume and application form.
- Complete a 25-minute conversational interview on your background, experience, and motivations.
- Receive next steps and onboarding details within a few days.
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
#hiringmercor
Keep track of your job search
Save personal notes for each job to track your thoughts, application status, and follow-ups.
Try for freeUpload your resume
Sign up to upload your resume and get AI-powered customization for job applications.
Sign up freePractice your interview
Get AI-powered mock interviews tailored to this Medical Evaluator - Clinical Expertise - AI Trainer role. Upload your resume and practice with real-time voice feedback.
Sign up to practice