Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Remote Physician (MD/DO) for Medical AI Evaluation

U.S.-based physicians review clinical vignettes, diagnostic reasoning, and treatment responses. Their benchmark assessments help improve Mindrift’s medical AI systems.

Description

  • Review clinical EHR vignettes and related questions, proposed answers, and distractor answers for diagnostic and treatment tasks.
  • Assess clinical reasoning, vignette accuracy and completeness, answer correctness and gradeability, and distractor quality.
  • Verify that each reasoning chain derives its answer solely from the facts in the vignette.
  • Edit reasoning traces and provide concise rationales.
  • Participate in three independent blind reviews followed by physician adjudication.
  • Work approximately 10–20 hours per week during active project phases.
  • Meet deadlines and satisfy the stated acceptance criteria.

Requirements

  • Be a U.S.-based, actively practicing MD or DO.
  • Hold a medical degree (MD or DO).
  • Have an active, unrestricted U.S. medical license verified by the issuing medical board.
  • Be board-certified or have completed residency training.
  • Have recent direct patient-care experience; attending-level experience is preferred.
  • Bring broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
  • Demonstrate strong clinical reasoning, including differential diagnosis, next-step management, and use of evidence-based guidelines.
  • Experience with medical AI evaluation, clinical content or exam-question review, or medical annotation and quality assurance is a plus.
  • Have strong written English proficiency (C1 or higher).
  • This role is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or people in non-clinical healthcare roles.
  • Be able to meet deadlines and acceptance criteria.

Benefits

  • Project-based participation.
  • Part-time, non-permanent projects.
  • Compensation of up to the equivalent of $130 per hour, paid per accepted task.

Related Jobs

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions
201 – 500 Employees
HealthcareHospitalityLogistics

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Open
SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 Employees

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

Open