Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Remote Physician AI Trainer (MD/DO)

Mindrift seeks US-based physicians to assess clinical vignettes and reasoning for medical AI projects. Part-time, project-based work pays up to $130 per hour for accepted tasks.

Description

  • Review EHR vignettes and related questions, proposed answers, and distractor traps for diagnosis and treatment tasks.
  • Assess clinical reasoning, vignette accuracy and completeness, answer correctness and gradeability, and the quality of distractor traps.
  • Verify that each reasoning chain reaches its conclusion using only facts in the vignette.
  • Revise reasoning traces and provide concise rationales.
  • Complete three independent blind reviews, followed by physician adjudication.
  • Deliver project tasks on time and meet the stated acceptance criteria.

Requirements

  • Be a US-based, actively practicing physician (MD or DO).
  • Hold an MD or DO degree.
  • Have an active, unrestricted US medical license, verified with the issuing medical board.
  • Be board-certified or have completed residency training.
  • Have recent direct patient-care experience; attending-level experience is preferred.
  • Bring broad, multisystem diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
  • Demonstrate strong clinical reasoning in differential diagnosis, next-step management, and applying evidence-based guidelines.
  • Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation and quality assurance is a plus.
  • Have strong written English proficiency (C1 or higher).
  • This role is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or people in non-clinical healthcare roles.
  • Be available for approximately 10–20 hours per week during active project phases and meet task deadlines and acceptance criteria.

Benefits

  • Part-time, project-based engagement.
  • Payment is provided for each accepted task.
  • Effective pay can reach $130 per hour, depending on qualification tier and task efficiency.

Related Jobs