Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

US Remote Physician, Medical AI Evaluation

US physicians review clinical EHR cases and assess medical reasoning for Mindrift’s AI programs. Part-time, project-based work focused on improving clinical AI systems.

Description

  • Review clinical EHR cases with questions, proposed answers, and distractor answers for diagnosis and treatment tasks
  • Assess clinical reasoning, case accuracy and completeness, answer correctness and gradeability, and distractor quality
  • Verify that each reasoning chain reaches its answer using only facts from the clinical case
  • Correct reasoning traces and provide brief rationales
  • Complete three independent blind reviews followed by physician adjudication
  • Meet task deadlines and the stated acceptance criteria

Requirements

  • Be a US-based, actively practicing physician with an MD or DO
  • Hold a medical degree (MD or DO)
  • Have an active, unrestricted US medical license verified by the issuing medical board
  • Be board-certified or have completed residency training
  • Have recent direct patient care experience; attending-level experience is preferred
  • Bring broad diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine
  • Demonstrate strong clinical reasoning, including differential diagnosis, next-step management, and use of evidence-based guidelines
  • Have strong written English skills at C1 level or higher
  • Be open to part-time, non-permanent project work
  • Not be a medical student, unlicensed medical graduate, non-physician clinician, or non-clinical healthcare professional

Benefits

  • Part-time opportunities on non-permanent, project-based assignments
  • Payment for each accepted task
  • Compensation of up to the equivalent of $130 per hour, depending on qualification tier and task efficiency

Related Jobs