Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Physician for Medical AI Evaluation

US physicians assess clinical EHR vignettes and the quality of medical reasoning. Mindrift offers specialists project-based AI work for technology companies.

Description

  • Assess clinical EHR vignettes, questions, proposed answers, and distractor answers across diagnosis and treatment tasks.
  • Review cases across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
  • Rate clinical reasoning, vignette accuracy and completeness, answer correctness and gradeability, answer leakage, and distractor quality.
  • Check that reasoning chains derive their answers from the vignette facts alone.
  • Edit reasoning traces and provide brief explanations.
  • Take part in three independent blind reviews, followed by physician adjudication.
  • Work approximately 10–20 hours per week during active project phases.

Requirements

  • Be a US-based, actively practicing physician with an MD or DO.
  • Hold an active, unrestricted US medical license verified with the issuing medical board.
  • Have board certification or completed residency training.
  • Have recent direct patient care experience; attending-level experience is preferred.
  • Bring broad diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.
  • Demonstrate strong clinical reasoning, including differential diagnosis, next-step management, and use of evidence-based guidelines.
  • Have strong written English skills at C1 level or higher.
  • Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation or quality assurance is a plus.
  • This work is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or people in non-clinical healthcare roles.
  • Submit tasks by their deadlines and meet the stated acceptance criteria.

Benefits

  • Project-based participation.
  • Part-time, non-permanent projects.
  • Payment is per accepted task.
  • Rates can reach the equivalent of $130 per hour, depending on qualification tier and task efficiency.

Related Jobs

Walmart

Principal Software Engineer, Cloud and Distributed Systems

Walmart

Lead Walmart’s cloud-native, AI-enabled mGPS/Compass platform, shaping distributed services and indoor routing. Improve in-store operations through resilient architecture and technical leadership.

Open
Cartonplast Group

Senior ERP Software Development Team Lead – Cartonplast, Hybrid Germany

Cartonplast Group

Lead Cartonplast’s ERP development team and shape commercial, logistics, and production workflows. The role combines team leadership, business coordination, and hands-on technical input in a hybrid setup in Germany.

Open