Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Physician for Medical AI Evaluation

US-based physicians review clinical EHR vignettes and assess medical reasoning for Mindrift AI projects. Part-time, task-based work supports the improvement of AI systems for technology companies.

Description

  • Review clinical EHR vignettes with questions, proposed answers, and distractor answers for diagnosis and treatment tasks.
  • Evaluate cases across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
  • Rate clinical reasoning, vignette accuracy and completeness, answer correctness and gradeability, and distractor quality.
  • Verify that reasoning chains derive their answers solely from facts in the vignette.
  • Revise reasoning traces and provide brief rationales.
  • Take part in three independent blind reviews followed by physician adjudication.
  • Complete project work during active phases in line with requirements and acceptance criteria.

Requirements

  • Be a US-based, actively practicing physician with an MD or DO.
  • Hold an active, unrestricted US medical license verified by the issuing medical board.
  • Have board certification or completed residency training.
  • Have recent direct patient care experience; attending-level experience is preferred.
  • Bring broad diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine.
  • Demonstrate strong clinical reasoning in differential diagnosis, next-step management, and applying evidence-based guidelines.
  • Experience with medical AI evaluation, clinical content or exam-question review, or medical annotation and quality assurance is a plus.
  • Have strong written English proficiency at C1 level or higher.
  • This role is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or people in non-clinical healthcare roles.
  • Submit a CV in English and state your English proficiency level.
  • Meet the stated acceptance criteria and submit tasks by their deadlines.

Benefits

  • Project-based participation.
  • Part-time projects with no permanent employment.
  • Earn up to the equivalent of $130 per hour, with payment for each accepted task.
  • Flexible workload estimated at about 10–20 hours per week during active project phases.

Related Jobs

SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 Employees

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

Open