Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Physician, Medical AI Evaluation

US physicians review clinical EHR cases and assess reasoning quality for Mindrift’s medical AI projects. Part-time, project-based work supporting the improvement of clinical AI systems.

Description

  • Review clinical EHR vignettes and related questions, proposed answers, and distractors for diagnosis and treatment tasks
  • Assess cases across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems
  • Rate clinical reasoning, case accuracy and completeness, answer disclosure and correctness, gradeability, and distractor quality
  • Verify that each reasoning chain derives its answer solely from facts in the vignette
  • Revise reasoning traces and provide brief rationales
  • Take part in three independent blind reviews, followed by physician adjudication
  • Work about 10–20 hours weekly during active project phases and submit tasks on time in line with acceptance criteria

Requirements

  • Be a US-based, actively practicing physician (MD or DO)
  • Hold a medical degree (MD or DO)
  • Have an active, unrestricted US medical license verified by the issuing medical board
  • Have board certification or completed residency training
  • Have recent direct patient care experience; attending-level experience is preferred
  • Bring broad diagnostic and treatment experience across multiple systems in internal, family, emergency, or hospital medicine
  • Demonstrate strong clinical reasoning in differential diagnosis, next-step management, and evidence-based guideline use
  • Have strong written English proficiency (C1 or higher)
  • This opportunity is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare professionals

Benefits

  • Participate on a project basis
  • Access part-time project opportunities
  • Receive payment for each accepted task
  • Earn the equivalent of up to $130 per hour, depending on qualification tier and task efficiency

Related Jobs

Active Nutrition International GmbH

Senior Procurement Specialist – Packaging and Raw Materials

Active Nutrition International GmbH

Lead operational procurement for packaging and raw materials at a sports nutrition company, covering supplier relationships, negotiations, and market analysis. Take primary responsibility for related audit processes and support new product launches and cost efficiency projects.

Open