Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Remote Physician, Medical AI Evaluation (Colorado)

US physicians assess clinical vignettes, diagnostic reasoning, and treatment responses for Mindrift’s medical AI projects. Part-time, project-based work focused on improving evaluation quality.

Description

  • Review clinical EHR vignettes, questions, proposed responses, and distractor answers for diagnosis and treatment tasks.
  • Assess reasoning quality, vignette accuracy and completeness, answer correctness and gradeability, and distractor quality.
  • Verify that conclusions follow from the facts provided in each vignette.
  • Revise reasoning traces and provide brief explanations.
  • Participate in three separate blind reviews, followed by physician adjudication.
  • Work during active project periods, meet submission deadlines, and satisfy acceptance standards.

Requirements

  • Be a US-based, actively practicing physician (MD or DO).
  • Hold a medical degree (MD or DO).
  • Have an active, unrestricted US medical license, verified by the issuing medical board.
  • Be board-certified or have completed residency training.
  • Have recent direct patient-care experience; attending-level experience is preferred.
  • Bring broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
  • Demonstrate strong clinical reasoning in differential diagnosis, next-step management, and use of evidence-based guidelines.
  • Experience in medical AI evaluation, clinical content or exam-question review, or medical annotation or quality assurance is preferred.
  • Have strong written English skills at C1 level or higher.
  • This role is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or people in non-clinical healthcare roles.
  • Submit a CV in English and state your English proficiency level.

Benefits

  • Project-based participation.
  • Part-time work on non-permanent projects.
  • Pay is up to the equivalent of $130 per hour, issued per accepted task; this is not a guaranteed hourly base rate.

Related Jobs

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions
201 – 500 Employees
HealthcareHospitalityLogistics

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Open
SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 Employees

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

Open