LogoFresh Jobs Ahead
mpathic
mpathic
11 – 50 Xodimlar
KonsaltingOziq-ovqat va ichimliklarSog‘liqni saqlash
mpathic inson va sun’iy intellekt, shuningdek insonlar o‘rtasidagi o‘zaro munosabatlarni tushunish va yaxshilash uchun sun’iy intellekt xavfsizligi hamda tahliliy dasturiy ta’minot ishlab chiqadi. Uning SaaS mahsulotlari va API’lari nutqni matnga transkripsiya qilish, shaxsni aniqlash imkonini beruvchi ma’lumotlarni yashirish, xulq-atvor va tekshiruv ro‘yxatlarini tahlil qilish, taqqoslash ma’lumotlar to‘plamlari, qizil jamoa sinovlari hamda Observing Agent API orqali sohaga oid bilimlarga asoslangan xavfsizlik cheklovlarini qo‘llab-quvvatlaydi. Kompaniya empatiyani kuchaytirish, tarafkashlikni kamaytirish va xavfsizroq, talablarga ko‘proq mos o‘zaro munosabatlarni ta’minlashga intiladigan sog‘liqni saqlash, hayot fanlari, klinik tadqiqotlar, sug‘urta va korporativ jamoalarga xizmat ko‘rsatadi.
LinkedIn
Kompaniyadagi ish o‘rinlari

Healthcare AI/ML Evaluation Reviewer

Review evidence for healthcare AI applications in mpathic’s regulatory sandbox evaluations. Assess model validation, reliability, safeguards, and monitoring for clinical use.

USAmerika Qo‘shma ShtatlariMasofaviyShartnomaO‘rta darajaSeniorTalab Qilinadigan Til: inglizchaSun’iy intellekt

Tavsif

  • Assess technical evidence for healthcare AI applications, covering performance, validation, generalizability, reliability, monitoring, and safeguards.
  • Review validation methods, reference standards, sample sizes, statistical analyses, metrics, operating thresholds, and uncertainty.
  • Examine data quality and representativeness, including leakage, subgroup differences, and generalizability across patient groups and care settings.
  • Test technical reliability, robustness, reproducibility, failure modes, and behavior on atypical or out-of-distribution inputs.
  • Review evaluation plans, benchmarks, and success criteria for pilot deployments.
  • Assess technical safeguards, escalation paths, and human oversight processes.
  • Review monitoring and change-management plans for detecting performance decline, tracking model behavior, managing updates and interventions, and setting rollback criteria.
  • Work with clinicians and technical specialists to address cross-disciplinary concerns.
  • Record strengths, limitations, evidence gaps, and technical concerns using the standard review framework.
  • Give clear, evidence-based recommendations and specify needed evidence or changes.
  • Take part in reviewer calibration and quality assurance.
  • Maintain independence and confidentiality, following conflict-of-interest and data-handling requirements.

Talablar

  • At least three years of professional or applied research experience in machine learning, data science, biostatistics, clinical informatics, or a related field, including direct work evaluating or validating predictive models or AI systems.
  • Understanding of model evaluation methods, including suitable performance metrics, validation design, statistical uncertainty, threshold selection, and common sources of bias or methodological error.
  • Experience evaluating model performance on independent or held-out data and judging whether results generalize beyond the evaluation dataset.
  • Practical experience evaluating at least one relevant AI system type, such as clinical NLP, large language models, conversational AI, medical imaging, computer vision, or tabular predictive models.
  • Ability to critically review technical research, evaluation reports, or validation studies and identify methodological weaknesses or unsupported conclusions.
  • Strong analytical writing skills and the ability to explain complex findings clearly to nontechnical audiences.
  • Ability to work independently and contribute to multidisciplinary expert review and calibration.
  • Willingness to complete confidentiality agreements, conflict-of-interest disclosures, and reviewer training.
  • Experience evaluating AI or ML systems in healthcare, clinical decision support, digital health, or another high-stakes setting.
  • Familiarity with clinical AI evaluation and reporting frameworks such as TRIPOD+AI, STARD-AI, CONSORT-AI, DECIDE-AI, or model cards.
  • Experience evaluating generative AI, LLM-based systems, or autonomous agents, including multi-turn behavior, reliability, hallucinations, and safeguards.
  • Experience with robustness testing, adversarial evaluation, red teaming, or systematic failure-mode analysis.
  • Knowledge of production monitoring, distribution shift, model drift, version control, and change management.
  • Experience designing or evaluating human-in-the-loop systems or comparing model performance with human expert judgments.
  • Familiarity with FDA guidance on AI-enabled medical devices, clinical decision support, or software as a medical device.
  • Experience conducting independent technical reviews, scientific peer reviews, grant reviews, or formal technology evaluations.
  • Experience working with clinicians, researchers, or regulatory stakeholders on AI evaluation or deployment.

Imtiyozlar

  • Contract work with payment per review.
  • Reviewer orientation covering the evaluation framework and project requirements before the first assignment.

O‘xshash ish o‘rinlari

Volga Partners

Healthcare Subject Matter Expert, AI Model Evaluation

Volga Partners
1 001 – 5 000 Xodimlar
H1B vizasi homiysiB2BKorxonaSun’iy intellekt
AUAvstraliyaCAKanadaGBBuyuk BritaniyaINHindistonNZYangi ZelandiyaPHFilippinUSAmerika Qo‘shma Shtatlari
35 $ – 150 $ / soat
MasofaviyShartnomaO‘rta darajaSeniorTalab Qilinadigan Til: inglizchaSun’iy intellekt

Volga Partners seeks physicians, nurse practitioners, and physician assistants to assess the clinical accuracy, reasoning, and safety of AI-generated medical content. Remote, project-based contract assignments vary according to project needs.

Ochish