D
Defcon AI
Defcon AI dezvoltă software bazat pe inteligență artificială pentru operațiunile de logistică, transport și lanț de aprovizionare. Tehnologia sa combină modelarea software cu agenți inteligenți pentru a ajuta organizațiile să planifice și să răspundă perturbărilor cauzate de dezastre naturale, evenimente neașteptate și condiții contestate. Compania activează la intersecția dintre inteligența artificială, mobilitate și logistică și colaborează cu parteneri pentru a furniza instrumente bazate pe date, concepute să îmbunătățească reziliența operațională, procesul decizional și eficiența răspunsului.

Model Test and Measurement Engineer – United States Remote

Defcon AI is seeking a Model Test and Measurement Engineer to independently validate AI systems. The role covers ground-truth development, model audits, workflow measurement, and evidence for responsible release decisions.

Descriere

  • Build labeled ground truth for model evaluation
  • Plan and conduct sampled audits
  • Gate releases by model version while maintaining version inventories, evaluation records, and rollback triggers
  • Review model drift and override activity
  • Develop evidence on human oversight, fairness, and disparate effects
  • Remain independent of model-building teams and deliver evaluation evidence without building models, setting thresholds, or approving releases based on that evidence
  • Measure workflow improvements through review time, throughput, backlog movement, override rates, and rework rates
  • Establish evaluation-stage quality controls for sample selection, review units, and fair comparisons across methods or searched sources
  • Specify measurement events required from other teams and verify that the review workspace records workflow events from initial use
  • Collaborate with data scientists, AI engineers, and technical leadership
  • Support release decisions, improvement initiatives, and customer evaluations through independent assessments

Cerințe

  • At least 5 years of experience with model validation as a defined responsibility
  • Hands-on experience constructing ground truth and designing sampling approaches
  • Strong Python and SQL skills
  • Ability to work independently from the teams whose models you evaluate
  • US citizenship required
  • Active US Secret clearance
  • Willingness to meet elevated personnel security requirements for portions of the work, as discussed during screening
  • Background in regulated-industry or government model risk
  • Experience testing fairness and disparate effects and documenting human oversight
  • Familiarity with the NIST AI Risk Management Framework or a comparable practice
  • Active Top Secret clearance

Beneficii

  • Competitive salary with bonus and equity
  • Fully remote, results-oriented work environment
  • Employer-paid medical, dental, and vision coverage for you and your family
  • Unlimited paid time off with manager approval
  • Flexible scheduling with autonomy over your workday
  • 14 weeks of fully paid parental leave
  • Occasional travel to DEFCON AI headquarters, customer sites, and partner facilities as needed

Locuri de muncă similare

Knowtion Health

Remote Talent Acquisition Manager

Knowtion Health

Oversee recruiting systems, requisitions, analytics, and contingent workforce operations at Knowtion Health. Help support scalable hiring processes for a growing healthcare company.

Deschide
Napco National

Purchasing Coordinator, Saudi Arabia (Remote)

Napco National

Coordinate purchasing operations for a manufacturing business in Saudi Arabia, from purchase orders and supplier deliveries to customs paperwork and material transfers. Support shipment clearance, invoice processing, supplier claims, and product certificate renewals.

Deschide
Terumo Medical Corporation

Region Manager, Terumo Interventional Systems Sales

Terumo Medical Corporation

Lead medical device sales across a North Central New Jersey region, managing field teams and hospital relationships. Drive regional revenue, sales performance, and compliant promotion of Terumo Interventional Systems products.

Deschide