Mercor
Mercor
51 – 200 Employees
Mercor’s available profile does not include enough verified information about its products, services, customers, sector, or hiring focus to support an accurate company overview. More source material is needed before describing the business or its opportunities.

Remote AI Safety Expert – English and Gujarati

Conduct adversarial testing of partner AI models and agents to identify vulnerabilities, bias, and harmful behaviors. Create annotated datasets, attack cases, and reproducible reports that improve frontier AI evaluations.

Description

  • Test conversational AI models and agents with jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation
  • Create human-generated data by annotating failures, categorizing vulnerabilities, and identifying systemic risks
  • Apply established taxonomies, benchmarks, and playbooks to maintain consistent evaluations
  • Develop reproducible reports, datasets, and attack cases for customers
  • Evaluate AI responses involving bias, misinformation, harmful behavior, and other sensitive topics
  • Find weaknesses that automated testing does not detect
  • Broaden evaluation coverage to help reduce unexpected production issues
  • Improve customer AI systems through structured adversarial testing

Requirements

  • Native fluency in English and Gujarati is required
  • Demonstrated judgment in evaluating language and content, including whether AI responses are accurate, complete, and appropriate, with the ability to explain the assessment
  • Strong attention to subtle errors, inconsistencies, and omissions
  • Ability to apply guidelines and quality standards consistently
  • Ability to communicate reasoning clearly to both technical and non-technical audiences
  • Flexibility to work across different projects, task types, and customers
  • Engagement is structured as an independent contractor arrangement
  • Applicants must not be H-1B or STEM OPT candidates
  • Preferred backgrounds include adversarial machine learning, cybersecurity, socio-technical risk, or creative probing

Benefits

  • Work fully remotely on a schedule you control
  • Receive weekly payments through Stripe or Wise for services rendered
  • Choose whether to participate in higher-sensitivity projects
  • Access clear guidance and wellness resources for projects involving sensitive content
  • Competitive pay
  • Collaborate with leading researchers
  • Earn referral payments of up to $90 per successful referral, subject to applicable limits

Related Jobs

Ameriprise Financial Services, LLC

Senior Manager, Data Products and AI Engineering

Ameriprise Financial Services, LLC
5,001 – 10,000 Employees
ConsultingFinanceInsurance

Lead technical delivery of analytics, data products, and AI applications for Ameriprise Financial’s asset management distribution business. Guide data engineering, business intelligence, generative AI, and retrieval-augmented generation initiatives.

Open