Mercor
Mercor
51 – 200 Employees
Mercor’s available profile does not include enough verified information about its products, services, customers, sector, or hiring focus to support an accurate company overview. More source material is needed before describing the business or its opportunities.

AI Safety Expert (English and Gujarati) – Remote Contract

Conduct red-team evaluations of conversational AI models and agents for Mercor, an AI lab partner focused on training frontier systems. Create vulnerability data, attack scenarios, and reproducible safety reports.

Description

  • Test conversational AI models and agents using jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation
  • Create human-labeled data by annotating failures, categorizing vulnerabilities, and identifying systemic risks
  • Use established taxonomies, benchmarks, and playbooks to ensure consistent evaluations
  • Develop reproducible reports, datasets, and attack scenarios
  • Assess AI responses involving bias, misinformation, harmful behavior, and other sensitive topics
  • Identify weaknesses that automated testing may overlook
  • Broaden evaluation coverage to help limit unexpected issues in production
  • Improve customer AI systems with clear, reproducible evaluation artifacts

Requirements

  • Native or fluent English and Gujarati proficiency
  • Sound judgment when evaluating language and content
  • Ability to determine whether AI responses are accurate, complete, and appropriate, and to explain the assessment
  • Careful attention to subtle errors, inconsistencies, and omissions
  • Consistent adherence to guidelines and quality requirements
  • Ability to communicate reasoning clearly to technical and non-technical audiences
  • Flexibility across projects, task formats, and customers
  • Preferred expertise in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing
  • Availability to work as an independent contractor
  • H-1B and STEM OPT candidates are not supported

Benefits

  • Work fully remotely
  • Choose your own working schedule
  • Receive weekly payments through Stripe or Wise
  • Competitive hourly compensation
  • Option to participate in projects involving higher-sensitivity content
  • Access clear guidance and wellness resources for sensitive-content work
  • Reasonable accommodations available upon request
  • Earn referral payments of up to $90 for each successful referral

Related Jobs