LogoFresh Jobs Ahead
Mercor
Mercor
51 – 200 Employees
Mercor’s available profile does not include enough verified information about its products, services, customers, sector, or hiring focus to support an accurate company overview. More source material is needed before describing the business or its opportunities.
LinkedIn
Company Jobs

AI Safety Expert – English and Telugu (Remote Contract)

Conduct red-team evaluations of conversational AI models and agents for Mercor, identifying vulnerabilities through adversarial testing. Create high-quality datasets, attack cases, and clear reports focused on English and Telugu language performance.

USUnited States
$16 – $22 / hour
RemoteContractMiddleSeniorEnglish RequiredTelugu RequiredArtificial Intelligence
Cyber Security

Description

  • Test conversational AI models and agents against jailbreaks, prompt injection, misuse scenarios, bias exploitation, and multi-turn manipulation
  • Create human-generated data by labeling failures, categorizing vulnerabilities, and identifying systemic risks
  • Use established taxonomies, benchmarks, and playbooks to ensure consistent evaluations
  • Develop reproducible reports, datasets, and adversarial attack cases
  • Assess AI responses related to bias, misinformation, harmful behavior, and other sensitive subjects
  • Identify weaknesses that automated evaluation methods may overlook
  • Broaden evaluation coverage to help prevent unexpected production issues
  • Improve customer AI systems through structured adversarial testing

Requirements

  • Native-level fluency in both English and Telugu
  • Sound judgment when evaluating language and content
  • Ability to determine whether AI responses are accurate, complete, and appropriate, and to explain the reasoning
  • Exceptional attention to subtle errors, inconsistencies, and omissions
  • Consistent adherence to guidelines and quality standards
  • Ability to communicate reasoning clearly to technical and non-technical audiences
  • Flexibility to work across different projects, task formats, and customers
  • Ability to work as an independent contractor
  • Must not require H-1B or STEM OPT sponsorship
  • Experience in adversarial machine learning, cybersecurity, sociotechnical risk, or creative probing is preferred

Benefits

  • Work fully remotely
  • Choose a flexible schedule that fits your availability
  • Receive weekly payments through Stripe or Wise
  • Project duration may change or end early based on business needs and performance
  • Access wellness resources and clear guidance for higher-sensitivity assignments
  • Build experience in human-data-driven AI red teaming
  • Help make AI systems more robust, safe, and trustworthy
  • Receive competitive payment
  • Collaborate with leading researchers
  • Reasonable accommodations are available upon request

Related Jobs