Mercor AI Safety Expert – English and Gujarati, US Remote Contract
Conduct human-led red-team evaluations of conversational AI models and agents for Mercor. Generate vulnerability data, attack scenarios, and reproducible safety assessments in English and Gujarati.
Description
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation
- Annotate failures, categorize vulnerabilities, and escalate systemic risks
- Use established taxonomies, benchmarks, and playbooks to maintain consistent evaluations
- Create reproducible reports, datasets, and attack scenarios
- Assess AI outputs involving bias, misinformation, harmful behavior, and other sensitive topics
- Detect weaknesses that automated testing may overlook
- Broaden evaluation coverage and help limit unexpected production issues
- Improve customer AI systems through human-generated, data-driven red teaming
Requirements
- Native-level fluency in English and Gujarati
- Sound judgment when evaluating language and content
- Ability to determine whether AI responses are accurate, complete, and appropriate, and explain the assessment
- Strong attention to subtle errors, inconsistencies, and omissions
- Consistent adherence to guidelines and quality standards
- Clear communication of reasoning to both technical and non-technical audiences
- Flexibility across projects, task formats, and customers
- Willingness to work as an independent contractor
- Must not be an H-1B or STEM OPT candidate
- Preferred expertise in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing
Benefits
- Fully remote contract work
- Flexible scheduling
- Weekly payments through Stripe or Wise
- Option to participate in higher-sensitivity projects
- Guidance and wellness resources for work involving sensitive content
- Competitive compensation
- Opportunity to collaborate with leading researchers
- Reasonable accommodations available upon request
- Referral program offering up to $90 for each successful referral