AI Safety Expert (English and Tamil) – Remote Contract
Mercor is seeking an English- and Tamil-speaking AI safety expert to red-team conversational models and agents. The contract role focuses on identifying vulnerabilities, generating evaluation data, and producing reproducible safety reports.
Description
- Conduct adversarial testing of conversational AI models and agents using jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.
- Create human-generated data by annotating failures, categorizing vulnerabilities, and identifying systemic risks.
- Use established taxonomies, benchmarks, and playbooks to maintain consistent evaluations.
- Deliver reproducible reports, datasets, and attack cases for customers.
- Assess AI outputs involving sensitive subjects, including bias, misinformation, and harmful behavior.
- Identify weaknesses that automated evaluation methods may overlook.
- Broaden evaluation coverage to help minimize unexpected production issues.
- Improve customer AI systems through structured adversarial testing.
Requirements
- Native or fluent English and Tamil language skills.
- Sound judgment when evaluating language and content.
- Ability to determine whether AI responses are accurate, complete, and appropriate, and explain the reasoning.
- Strong attention to subtle errors, inconsistencies, and omissions.
- Consistent adherence to guidelines and quality standards.
- Ability to communicate reasoning clearly to both technical and non-technical audiences.
- Adaptability across projects, task formats, and customers.
- Ability to work as an independent contractor.
- H1-B and STEM OPT candidates are not supported.
- Preferred: adversarial machine learning experience with jailbreak datasets, prompt injection, RLHF or DPO attacks, or model extraction.
- Preferred: cybersecurity experience in penetration testing, exploit development, or reverse engineering.
- Preferred: socio-technical risk experience involving harassment or disinformation probing, abuse analysis, or conversational AI testing.
- Preferred: creative probing experience in psychology, acting, or writing.
Benefits
- Fully remote work.
- Flexible scheduling with the ability to set your own hours.
- Weekly payments through Stripe or Wise.
- Optional participation in higher-sensitivity projects.
- Clear guidance and wellness resources for work involving sensitive content.
- Competitive hourly pay.
- Opportunity to collaborate with leading researchers.
- Referral payments of up to $90 per successful referral, subject to applicable limits.
- Reasonable accommodations available upon request.