
Widget Factory creates training environments that help advanced AI models learn to tackle practical work. Its team of engineers, operators, and domain experts designs tasks and systems that challenge models to resolve ambiguous problems, coordinate across tools, and make decisions with incomplete information. The company focuses on combining human judgment with machine capability, and its work brings together more than 100 Problem Design Engineers. Widget Factory operates in artificial intelligence, enterprise software, and SaaS.
Cybersecurity RL Environment Reviewer
Review defensive security and infrastructure security reinforcement learning environments for realism, grading accuracy, and forensic solvability before customer delivery.
Description
- Assess security scenarios for realism, reproducibility, and solvability using the supplied context
- Check that detection and remediation grading distinguishes correct fixes from incorrect or incomplete ones
- Confirm planted forensic artifacts can be recovered using sound methods
- Identify inconsistent files, missing context, unclear requirements, and ambiguities
- Provide a concise explanation for each review decision
- Complete a paid sample review of one task, taking approximately 30 to 45 minutes, before beginning regular work
Requirements
- Hands-on experience in at least one area: SOC or detection engineering, incident response, cloud security involving AWS, GCP, or Azure IAM and misconfigurations, or digital forensics
- Comfort using logs, cloud consoles or CLIs, and a common detection rule language such as Sigma or KQL, a SIEM's native query language, or standard forensic tools
- Able to explain clearly in writing why a finding is realistic or not and whether it has been graded correctly
- Reliable and self-directed, with comfort working asynchronously and with limited oversight
- A certification such as GCIH, GCFA, GREM, CISSP, or a cloud security credential such as AWS Security Specialty is preferred
- Professional experience building or tuning detection content is preferred
- Forensics or miscellaneous category CTF experience, or prior blue team competition experience, is preferred
- Currently authorized to work in the United States
- Must state whether work sponsorship will ever be needed
Benefits
- Part-time contract work with flexible hours
- Paid sample review before regular work begins