Red Cell Partners
Red Cell Partners
Red Cell Partners builds and grows technology companies serving healthcare, cybersecurity, and national security. Its venture-building model combines investment, company creation, and operational support to develop solutions for complex challenges in these fields. The organization works with entrepreneurs, operators, and technologists to move ideas from early development toward market-ready companies.

Lead AI Researcher, Member of Technical Staff

Develop evaluation frameworks, reinforcement learning environments, and feedback systems at Red Cell Partners’ stealth startup. Advance reliable AI for healthcare, government, and regulated industries.

Description

  • Create evaluation frameworks and benchmarks for frontier language models, AI agents, multimodal systems, and reinforcement learning environments.
  • Build reward models, automated verifiers, graders, and feedback systems to measure and improve model behavior.
  • Run controlled fine-tuning and reinforcement learning experiments to assess how datasets affect model capability, generalization, and alignment.
  • Identify evaluation methods that reflect real-world work and operational settings.
  • Develop systems for high-quality human data, including expert task design, annotation methods, data-quality signals, and attribution techniques.
  • Turn research questions into focused, rigorous experiments that produce actionable findings.
  • Rapidly prototype, assess results, diagnose failures, and use findings to improve benchmarks, datasets, or technical systems.
  • Advance promising methods from experiments into scalable, production-ready implementations.
  • Coordinate across research, engineering, product, and operations to deliver a shared technical roadmap.
  • Contribute to the technical community with benchmarks, open-source tools, research, and technical writing.

Requirements

  • At least five years of relevant experience in machine learning, AI, computer science, data science, software engineering, or a related technical field.
  • Ability to work across AI research and software engineering.
  • Strong Python skills and experience building reliable, scalable software.
  • Practical experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems.
  • Strong knowledge of frontier AI methods, including benchmarks, evaluation techniques, agent harnesses, post-training approaches, and training-data design.
  • Experience developing or using reward models, automated verifiers, graders, or other model-feedback systems.
  • Experience designing evaluations or experiments to measure model capability, generalization, alignment, or agent performance.
  • Ability to build research prototypes and turn them into maintainable, production-quality systems.
  • Strong analytical, problem-solving, written communication, and technical documentation skills.
  • U.S. citizenship required.
  • An advanced degree in machine learning, AI, computer science, data science, or a related field is preferred but not required.
  • Applicants with equivalent research and engineering experience, including strong technical, open-source, or published work, are encouraged to apply.

Benefits

  • Career-track role with potential for rapid advancement based on strong performance as the firm grows.
  • Employer-paid medical, dental, and vision coverage for employees and their families.
  • Fourteen weeks of paid maternity and paternity leave at normal pay.
  • Unlimited paid time off, subject to management approval.
  • Professional development and continued learning opportunities.
  • Optional 401(k), FSA, and equity incentives.
  • Mental health benefits through Tara Mind.
  • Cost-effective GLP-1 solutions through Crux.

Related Jobs

Hewlett Packard Enterprise

Principal AI Engineer, Remote in the United States

Hewlett Packard Enterprise

Lead the research, architecture, and deployment of scalable AI and machine learning systems for Hewlett Packard Enterprise’s edge-to-cloud business. The role also includes technical leadership and mentorship.

Open