Anyone AI
Anyone AI
Anyone AI is a Latin America–focused education and talent platform helping software engineers develop careers in artificial intelligence and machine learning. Its remote, mentor-led programs combine technical training, including a Machine Learning Developer track, with career preparation such as resume and LinkedIn guidance, interview coaching, and English practice. The company also operates a talent marketplace that connects its trained community with employers seeking AI professionals, alongside a placement-oriented model that includes income-share payments and employer partnerships.

AI Agent Evaluator (Argentina, Remote)

Compare two AI assistants on their use of personal context and connected services. Provide structured feedback to support frontier model training.

Description

  • Assess how well AI assistants understand users, apply personal context, and hold useful conversations
  • Create prompts based on your questions, interests, or needs
  • Have natural, multi-turn conversations with two AI assistants
  • Ask questions that draw on connected service information or activity when relevant
  • Compare how well each assistant uses available information and connects relevant context
  • Judge whether responses are helpful, natural, trustworthy, and safe
  • Assess how each assistant handles feedback and corrections
  • Explain the reasoning behind your evaluations clearly
  • Verify the digital services you currently use and your recent activity

Requirements

  • Fluency in at least one supported language or locale: Latin American Spanish, Arabic, Brazilian Portuguese, Japanese, Turkish, Indonesian, Hindi, Korean, French, German, or English
  • Strong reading comprehension and the ability to explain feedback clearly
  • Careful attention to detail and sound judgment when comparing conversational experiences
  • Willingness to use relevant personal context and connected services while interacting with AI assistants
  • Recent activity across a qualifying combination of digital services
  • Completion of project eligibility verification and any corresponding expert requirements
  • Experience using AI assistants for everyday questions, planning, or research is preferred
  • Previous experience in AI evaluation, user research, or quality assurance is preferred
  • Ability to notice subtle differences in relevance, personalization, and conversation quality is preferred

Benefits

  • Part-time independent contractor arrangement
  • Project lasting up to three months
  • Remote work
  • Contribute to training and evaluating frontier AI models
  • May be considered for other AI evaluation projects if not eligible for this one

Related Jobs