Terac
Terac
Terac is an artificial intelligence company building B2B market research tools for faster customer insight. Its platform helps companies find research participants, run interviews with diverse audiences, and analyze the resulting feedback in hours instead of weeks. By bringing participant sourcing, interviewing, and analysis into one workflow, Terac supports teams that need timely evidence for product and business decisions.

Contract Software Engineer – AI Evaluation (Remote, United States)

Review realistic programming tasks, coding environments, and AI evaluation harnesses for quality, accuracy, complexity, and realism. Provide expert feedback to Terac, a platform connecting AI researchers with vetted human experts.

Description

  • Review realistic programming tasks for quality and technical accuracy
  • Evaluate coding environments and harnesses used for AI testing
  • Identify potential flaws in provided code structures
  • Give feedback on the difficulty and realism of coding challenges
  • Assess the complexity and realism of programming evaluations
  • Explain how evaluation environments work
  • Compare evaluation environments with common industry practices

Requirements

  • Professional experience working as a software engineer or developer
  • Experience building or validating programming tasks
  • Background in code review and evaluation harnesses
  • Ability to discuss technical architecture and testing methodologies
  • Hands-on experience building, reviewing, or testing realistic programming tasks
  • Familiarity with evaluation harnesses
  • Open to full-stack developers, backend engineers, test automation engineers, and systems architects

Benefits

  • Paid participation in interviews or studies
  • Compensation of $75 per hour

Related Jobs