Weekday (YC W21)
Weekday (YC W21)
11 – 50 Employees
ConsultingHR TechSaaS
Weekday (YC W21) is an India-focused recruitment platform in the HR technology and SaaS space. It combines AI-driven tools with a broad candidate database to help companies identify and engage talent through proactive outreach. The platform supports communication across email, WhatsApp, and phone, while also giving candidates a straightforward way to discover and apply for roles.

Remote Business Analyst, AI Chatbot Evaluation

Assess AI chatbot responses for a client project by comparing outputs against quality standards and documenting objective findings. This remote contract role includes business analysis and evaluation work.

Description

  • Compare responses from multiple AI chatbots.
  • Assess chatbot answers for accuracy, relevance, completeness, clarity, consistency, and overall quality using set criteria.
  • Document business requirements and turn them into practical evaluation guidelines.
  • Carry out structured reviews and record impartial, evidence-based assessments.
  • Examine workflows, processes, and data to find gaps, inconsistencies, and opportunities to improve.
  • Write reports, summaries, and supporting materials that explain evaluation results.
  • Work with project managers and cross-functional colleagues to clarify requirements and resolve assessment questions.
  • Monitor task status, quality measures, and deliverables to keep work on schedule.
  • Spot recurring problems in chatbot answers and share useful findings.
  • Keep project records accurate and consistent while protecting confidentiality.

Requirements

  • Bachelor’s degree in business administration, finance, computer science, or a related discipline.
  • At least three years’ experience as a business analyst or in a comparable analytical position.
  • Strong analytical, problem-solving, and decision-making abilities.
  • Clear written and spoken communication.
  • Proficiency with Excel, SQL, Power BI, Tableau, or comparable analysis tools.
  • Experience gathering requirements, mapping processes, and preparing business documentation.
  • Able to collaborate across teams and handle competing priorities.
  • Careful attention to detail and the ability to make consistent, impartial evaluations.
  • Familiarity with Agile or Scrum is an advantage.
  • Able to follow detailed guidance, meet deadlines, and work independently remotely.
  • Must be based in the United States.
  • Available to work eight hours a day, five days a week, including at least four hours overlapping US Pacific Time.
  • Able to work weekends when needed, taking two weekdays off each week.

Benefits

  • Contribute to projects that assess AI systems and chatbot response quality.
  • Work fully remotely.
  • Gain experience with structured AI review and quality assurance processes.
  • Work on projects with wider business and technology applications.
  • Work under defined contract terms, hourly pay, and project expectations.

Related Jobs