Weekday (YC W21)
Weekday (YC W21)
11 – 50 Employees
ConsultingHR TechSaaS
Weekday (YC W21) is an India-focused recruitment platform in the HR technology and SaaS space. It combines AI-driven tools with a broad candidate database to help companies identify and engage talent through proactive outreach. The platform supports communication across email, WhatsApp, and phone, while also giving candidates a straightforward way to discover and apply for roles.

Remote Business Analyst, AI Chatbot Evaluation

Assess and compare AI chatbot responses using structured quality criteria. Produce clear evaluations and documentation for international AI training projects.

Description

  • Assess and compare responses from multiple AI chatbots using established criteria.
  • Evaluate chatbot responses for accuracy, relevance, completeness, clarity, and overall quality.
  • Translate business requirements into evaluation guidance and functional specifications.
  • Collect, interpret, and document information to support consistent, objective assessments.
  • Review workflows, processes, and data to find gaps, inconsistencies, and opportunities to improve.
  • Prepare evaluation reports, summaries, and supporting materials.
  • Work with project managers and cross-functional teams to clarify requirements and resolve assessment questions.
  • Monitor task progress, quality measures, and deliverables while meeting deadlines.
  • Spot recurring response-quality issues and share practical findings.
  • Apply consistent quality standards and protect confidential information throughout the work.
  • Complete a final assessment for every assigned task.

Requirements

  • Bachelor’s degree in business administration, finance, computer science, or a related discipline.
  • At least three years of experience as a business analyst or in a similar analytical role.
  • Strong analytical, problem-solving, and decision-making skills.
  • Excellent written communication and the ability to explain findings clearly.
  • Careful attention to detail and the ability to assess information objectively.
  • Proficiency with Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
  • Experience gathering requirements, mapping processes, and preparing business documentation.
  • Able to work independently, handle competing priorities, and meet tight deadlines.
  • Strong documentation skills and ability to follow structured evaluation guidelines.
  • Familiarity with Agile or Scrum methods is an advantage.
  • Commitment to a full-time, 16-week remote engagement with the required time-zone overlap.
  • Availability to work eight hours per day, five days per week, including weekends when needed, with two weekdays off.
  • At least four hours of overlap with US Pacific Time.

Benefits

  • Contribute to projects focused on AI evaluation and response quality.
  • Work remotely from your location.
  • Gain exposure to structured AI assessment workflows and quality evaluation processes.
  • Contribute to projects with international reach.
  • Work with a defined contract term, hourly compensation, and clear evaluation responsibilities.

Related Jobs