Weekday (YC W21)
Weekday (YC W21)
11 – 50 Employees
ConsultingHR TechSaaS
Weekday (YC W21) is an India-focused recruitment platform in the HR technology and SaaS space. It combines AI-driven tools with a broad candidate database to help companies identify and engage talent through proactive outreach. The platform supports communication across email, WhatsApp, and phone, while also giving candidates a straightforward way to discover and apply for roles.

Senior Software Engineer, Python and TypeScript

Build AI evaluation pipelines, rubrics, and data quality systems for a client. Remote contract open in approved US regions and Canada, with PST overlap.

Description

  • Create and improve rubrics, evaluation frameworks, and quality standards for preference data.
  • Assess and label data, spotting inconsistencies, quality issues, and ways to improve it.
  • Develop and optimize the pipelines and infrastructure used to generate, collect, process, and evaluate data.
  • Turn analysis and evaluation findings into clear reports, recommendations, updates, and actionable summaries.
  • Work with researchers and engineers to make qualitative judgments into consistent, repeatable, scalable processes.
  • Contribute to complex software repositories and maintain code quality, reliability, and performance.
  • Find inefficient workflows and improve data quality, evaluation consistency, and engineering processes.
  • Complete application screening, an AI interview, a coding challenge, a technical and cultural interview, and a final candidate evaluation.

Requirements

  • At least five years of professional software engineering experience, including Python pipeline and infrastructure work, or experience with TypeScript, JavaScript, or Go.
  • Practical experience collecting preference data, creating rubrics, or developing evaluation criteria.
  • Strong knowledge of software engineering principles, code quality, debugging, and maintainable system design.
  • Excellent written and spoken communication, including the ability to explain complex technical ideas clearly and concisely.
  • Strong analytical ability and sound, consistent judgment when assessing quality.
  • Ability to explain why a solution, example, or implementation meets a high quality standard.
  • Able to work independently in ambiguous settings while prioritizing execution and timely delivery.
  • Experience contributing to or navigating large, complex open source codebases, such as VS Code, preferred.
  • Experience building data pipelines, developer infrastructure, or automated evaluation systems preferred.
  • Background in AI model evaluation, preference data workflows, data annotation, or quality assessment preferred.
  • Experience working with AI researchers, machine learning engineers, or multidisciplinary technical teams preferred.
  • Education from a leading university or professional experience at a highly regarded technology company preferred.
  • A LinkedIn profile is mandatory and must be included in the resume.
  • Must not currently work for Microsoft.
  • Must be able to meet the required weekly hours and PST overlap throughout the contract.

Related Jobs