Nerdy is an education technology and SaaS company behind Varsity Tutors, combining live instruction with AI-powered learning tools on an integrated digital platform. Its services include one-to-one tutoring, weekly test-preparation classes, workshops, session playback, adaptive diagnostics, AI-generated session summaries, an on-demand AI Tutor, and Tutor Copilot tools for finding relevant examples and exercises. Covering more than 3,000 subjects, Nerdy uses expert curation, learning data, and AI-based matching to connect students with highly rated tutors and tailor practice and study support.
Staff Data Scientist, NLP and LLMs
Apply NLP and large language models to call, chat, and session transcripts for Nerdy’s global learning platform. Build evaluated models and production data products that support measurable business outcomes.
Description
- Apply NLP and large language models to call, chat, and session transcripts
- Extract dependable, structured signals from unstructured speech and text
- Establish conversation quality standards and turn them into validated metrics
- Develop LLM evaluation approaches with reference datasets, rubrics, model-assisted assessment, and human review
- Create models for classification, extraction, scoring, and summarization
- Assess how conversation patterns relate to conversion, issue resolution, and retention
- Move models from prototype into production in partnership with engineers
- Track model performance and retrain models to preserve reliability
- Design and assess experiments to measure business impact
- Work with Data Engineering and Analytics Engineering to build governed, reusable lakehouse tables
- Share findings and recommendations with technical and business leaders
- Use AI tools for code generation and review, experiment analysis, transcript exploration, and documentation while following privacy and security safeguards
Requirements
- A master’s degree in Computer Science, Statistics, Mathematics, Computational Linguistics, or a related quantitative discipline; a PhD is preferred
- At least six years applying data science or machine learning to real products
- Experience taking at least one system from concept through production and ongoing use
- Advanced knowledge of NLP and LLMs, including prompt design, structured extraction, and fine-tuning or retrieval
- Practical experience assessing LLM systems with reference datasets, rubrics, model-assisted review, human reviewers, inter-rater agreement, and regression tests
- Strong Python skills, including pandas, scikit-learn, and PyTorch or comparable tools
- Advanced SQL skills with a modern warehouse or lakehouse
- Experience with one or more of Starburst Galaxy (Trino), Iceberg, dbt Cloud, Snowflake, BigQuery, Databricks, or Athena
- Experience using major LLM APIs, such as Anthropic Claude or OpenAI
- Understanding of production cost, latency, and privacy limits
- Experience with speech-to-text output, speaker attribution, long-context summarization, personally identifiable information handling, and transcription errors
- Skills in experimentation and causal inference
- Ability to explain results to nontechnical business leaders and define measurable outcomes
- Experience with Git-based workflows, code review, and CI/CD
- Experience using AI-focused productivity tools such as Cursor, Make, Supabase, Netlify, Claude Code, n8n, Firecrawl, ChatGPT, Grok, Bolt, or Vercel
- Alignment with Nerdy’s apolitical, mission-focused culture
Benefits
- Competitive compensation benchmarked in U.S. dollars and paid in local currency
- Fully remote work from within your home country, with no relocation required
- Flexible time off
- Paid local holidays
- A free, comprehensive learning membership for you and your household, with one-to-one tutoring hours, unlimited on-demand classes, and access to Nerdy’s learning products and services
- Access to advanced AI tools
- Regular training and peer review
- A collaborative culture with frequent feedback
- The chance to contribute to a global learning platform