LogoFresh Jobs Ahead
The College Board
The College Board
1,001 – 5,000 Employees
EducationNon-profit
The College Board is a mission-driven nonprofit organization working to expand access, excellence, and equity in education. Its work helps students prepare for higher education, develop essential skills, and navigate pathways to college opportunity while addressing barriers that can limit access. With teams working across several U.S. locations, The College Board brings together education professionals focused on collaboration, inclusion, and respect. The organization is also modernizing its operations and strengthening its digital presence to better support students and families nationwide.
LinkedIn
Company Jobs

Director of AI-Assisted Solutions

Lead the use of AI tools and workflows to scale assessment content development for The College Board. Oversee item generation, evaluation, training, and adoption across SAT, AP, and other programs in a fully remote U.S. role.

USUnited States
$88,000 – $135,000 / year
RemoteFull-timeLeadEnglish RequiredArtificial Intelligence

Description

  • Lead end-to-end delivery for assigned College Board assessment program engagements
  • Define problems and requirements, then design and build AI tools, prompts, and workflows
  • Deliver functional solutions supported by training and adoption plans
  • Evaluate AI-generated content for construct misalignment, flawed reasoning, bias, and factual errors
  • Provide final quality approval for tools delivered to partner teams
  • Establish quality standards and evaluation methods, including rubrics, benchmarks, and scoring frameworks
  • Identify requirements for systems-based solutions that need additional stakeholder input and resources
  • Diagnose cultural, staffing, process, and technology gaps that limit scale
  • Set engagement priorities and program roadmaps for AI-enabled item development
  • Define standards and inputs for agentic workflows
  • Contribute to enterprise-wide agentic-human hybrid architecture, strategy, and roadmaps
  • Represent supported programs in cross-program tooling and methodology discussions
  • Design and deliver training on AI-assisted and agentic workflows
  • Create process documentation supporting responsible tool adoption
  • Establish and document measures of impact
  • Maintain College Board assessment design and development standards
  • Test emerging AI tools, models, and techniques
  • Share findings with teams and internal communities of practice
  • Attend relevant external meetings and conferences as a College Board representative

Requirements

  • At least seven years of experience developing standardized assessment items across multiple item types
  • Expert command of item-writing practice and construct alignment
  • Deep subject expertise in Reading Comprehension, Writing, Math, or Science assessment
  • At least three years of hands-on experience with AI-assisted or agentic methods, including AIG, RAG, prompt engineering, and context engineering
  • Demonstrated success driving process or technology improvements through adoption and measurable impact
  • Working knowledge of large language models, hallucinations, context-window limitations, and stale training data
  • Experience with agentic and multi-agent workflows, tool calling, and chained or orchestrated prompts
  • Experience with vibe coding, coding, or rapid prototyping
  • Ability to independently create functional scripts, tools, or interactive prototypes
  • Experience designing processes, educating others, and enabling adoption of tools, processes, and systems
  • Ability to connect technical and non-technical discussions
  • Proven ability to collaborate across functions
  • Strong organizational and planning skills
  • Experience implementing procedures, managing project plans and schedules, and maintaining tracking documentation
  • Experience with item and test development lifecycles, digital authoring and review tools, and content management or item banking systems
  • Comfort working with ambiguity in a fast-paced environment
  • Willingness to travel six to eight times per year
  • Authorization to work in the United States
  • Interest in expanding educational and career opportunities through mission-driven work
  • Curiosity and willingness to test emerging technologies and AI-driven solutions
  • Clear, concise written and verbal communication skills
  • Learner mindset and commitment to continued growth
  • Strong drive for impact and excellence
  • Collaborative and empathetic working style
  • Master’s degree or equivalent education and experience strongly preferred

Benefits

  • Meaningful career opportunities
  • Supportive team environment
  • Comprehensive package designed to support employee well-being and success
  • Fair, competitive compensation
  • Salaries adjusted for location
  • Transparent offers grounded in market data
  • Fully remote work option
  • Hybrid work option for candidates near College Board offices, with Tuesdays and Wednesdays in the office
  • Travel to relevant external professional meetings and conferences

Related Jobs

Nebius Group

Senior Customer AI Engineer

Nebius Group
1,001 – 5,000 Employees
Artificial IntelligenceEnterpriseSaaS
USUnited States
$209,800 – $262,200 / year
RemoteFull-timeSeniorEnglish RequiredAI EngineerMachine Learning Engineer
CloudDistributed Systems

Guide customers from proof of concept to production on Nebius’s AI cloud platform, helping them deploy AI workloads reliably and at scale. Improve performance, reliability, and cost efficiency while accelerating time to production and customer value.

Open