Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

AI Conversation Research and Evaluation Specialist

Gramian Consulting is hiring an AI conversation evaluator to improve the quality of AI recommendations. The role uses structured qualitative analysis to assess interpersonal scenarios and identify missing context.

Description

  • Review AI conversations about interpersonal situations and everyday decisions.
  • Spot missing context and suggest follow-up questions that could improve AI responses.
  • Determine whether additional information could meaningfully change an AI recommendation.
  • Separate decision-critical information from details that are descriptive or non-essential.
  • Carry out qualitative reviews and record findings under structured evaluation guidelines.
  • Check whether conversations account for relevant personal, psychological, social, financial, practical, and organizational factors.
  • Find opportunities to clarify, build understanding, and gather more information.
  • Assess conversations about relationships, work, education, family, wellbeing, planning, and resource constraints.
  • Work with research teams to support consistent assessments grounded in evidence.
  • Deliver accurate, clear, consistent work within project deadlines.

Requirements

  • At least 3–5 years of relevant, direct professional experience in one or more of the listed fields.
  • Social work route: an MSW or equivalent graduate-level qualification.
  • Social work route: an LCSW, LICSW, LMSW, or equivalent applicable social work license or credential.
  • Experience with client assessment, case review, interviewing, counseling, or related social work practice.
  • Counseling, therapy, or psychology route: a relevant master’s degree plus an LMFT, LPC, LCPC, or equivalent counseling or therapy license or credential; alternatively, a PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
  • Relevant work in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional practice.
  • Qualitative research, HCI, or communication route: an MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related field.
  • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding.
  • Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities to clarify.
  • Mediation, coaching, student services, organizational consulting, or related advisory route: a relevant professional qualification, credential, or demonstrated subject-matter expertise.
  • At least five years of direct advisory or client-facing experience for candidates qualifying through this route.
  • Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work.
  • Ability to gather context, understand individual or organizational needs, and make informed recommendations.

Related Jobs