Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

AI Conversation Research and Evaluation Specialist

Review AI conversations about interpersonal situations and everyday decisions for Gramian Consulting, an IT services and engineering talent consultancy. Identify missing context and help improve the relevance of AI recommendations.

Description

  • Review AI conversations about real-world interpersonal situations and everyday decisions.
  • Spot gaps in context and suggest follow-up questions that could improve AI responses.
  • Determine whether additional information could change an AI-generated recommendation.
  • Separate information that affects a decision from incidental or descriptive details.
  • Carry out qualitative reviews and record findings using structured evaluation guidelines.
  • Consider personal, psychological, social, financial, practical, and organizational factors in conversations.
  • Find opportunities to clarify details, deepen understanding, and gather more information.
  • Review discussions of relationships, work, education, family, wellbeing, planning, and resource constraints.
  • Work with research teams to produce consistent assessments grounded in evidence.
  • Deliver accurate, clear, and consistent reviews on schedule.

Requirements

  • At least 3–5 years of relevant direct professional experience in one or more of the specified domains.
  • Social work route: A master's degree in social work (MSW) or equivalent graduate qualification.
  • Social work route: An applicable social work license or credential, such as LCSW, LICSW, or LMSW.
  • Social work route: Experience with client assessments, case reviews, interviews, counseling, or related social work practice.
  • Counseling, therapy, or psychology route: A relevant master's degree and an LMFT, LPC, LCPC, or equivalent license or credential; alternatively, a PhD or PsyD in clinical, counseling, social, or industrial-organizational psychology.
  • Counseling, therapy, or psychology route: Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing work.
  • Qualitative research, HCI, or communication route: An MA, PhD, or equivalent advanced expertise in a related discipline.
  • Qualitative research, HCI, or communication route: Experience with qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding.
  • Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities to clarify.
  • Mediation, coaching, student services, organizational consulting, or related advisory route: A relevant professional qualification, credential, or demonstrated subject-matter expertise.
  • Advisory route: At least five years of direct advisory or client-facing experience.
  • Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work.
  • Ability to gather context, understand individual or organizational needs, and make informed recommendations.

Related Jobs