Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

Business Analyst, AI Response Evaluation

Assess AI chatbot responses against business requirements at Gramian Consulting, an IT services and engineering talent consultancy. Produce evidence-based evaluations, reports, and process documentation.

Description

  • Collect and document business requirements, stakeholder expectations, and project goals.
  • Evaluate chatbot responses for accuracy, relevance, completeness, and fit with established criteria.
  • Conduct structured reviews and deliver evidence-based assessments of AI-generated content.
  • Turn business needs into functional specifications, evaluation criteria, and practical documentation.
  • Review workflows, processes, and data to identify gaps and opportunities to improve.
  • Prepare reports, dashboards, process maps, and other project materials.
  • Assist with project planning, testing, implementation, and user acceptance testing.
  • Work with technical teams and business stakeholders to clarify and meet project requirements.
  • Monitor project progress, risks, dependencies, and key performance indicators.
  • Share findings and recommendations to inform decisions.
  • Maintain evaluation quality and meet deadlines and task targets.

Requirements

  • Bachelor’s degree in business administration, finance, computer science, or a related field.
  • At least three years of experience as a business analyst or in a similar analytical role.
  • Strong analytical, problem-solving, and decision-making skills.
  • Proficiency in Excel and experience with SQL, Power BI, Tableau, or similar analysis and reporting tools.
  • Experience gathering requirements, writing functional specifications, and mapping business processes.
  • Strong attention to detail and ability to compare complex information against defined criteria.
  • Excellent written communication, reporting, and documentation skills.
  • Ability to collaborate across teams and manage multiple priorities independently.
  • Availability to work five days per week, including weekends when needed, with two weekdays off during the project.

Related Jobs