Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.
Remote Quantitative AI Evaluation Specialist
Contract data science specialist at Gramian Consulting evaluating AI-generated solutions. Develops prompts, datasets, and feedback to improve quantitative AI models.
Description
- Review AI-generated work in data science, statistics, machine learning, experimentation, and quantitative problem-solving.
- Develop expert prompts, datasets, and reference solutions for AI training and evaluation.
- Spot flawed methods, statistical errors, unsupported assumptions, and gaps in quantitative reasoning.
- Judge the accuracy, reliability, and clarity of analytical methods and conclusions.
- Give structured, evidence-based feedback to strengthen AI model capabilities.
- Use consistent evaluation standards and explain technical findings clearly.
Requirements
- At least one year of professional experience at a recognized technology, finance, or research company, including some experience within the past three years.
- Foundational knowledge of data science, statistics, machine learning, or quantitative analysis.
- Strong analytical and critical-thinking skills, including the ability to detect errors in data-driven reasoning.
- Excellent written English and the ability to explain technical and statistical concepts clearly.
- Ability to assess complex problems systematically and provide accurate, well-supported feedback.
- Currently residing in an English-speaking country.