Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

Scientific Chemistry Python AI Evaluation Contractor

Contract role for designing Python-based chemistry problems, validation tests, and rigorous datasets used to train and evaluate advanced AI models at Gramian Consulting.

Description

  • Create scientific coding tasks with a central chemistry problem and at least three logically connected sub-problems that increase in structure and complexity.
  • Build verified Python reference solutions with comprehensive unit-test coverage.
  • Design targeted test cases that separate correct AI-generated answers from incorrect ones.
  • Perform quality-control checks in the Central Task Platform, covering Tier 1 structural validation and Tier 2 quality rubrics.
  • Refine task requirements, implementations, and test cases in response to quality-control feedback.
  • Tune tasks to satisfy Pass@K evaluation standards across GPT, Gemini, Nemotron, and other LLM judges.
  • uphold scientific accuracy, deterministic behavior, clear problem formulation, and project quality requirements.
  • Deliver strong first submissions, reduce rework, and consistently target L1 approval.
  • Attend review meetings, feedback sessions, and project standups during required overlap hours.

Requirements

  • Master’s degree or PhD in Chemistry.
  • Strong Python programming ability and practical experience in scientific computing.
  • Experience with scientific Python tools such as NumPy, SciPy, SymPy, or comparable domain-specific libraries.
  • Ability to define rigorous scientific problems with explicit constraints and expected outputs.
  • Experience implementing scientific solutions with unit tests and deterministic results.
  • Background in AI data annotation, scientific research, or technical scientific writing.
  • Familiarity with LLM evaluation systems, coding benchmarks, or assessment of AI-generated code.
  • Published research or academic project experience in chemistry or another STEM field.

Related Jobs

FundApps

Mid-Level Software Engineer — London Hybrid

FundApps

Build backend and cloud-native software for FundApps, whose products monitor more than US$20 trillion in assets under management. Help deliver sustainable technology across a distributed platform using C#, PostgreSQL, AWS, Terraform, React, and TypeScript.

Open
AFL

IT Threat and Vulnerability Management Analyst (Hybrid)

AFL

Help AFL identify, assess, and reduce cyber exposure across corporate and manufacturing networks. The role covers vulnerability discovery, exploitability analysis, remediation coordination, risk acceptance, and security reporting.

Open
Concept Reply GmbH

AIoT Full-Stack Developer (Hybrid, Germany)

Concept Reply GmbH

Join Concept Reply GmbH to build AIoT solutions across frontend, backend, and machine learning. The role supports applications for automotive, manufacturing, and intelligent infrastructure.

Open
EXL

Business Analyst - Business Intelligence and AI Analytics

EXL

Business intelligence and AI consultant developing scalable data pipelines, governed semantic models, and Power BI/Tableau reporting. Creates LLM-powered analytics to support enterprise decision-making.

Open