Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

Mathematics Expert, Python and AI — Remote in Bangladesh

Develop rigorous mathematical coding datasets, verified Python solutions, and evaluation tests for advanced AI research. Help assess frontier language models through structured problem design and quality validation.

Description

  • Create mathematical coding tasks with one primary problem and at least three logically connected sub-problems that build toward the final solution.
  • Develop verified Python reference solutions with comprehensive unit test coverage.
  • Create discriminative test cases that separate correct AI-generated outputs from incorrect ones.
  • Conduct quality validation in the Central Task Platform (CTP), covering Tier 1 structural checks and Tier 2 quality rubrics.
  • Update problem specifications, solutions, and test cases in response to quality-control feedback.
  • Tune tasks to satisfy Pass@K evaluation criteria across GPT, Gemini, Nemotron, and other LLM judges.
  • Verify mathematical accuracy, well-posedness, determinism, and adherence to project quality standards.
  • Deliver strong first submissions while reducing rework and working toward consistent L1 approval.
  • Join review sessions, feedback meetings, and project standups during required overlap hours.

Requirements

  • A master’s degree or PhD in Mathematics.
  • Strong Python programming ability, including scientific-computing experience.
  • Experience with scientific Python libraries such as NumPy, SciPy, SymPy, or comparable domain-specific tools.
  • Ability to formulate rigorous mathematical problems with explicit constraints and expected outputs.
  • Experience implementing scientific or mathematical solutions with unit tests and deterministic results.
  • Previous work in AI data annotation, scientific research, or scientific writing.
  • Familiarity with LLM evaluation frameworks, coding benchmarks, or assessment of AI-generated code.
  • Published research or academic project experience in mathematics or another STEM field.

Related Jobs