Gramian Consulting
Gramian Consulting
Gramian Consulting is a remote-first consulting firm focused on engineering, data, and AI talent. It helps organizations expand technical capacity through talent augmentation, recruiting, dedicated teams, and contractor management, while providing services such as LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure. The firm also supports individual career development through mentorship and education programs covering career readiness, interview preparation, and international market orientation. Its work combines hands-on engineering and recruiting experience to help clients build technical teams and apply AI to business needs.

Senior Software Engineer – AI Code Evaluation (Remote, Pakistan)

Gramian Consulting is seeking a senior software engineer to evaluate AI-generated code for LLM training programs. The role covers code review, reference-solution development, and benchmark creation for language-model assessment.

Description

  • Evaluate AI-generated code across multiple programming languages and software engineering scenarios.
  • Judge code for correctness, reliability, security, scalability, readability, and maintainability.
  • Detect bugs, logical flaws, incomplete implementations, edge-case failures, and architectural weaknesses.
  • Examine unfamiliar codebases and assess the effects of proposed changes.
  • Review bug fixes, feature work, refactoring, API integrations, configuration updates, and database operations.
  • Compare implementation alternatives and verify their compliance with technical requirements.
  • Rewrite or refine code into high-quality reference solutions.
  • Explain technical issues and recommended improvements clearly.
  • Create evaluation criteria, technical annotations, and rubrics for assessing code quality.
  • Work with research and engineering teams to develop coding benchmarks and advance LLM evaluation methods.

Requirements

  • At least seven years of professional software engineering experience.
  • Strong proficiency in at least one language such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP, or Rust.
  • Substantial experience building, maintaining, debugging, and reviewing production-grade software.
  • Solid command of software design principles, clean code, modular architecture, abstraction, error handling, and maintainability.
  • Demonstrated ability to find functional, performance, security, and design problems in complex codebases.
  • Strong debugging, root-cause analysis, and problem-solving abilities.
  • Experience participating in code reviews and collaborative development workflows.
  • Familiarity with Git and current software engineering practices.
  • Strong written English and the ability to communicate technical feedback precisely.
  • Good knowledge of data structures, algorithms, APIs, databases, and application architecture.

Related Jobs

Prollenium Medical Technologies Inc.

Contract Customer Service Manager – Hybrid, Canada

Prollenium Medical Technologies Inc.
51 – 200 Employees
ConsultingHealthcareLegal

Lead Prollenium Medical Technologies’ customer service team, performance programs, and order-to-cash improvements. Support Canadian medical-device and dermal-filler operations through data-driven service management.

Open
Highmark Health
Hill International, Inc.

Human Resources Business Partner, West Region (Hybrid)

Hill International, Inc.
1,001 – 5,000 Employees
ConsultingLogisticsMarketing

Advise Hill International leaders across California and the Western United States on workforce strategy, employee relations, and organizational effectiveness. Support infrastructure-focused teams through talent planning, change initiatives, and practical HR guidance.

Open