Anyone AI
Anyone AI
Anyone AI je izobraževalna platforma in platforma za talente, osredotočena na Latinsko Ameriko, ki programskim inženirjem pomaga razvijati kariere na področju umetne inteligence in strojnega učenja. Njeni spletni programi, ki jih vodijo mentorji, združujejo tehnično usposabljanje, vključno s programom za razvijalce strojnega učenja, s pripravo na kariero, kot so svetovanje pri življenjepisu in profilu LinkedIn, priprava na razgovore ter vadba angleščine. Podjetje upravlja tudi trg talentov, ki njegovo usposobljeno skupnost povezuje z delodajalci, ki iščejo strokovnjake za umetno inteligenco, ter uporablja model, usmerjen v zaposlovanje, ki vključuje plačila na podlagi deleža dohodka in partnerstva z delodajalci.

Senior Software Engineer, SWE-Bench Evaluation

Review open-source software tasks from GitHub issues and pull requests for Anyone AI. Assess their clarity, test quality, reproducibility, complexity, and suitability for benchmarking.

Opis

  • Review and assess software engineering tasks based on real GitHub issues and pull requests.
  • Check that task descriptions and success criteria are clear and complete.
  • Evaluate unit tests for accuracy, coverage, and resilience.
  • Find flaky tests, missing dependencies, version mismatches, and environment problems.
  • Check whether tasks can be reproduced consistently across environments.
  • Judge each task’s practical difficulty and technical complexity.
  • Recommend whether tasks should be accepted, revised, or removed.
  • Review bug fixes and feature work, including repository setup, dependency handling, changes across files and modules, and overall technical quality.

Zahteve

  • At least three years of professional software engineering experience.
  • Strong experience working in large codebases spanning multiple files.
  • Experience reviewing pull requests, debugging problems, and maintaining production software.
  • A solid understanding of unit testing and test coverage.
  • Ability to judge whether tests validate a solution correctly without unnecessarily limiting implementation choices.
  • Experience managing dependencies, configuring environments, and ensuring reproducibility.
  • Strong command of Git and GitHub-based development workflows.
  • Ability to analyze complex technical issues and provide clear written feedback.
  • Contributions to or maintenance of open-source projects are a plus.
  • Experience with SWE-Bench, SWE-Bench Verified, or comparable coding benchmarks is a plus.
  • Experience with major Python open-source projects, such as Django, Flask, scikit-learn, SymPy, matplotlib, requests, or pytest, is a plus.
  • Experience with Docker, CI/CD, pip, conda, or dependency pinning is a plus.
  • Knowledge of test fixtures, test isolation, or property-based testing is a plus.
  • Experience designing technical assessments or reviewing coding challenges is a plus.
  • Experience in AI/ML evaluation, data curation, RLHF, or benchmark development is a plus.

Ugodnosti

  • Work remotely.
  • Part-time, project-based consulting engagement.

Sorodna delovna mesta

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Odpri
RecruitGo

Remote Executive Assistant, Outreach and Marketing — Philippines

RecruitGo
51 – 200 Zaposleni
LogistikaSvetovanjeTrženje

Handle administrative support, CRM, outreach, and marketing for RecruitGo, an Employer of Record serving global clients with talent from emerging markets. Support two UK-facing clients with day-to-day administration and creative campaigns.

Odpri