OpenRouter
OpenRouter
OpenRouter ir mākslīgā intelekta platforma, kas izstrādātājiem un komandām nodrošina vienotu veidu, kā piekļūt un strādāt ar dažādu pakalpojumu sniedzēju lielajiem valodas modeļiem. Tās modeļu katalogā ir, piemēram, Mistral Small 3 un DeepSeek R1 Distill Qwen 32B, kas atbalsta lietotnes, kurās svarīgs ātrums, precizitāte un elastīga modeļa izvēle. OpenRouter piedāvā arī programmēšanas un spēļu izstrādes rīkus, un to var izmantot tādās jomās kā mārketings, finanses un izglītība.

Site Reliability Engineer, AI Provider Operations — OpenRouter (Remote, US)

Operate reliability systems for OpenRouter’s AI providers, including observability, failover, and incident response. Automate endpoint quality checks, capacity management, and launch readiness.

Apraksts

  • Develop monitoring for provider endpoints and track latency, throughput, errors, uptime, and output correctness.
  • Define service-level objectives (SLOs) for provider tiers and configure actionable alerts.
  • Improve degraded-endpoint detection and coordinate automatic traffic failover with the routing team.
  • Manage on-call provider incidents from triage and mitigation through partner communication, postmortems, and follow-up actions.
  • Produce provider scorecards and SLO reports.
  • Provide technical escalation support for provider endpoint issues.
  • Develop continuous canaries and evaluations to catch otherwise hidden quality regressions.
  • Automate provider operations, including endpoint disablement, capacity changes, deprecations, and rate-limit adjustments.
  • Create endpoint load-testing tools to assess launch readiness and initial traffic.
  • Report to the Provider Operations Manager.

Prasības

  • At least four years in SRE, production engineering, or infrastructure roles supporting high-traffic, customer-facing systems.
  • Strong observability skills, including metrics, tracing, logs, SLOs, error budgets, and actionable alerting.
  • Software engineering ability and a preference for building tools over following runbooks.
  • Experience with TypeScript and/or Python.
  • Knowledge of distributed-systems failure modes, including timeouts, retries, backpressure, and partial outages.
  • Ability to lead incidents calmly and communicate clearly with external partners under pressure.
  • Understanding of LLM inference concepts, or willingness to learn about streaming, tool calling, prompt caching, throughput and latency tradeoffs, and provider API differences.
  • Experience at an inference provider, model lab, GPU cloud, or API gateway or CDN company is a plus.
  • Experience with TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel is a plus.
  • Background in routing, load balancing, or traffic management systems is a plus.
  • Experience with evaluations or synthetic monitoring for machine-learning systems is a plus.

Saistītās vakances

Enlight Renewable Energy Ltd (ENLT)

Director of Engineering, Renewable Energy

Enlight Renewable Energy Ltd (ENLT)

Lead engineering for Enlight’s solar, wind, and battery storage projects, setting technical standards and guiding teams across the project lifecycle. The role covers optimization, due diligence, procurement support, and engineering leadership across Europe.

Atvērt
General Dynamics Information Technology

Senior AI Autonomy Engineering SME, UAS and Drone Swarming

General Dynamics Information Technology

Lead the design of autonomous UAS, drone swarms, and command-and-control solutions for defense missions. Advance AI and machine learning capabilities across Department of Defense environments.

Atvērt
nahc.io

Senior Full-Stack Engineer (Go) — Hong Kong Remote

nahc.io

Build TypeScript interfaces and Go services for a proprietary trading and research firm. Develop modular financial applications, real-time analytics, reusable components, and SDKs.

Atvērt
YASH Technologies

Senior Python Module Lead

YASH Technologies

Lead Python backend development at YASH Technologies, building scalable microservices and automating REST API testing, cloud deployments, and DevOps operations.

Atvērt
Worldwide Clinical Trials

Principal Statistical Programmer

Worldwide Clinical Trials

Lead SAS and CDISC programming across complex clinical studies at Worldwide Clinical Trials, a global clinical research organization. Oversee regulatory submissions, quality initiatives, and statistical programming teams.

Atvērt
Flourish Health

Executive Assistant to the CEO

Flourish Health

Support Flourish Health’s CEO by coordinating executive operations, key relationships, board logistics, recruiting, and culture initiatives at a team-based mental health provider for young people.

Atvērt