OpenRouter
OpenRouter
OpenRouter — dasturchilar va jamoalarga turli provayderlarning katta til modellaridan foydalanish va ular bilan ishlashning yagona usulini taqdim etadigan sun’iy intellekt platformasi. Uning modellar katalogida Mistral Small 3 va DeepSeek R1 Distill Qwen 32B kabi variantlar mavjud bo‘lib, tezlik, aniqlik va modelni moslashuvchan tanlashni ustuvor biladigan ilovalarni qo‘llab-quvvatlaydi. OpenRouter, shuningdek, kod yozish va o‘yinlar yaratish uchun vositalarni taklif etadi hamda marketing, moliya va ta’lim kabi sohalarda qo‘llanishi mumkin.

Site Reliability Engineer, AI Provider Operations — OpenRouter (Remote, US)

Operate reliability systems for OpenRouter’s AI providers, including observability, failover, and incident response. Automate endpoint quality checks, capacity management, and launch readiness.

Tavsif

  • Develop monitoring for provider endpoints and track latency, throughput, errors, uptime, and output correctness.
  • Define service-level objectives (SLOs) for provider tiers and configure actionable alerts.
  • Improve degraded-endpoint detection and coordinate automatic traffic failover with the routing team.
  • Manage on-call provider incidents from triage and mitigation through partner communication, postmortems, and follow-up actions.
  • Produce provider scorecards and SLO reports.
  • Provide technical escalation support for provider endpoint issues.
  • Develop continuous canaries and evaluations to catch otherwise hidden quality regressions.
  • Automate provider operations, including endpoint disablement, capacity changes, deprecations, and rate-limit adjustments.
  • Create endpoint load-testing tools to assess launch readiness and initial traffic.
  • Report to the Provider Operations Manager.

Talablar

  • At least four years in SRE, production engineering, or infrastructure roles supporting high-traffic, customer-facing systems.
  • Strong observability skills, including metrics, tracing, logs, SLOs, error budgets, and actionable alerting.
  • Software engineering ability and a preference for building tools over following runbooks.
  • Experience with TypeScript and/or Python.
  • Knowledge of distributed-systems failure modes, including timeouts, retries, backpressure, and partial outages.
  • Ability to lead incidents calmly and communicate clearly with external partners under pressure.
  • Understanding of LLM inference concepts, or willingness to learn about streaming, tool calling, prompt caching, throughput and latency tradeoffs, and provider API differences.
  • Experience at an inference provider, model lab, GPU cloud, or API gateway or CDN company is a plus.
  • Experience with TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel is a plus.
  • Background in routing, load balancing, or traffic management systems is a plus.
  • Experience with evaluations or synthetic monitoring for machine-learning systems is a plus.

O‘xshash ish o‘rinlari

Correlation One

Learning Designer, Data and AI Training

Correlation One
51 – 200 Xodimlar
H1B vizasi homiysi

Design evidence-based data and AI training for Correlation One’s workforce development programs, creating curricula, exercises, and reusable learning resources for enterprise clients.

Ochish