OpenRouter
OpenRouter
OpenRouter — әзірлеушілер мен командаларға әртүрлі провайдерлер ұсынатын ірі тілдік модельдерге қол жеткізіп, олармен жұмыс істеудің бірыңғай тәсілін беретін жасанды интеллект платформасы. Оның модельдер каталогында Mistral Small 3 және DeepSeek R1 Distill Qwen 32B сияқты нұсқалар бар, олар жылдамдыққа, дәлдікке және модельді икемді таңдауға басымдық беретін қолданбаларды қолдайды. OpenRouter сонымен қатар бағдарламалау мен ойын әзірлеуге арналған құралдарды ұсынады және маркетинг, қаржы және білім беру сияқты салаларда қолданылуы мүмкін.

Site Reliability Engineer, AI Provider Operations — OpenRouter (Remote, US)

Operate reliability systems for OpenRouter’s AI providers, including observability, failover, and incident response. Automate endpoint quality checks, capacity management, and launch readiness.

Сипаттама

  • Develop monitoring for provider endpoints and track latency, throughput, errors, uptime, and output correctness.
  • Define service-level objectives (SLOs) for provider tiers and configure actionable alerts.
  • Improve degraded-endpoint detection and coordinate automatic traffic failover with the routing team.
  • Manage on-call provider incidents from triage and mitigation through partner communication, postmortems, and follow-up actions.
  • Produce provider scorecards and SLO reports.
  • Provide technical escalation support for provider endpoint issues.
  • Develop continuous canaries and evaluations to catch otherwise hidden quality regressions.
  • Automate provider operations, including endpoint disablement, capacity changes, deprecations, and rate-limit adjustments.
  • Create endpoint load-testing tools to assess launch readiness and initial traffic.
  • Report to the Provider Operations Manager.

Талаптар

  • At least four years in SRE, production engineering, or infrastructure roles supporting high-traffic, customer-facing systems.
  • Strong observability skills, including metrics, tracing, logs, SLOs, error budgets, and actionable alerting.
  • Software engineering ability and a preference for building tools over following runbooks.
  • Experience with TypeScript and/or Python.
  • Knowledge of distributed-systems failure modes, including timeouts, retries, backpressure, and partial outages.
  • Ability to lead incidents calmly and communicate clearly with external partners under pressure.
  • Understanding of LLM inference concepts, or willingness to learn about streaming, tool calling, prompt caching, throughput and latency tradeoffs, and provider API differences.
  • Experience at an inference provider, model lab, GPU cloud, or API gateway or CDN company is a plus.
  • Experience with TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel is a plus.
  • Background in routing, load balancing, or traffic management systems is a plus.
  • Experience with evaluations or synthetic monitoring for machine-learning systems is a plus.

Ұқсас жұмыс орындары

Saab

BI Developer, Qlik and Microsoft Fabric — Saab

Saab

Build Qlik, Power BI, and Microsoft Fabric analytics solutions for Saab’s defense and security business. Turn data into actionable insights and AI-enabled capabilities.

Ашу
TaskUs

Data Visualization Analyst

TaskUs

Create Power BI dashboards and reports for TaskUs clients, turning complex data into clear, useful insights. Collaborate with business and technical teams to deliver accurate reporting.

Ашу
Eli Lilly and Company

Associate Director, Talent Analytics and Assessment Science — Eli Lilly, Indianapolis Hybrid

Eli Lilly and Company

Lead Lilly’s employee listening strategy and assessment science. Use psychometrics, program evaluation, and responsible AI analytics to inform workforce decisions.

Ашу
Expleo Group

Data Engineer, Expleo Group — Portugal Hybrid

Expleo Group

Build ETL/ELT pipelines and reusable data products for Expleo’s engineering and technology services. Connect Azure, Snowflake, APIs, and AWS sources to support AI, analytics, and reporting.

Ашу
OPEN

Data Engineer, Semarchy and SQL

OPEN

Build and optimize data pipelines for critical banking platforms using Semarchy xDI and SQL. Join a data team working on ingestion, transformation, data quality, and production delivery.

Ашу
Sigma Software Group

Senior Data Engineer, Databricks Migration

Sigma Software Group

Migrate a large-scale retail analytics platform from BigQuery to Databricks, building Lakehouse architectures, Spark pipelines, and governed data solutions at Sigma Software Group.

Ашу
YASH Technologies

PySpark Data Engineer

YASH Technologies

Build scalable PySpark data pipelines at YASH Technologies. Develop ETL/ELT workflows with Microsoft Fabric, Spark SQL, Lakehouse, and Data Factory.

Ашу
Expleo Group

Senior Retail Lifecycle Management Programme Manager

Expleo Group

Lead retail lifecycle management technology delivery in Dubai, coordinating price optimisation and store transfer initiatives with an AWS partner. The role covers supply chain data readiness, cross-functional delivery, user adoption, and executive reporting.

Ашу
Cabot Corporation

Senior Digital Category Manager, IT Procurement

Cabot Corporation

Lead global technology sourcing, supplier negotiations, and procurement transformation for Cabot Corporation’s specialty chemicals business.

Ашу