Baseten
Baseten
Baseten provides model inference infrastructure for companies deploying machine learning and AI applications. Its platform is built for fast, scalable serving, combining high-throughput inference, rapid deployment, autoscaling, secure enterprise model serving, and support for open-source model packaging. Baseten helps engineering and machine learning teams manage the operational demands of model infrastructure so they can focus on developing domain-specific models. The company operates across artificial intelligence, SaaS, and enterprise technology, with a team of 11–50 employees.

Backend Engineer, Observability and AI Infrastructure

Build backend systems for observability, billing, developer tooling, and AI agents. Help power Baseten’s platform for running critical AI inference workloads in production.

Description

  • Build scalable pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructure.
  • Evolve observability platforms through migrations and architectural improvements that increase reliability, lower costs, and support organizational growth.
  • Develop commercialization and billing systems.
  • Build integrations with strategic partners.
  • Create internal infrastructure and tools that improve developer productivity, CI/CD, and deployment safety.
  • Lead the internal AI agent platform from architecture and development through rollout, operation, and measurement.
  • Set Baseten’s testing strategy, including the standards, tiers, and tools engineering teams use.
  • Encourage platform adoption with strong defaults, clear documentation, and a smooth developer experience.
  • Strengthen platform reliability through improved alerting, incident tools, and production debugging workflows.
  • Guide technical design for cross-team projects and balance delivery speed, quality, and long-term maintainability.
  • Work with infrastructure, model performance, and product teams to understand their needs and help them deliver faster.
  • Improve engineering quality through code reviews, mentorship, and clear technical writing.

Requirements

  • Bachelor’s degree in computer science, engineering, or a related field, or equivalent experience.
  • At least five years of relevant industry experience, focused on scalable backend systems and platforms.
  • Experience building or operating observability systems for logging, metrics, and tracing, or large-scale internal infrastructure.
  • Proficiency in Python, Go, Rust, or a similar backend language.
  • Strong understanding of engineering quality and principles, including the reasoning behind technical decisions.
  • Systems-level perspective on how distributed system components interact and how data moves through them.
  • A platform mindset: design for adoption and self-service, treat internal engineers as customers, and favor useful defaults over prescriptive style guides.
  • Excellent written and verbal communication skills.

Benefits

  • Competitive compensation with meaningful equity.
  • In the United States, full medical, dental, and vision insurance coverage for employees and their dependents.
  • Flexible paid time off and a company-wide winter break, with offices closed from Christmas Eve through New Year’s Day.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • Company-facilitated 401(k) plan in the United States.
  • Opportunities to learn and build connections through exposure to a range of machine learning startups.

Related Jobs

Lambda

Senior Software Development Engineer, Network Automation

Lambda

Build automation for network provisioning, configuration, and capacity planning across Lambda’s AI cloud infrastructure. This hybrid role supports work from the Bellevue or San Francisco office.

Open