LogoFresh Jobs Ahead
LlamaIndex
LlamaIndex
1 – 10 Employees
Artificial IntelligenceSaaS
LlamaIndex is an artificial intelligence and SaaS company building a data framework for production-quality large language model applications and agents. Its tools and documentation help developers connect language models to diverse datasets, structure user data, and develop efficient AI software for real-world use.
LinkedIn
Company Jobs

Head of Engineering – LlamaIndex, San Francisco Hybrid

Lead LlamaIndex’s engineering organization as it builds software that makes enterprise data useful for AI applications. Shape ML infrastructure, APIs, model serving, and dependable customer-facing products.

USUnited StatesCACalifornia
$200,000 – $300,000 / year
HybridFull-timeLeadEnglish RequiredEngineering Manager
CloudDistributed Systems

Description

  • Lead and grow the engineering organization by establishing priorities, ownership, and accountability.
  • Work with company leaders to turn customer needs into a focused roadmap and deliver software reliably.
  • Contribute hands-on through architecture, code reviews, production troubleshooting, and critical implementation work.
  • Define technical direction across application services, APIs, data pipelines, and machine learning infrastructure.
  • Collaborate with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment.
  • Direct model-serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference costs.
  • Advance engineering practices for testing, observability, security, incident response, and release management.
  • Recruit engineers, develop technical leaders and managers, and foster direct communication, customer focus, and accountability.

Requirements

  • Experience leading engineering teams in B2B SaaS while delivering and operating customer-facing products.
  • Experience overseeing multiple engineering teams or technical domains at a complexity comparable to a 20–30-person organization.
  • Strong hands-on engineering ability, including production coding, architecture review, and diagnosis of complex technical issues.
  • Practical experience with model serving and training workflows, including fine-tuning, evaluation, deployment, and production operations.
  • Understanding of tradeoffs among model quality, latency, throughput, GPU resources, reliability, and cost.
  • Strong background in backend development, APIs, distributed systems, and cloud infrastructure.
  • Demonstrated success hiring and developing engineers, setting expectations, and providing constructive feedback.
  • Sound product judgment when balancing delivery speed with correctness, reliability, and security.
  • Clear written and verbal communication with technical teams, customers, and company leadership.
  • Experience scaling engineering within a Series A–C startup.
  • Experience with document processing, OCR, extraction, retrieval, indexing, or related enterprise-data systems.
  • Experience with LLMs or multimodal models, evaluation datasets, and model-quality monitoring.
  • Experience with GPU infrastructure, distributed training, inference optimization, or model-serving frameworks.
  • Experience building developer tools or API-first products.
  • Experience addressing enterprise needs such as multi-tenancy, access controls, auditability, and security reviews.
  • Experience developing engineering managers while remaining closely involved in technical execution.
  • Ability to work from the San Francisco office at least three days per week.
  • Ability to work in the United States without sponsorship, where applicable.

Benefits

  • Equity

Related Jobs

Lambda

Core Cloud Platform Engineering Manager

Lambda
51 – 200 Employees
H1B Visa SponsorConsultingHealthcareLogistics
USUnited StatesCACaliforniaWAWashington
$297,000 – $440,000 / year
HybridFull-timeSeniorLeadEnglish RequiredEngineering Manager
CloudDistributed SystemsGoKubernetesPython

Lead the team building Lambda’s foundational Kubernetes and distributed cloud services for AI infrastructure. The role covers team development, technical delivery, reliability, and operations across multiple regions.

Open