LogoFresh Jobs Ahead
Baseten
Baseten
11 – 50 Angajați
Sponsor pentru viza H1BInteligență artificialăÎntreprindereSaaS
Baseten oferă infrastructură pentru inferența modelelor destinată companiilor care implementează aplicații de învățare automată și inteligență artificială. Platforma sa este concepută pentru servirea rapidă și scalabilă a modelelor, combinând inferența cu debit mare, implementarea rapidă, scalarea automată, servirea securizată a modelelor pentru companii și suportul pentru împachetarea modelelor open-source. Baseten ajută echipele de inginerie și învățare automată să gestioneze cerințele operaționale ale infrastructurii pentru modele, astfel încât să se poată concentra pe dezvoltarea unor modele specifice domeniului. Compania activează în domeniile inteligenței artificiale, software-ului ca serviciu și tehnologiei pentru întreprinderi și are o echipă de 11–50 de angajați.
LinkedIn
Locurile de muncă ale companiei

Engineering Manager, GPU Inference Performance at Baseten

Lead GPU inference performance engineering at Baseten, an AI infrastructure company. Guide runtime optimization, model efficiency, and the growth of a specialized technical team.

USStatele Unite ale AmericiiCACaliforniaNYNew York
240.000 $ – 270.000 $ / an
HibridNormă întreagăNivel mediuSeniorLimbă Obligatorie: englezăManager de inginerie
PyTorch

Descriere

  • Manage, mentor, and develop inference performance engineers through regular one-to-ones, feedback, career planning, and performance reviews
  • Recruit GPU and inference engineers while fostering a collaborative team culture
  • Own the runtime performance roadmap and its execution
  • Review technical designs, direct profiling and optimization work, and help engineers assess time and memory use
  • Productionize quantization, speculative decoding, KV-cache reuse, chunked prefill, and custom scheduling
  • Translate performance gains into measurable improvements in tokens per GPU-hour, utilization, latency, and cost
  • Bring new model architectures onto emerging hardware and tune their performance
  • Collaborate with Infrastructure, Inference Platform, Kernels, Model APIs, and customer-facing teams to prioritize work, coordinate launches, and deliver improvements
  • Establish engineering standards for quality, benchmarking, operational excellence, and incident response
  • Advance agentic inference optimization, agentic kernels, speculative-decoding model training, and the Baseten Inference Stack

Cerințe

  • Bachelor’s, master’s, or doctoral degree in computer science, engineering, mathematics, or a related discipline
  • Management experience covering engineering hiring, mentoring, feedback, and performance reviews
  • Experience leading or closely supporting GPU optimization teams in training, inference, or recommendation systems
  • Deep technical knowledge of GPU workloads, architecture, and performance tradeoffs
  • Familiarity with machine learning libraries including PyTorch, TensorRT, or TensorRT-LLM
  • Demonstrated ability to set roadmaps and deliver complex technical projects with a team
  • Strong written and verbal communication skills for aligning stakeholders across teams
  • Familiarity with inference engines such as vLLM, SGLang, or TensorRT-LLM
  • Experience applying LLM optimization methods such as quantization, speculative decoding, and continuous batching
  • Experience developing or working with GPU kernels using CUDA, Triton, or CUTLASS
  • Experience scaling an engineering team during rapid startup growth
  • Prior hands-on experience as a performance or systems engineer before moving into management

Beneficii

  • Competitive compensation package with meaningful equity
  • For U.S. employees, full medical, dental, and vision coverage for employees and dependents
  • Flexible paid time off, including a company-wide winter break
  • Paid parental leave
  • Fertility and family-building support through Carrot
  • For U.S. employees, a company-facilitated 401(k) plan
  • Opportunities to work with a range of machine learning startups and build industry connections

Locuri de muncă similare

Terumo Medical Corporation

Territory Manager, Interventional Systems — Philadelphia

Terumo Medical Corporation
1.001 – 5.000 Angajați
Sponsor pentru viza H1BAsistență medicalăConsultanțăIndustria prelucrătoare
USStatele Unite ale AmericiiPAPennsylvania
50.000 $ – 65.000 $ / an
La sediuNormă întreagăNivel mediuSeniorLimbă Obligatorie: englezăManager de conturiVânzări

Lead sales of Terumo Interventional Systems devices to hospitals and outpatient facilities in the Philadelphia area. Build accounts, support procedures, educate clinicians, and meet territory sales goals.

Deschide