Baseten
Baseten
Baseten उन कंपनियों के लिए मॉडल इन्फरेंस इंफ्रास्ट्रक्चर उपलब्ध कराता है, जो मशीन लर्निंग और एआई एप्लिकेशन तैनात करती हैं। इसका प्लेटफ़ॉर्म तेज़ और बड़े पैमाने पर मॉडल सर्विंग के लिए बनाया गया है, जिसमें उच्च-थ्रूपुट इन्फरेंस, तेज़ परिनियोजन, ऑटोस्केलिंग, सुरक्षित एंटरप्राइज़ मॉडल सर्विंग और ओपन-सोर्स मॉडल पैकेजिंग का समर्थन शामिल है। Baseten इंजीनियरिंग और मशीन लर्निंग टीमों को मॉडल इंफ्रास्ट्रक्चर की परिचालन संबंधी चुनौतियों को संभालने में मदद करता है, ताकि वे डोमेन-विशिष्ट मॉडल विकसित करने पर ध्यान केंद्रित कर सकें। कंपनी कृत्रिम बुद्धिमत्ता, SaaS और एंटरप्राइज़ तकनीक के क्षेत्रों में काम करती है और इसमें 11–50 कर्मचारी हैं।

Engineering Manager, GPU Inference Performance at Baseten

Lead GPU inference performance engineering at Baseten, an AI infrastructure company. Guide runtime optimization, model efficiency, and the growth of a specialized technical team.

विवरण

  • Manage, mentor, and develop inference performance engineers through regular one-to-ones, feedback, career planning, and performance reviews
  • Recruit GPU and inference engineers while fostering a collaborative team culture
  • Own the runtime performance roadmap and its execution
  • Review technical designs, direct profiling and optimization work, and help engineers assess time and memory use
  • Productionize quantization, speculative decoding, KV-cache reuse, chunked prefill, and custom scheduling
  • Translate performance gains into measurable improvements in tokens per GPU-hour, utilization, latency, and cost
  • Bring new model architectures onto emerging hardware and tune their performance
  • Collaborate with Infrastructure, Inference Platform, Kernels, Model APIs, and customer-facing teams to prioritize work, coordinate launches, and deliver improvements
  • Establish engineering standards for quality, benchmarking, operational excellence, and incident response
  • Advance agentic inference optimization, agentic kernels, speculative-decoding model training, and the Baseten Inference Stack

आवश्यकताएँ

  • Bachelor’s, master’s, or doctoral degree in computer science, engineering, mathematics, or a related discipline
  • Management experience covering engineering hiring, mentoring, feedback, and performance reviews
  • Experience leading or closely supporting GPU optimization teams in training, inference, or recommendation systems
  • Deep technical knowledge of GPU workloads, architecture, and performance tradeoffs
  • Familiarity with machine learning libraries including PyTorch, TensorRT, or TensorRT-LLM
  • Demonstrated ability to set roadmaps and deliver complex technical projects with a team
  • Strong written and verbal communication skills for aligning stakeholders across teams
  • Familiarity with inference engines such as vLLM, SGLang, or TensorRT-LLM
  • Experience applying LLM optimization methods such as quantization, speculative decoding, and continuous batching
  • Experience developing or working with GPU kernels using CUDA, Triton, or CUTLASS
  • Experience scaling an engineering team during rapid startup growth
  • Prior hands-on experience as a performance or systems engineer before moving into management

लाभ

  • Competitive compensation package with meaningful equity
  • For U.S. employees, full medical, dental, and vision coverage for employees and dependents
  • Flexible paid time off, including a company-wide winter break
  • Paid parental leave
  • Fertility and family-building support through Carrot
  • For U.S. employees, a company-facilitated 401(k) plan
  • Opportunities to work with a range of machine learning startups and build industry connections

संबंधित नौकरियाँ

Kreato Global | BPO and Language Solutions
Red Hat

Red Hat OpenShift Cloud Consultant

Red Hat

Implement Red Hat OpenShift, Ceph, and Ansible solutions for enterprise customers in Israel. Design cloud architectures and advance DevOps automation at customer sites.

खोलें
Taurus SA

IT Technician and Client Support Specialist

Taurus SA

Support Taurus’s corporate users and external clients at a regulated digital-asset fintech. Handle Azure infrastructure, endpoint support, ticket triage, and client issue resolution.

खोलें
RecruitGo

Remote Executive Assistant, Outreach and Marketing — Philippines

RecruitGo

Handle administrative support, CRM, outreach, and marketing for RecruitGo, an Employer of Record serving global clients with talent from emerging markets. Support two UK-facing clients with day-to-day administration and creative campaigns.

खोलें
Mars

Mars Customer Manager, Wegmans Account, Illinois Remote

Mars

Lead Mars Snacking’s Accelerator account strategy for Wegmans. Drive retailer growth through assortment, merchandising, pricing, promotions, and forecasting.

खोलें
Outforce

Credit Control and Collections Analyst

Outforce

Manage receivables, collections, and cash flow reporting for an FMCG business. Use SAP, Vend, and Excel to assess customer accounts and credit risk.

खोलें
SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 कर्मचारी

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

खोलें
Salonkee

Sales Representative, Salon Software — Göttingen

Salonkee

Grow Salonkee’s salon software business across Göttingen through local prospecting, product demonstrations, and end-to-end sales. Build relationships with salon owners and guide them from first contact through to closing.

खोलें
Salonkee

Hybrid Sales Representative, Lindau

Salonkee

Grow Salonkee’s salon software business across Lindau and Friedrichshafen through outreach, product demonstrations, and end-to-end sales. Build relationships with local salon owners and manage each opportunity through to closing.

खोलें
Salonkee

Sales Representative in Göttingen (Hybrid)

Salonkee

Grow Salonkee’s salon software business in Göttingen by building local salon relationships. The role spans cold outreach, product demonstrations, and managing sales from first contact through closing.

खोलें