Hewlett Packard Enterprise
Hewlett Packard Enterprise
Hewlett Packard Enterprise हाइब्रिड क्लाउड और AI-संचालित संचालन चलाने वाले संगठनों के लिए एंटरप्राइज़ तकनीक विकसित करता है। इसके पोर्टफोलियो में HPE ProLiant सर्वर और HPE Cray हाई-परफॉर्मेंस कंप्यूटिंग, HPE Alletra स्टोरेज, HPE Aruba नेटवर्किंग, AI प्लेटफ़ॉर्म और तैयार AI फ़ैक्ट्रियाँ, तथा सेवा के रूप में GreenLake समाधान शामिल हैं। HPE Zero Trust और SASE जैसी सुरक्षा क्षमताएँ भी प्रदान करता है, साथ ही पेशेवर, सलाहकारी और सहायता सेवाएँ देता है, जो बड़े संगठनों को अपने बुनियादी ढाँचे को आधुनिक बनाने, डेटा सेंटर परिवेशों का प्रबंधन करने और बड़े पैमाने पर AI लागू करने में मदद करती हैं।

Senior Inference Software Engineer at HPE Hybrid

Lead development of HPE AI Essentials’ enterprise LLM inference runtime for customer-owned infrastructure. Improve GPU-efficient serving, distributed execution, and Kubernetes orchestration.

विवरण

  • Own core components of the LLM serving deployment, including engine integration, continuous batching, KV-cache management and reuse, and quantized execution.
  • Work with inference engineering teams to reduce time to first token, inter-token latency, GPU throughput, and P95/P99 tail latency.
  • Develop and operate distributed execution features such as disaggregated prefill and decode, tensor and pipeline parallelism, and KV-cache offload across GPU memory, host memory, and RDMA-attached storage.
  • Assess emerging runtimes, quantization methods, speculative decoding, and mixture-of-experts serving, then recommend technologies for adoption.
  • Help build the orchestration layer covering model admission, GPU scheduling and partitioning, cache-aware request routing, and autoscaling.
  • Resolve customer issues end to end, determine root causes, and strengthen related systems and processes.
  • Review code and designs, mentor colleagues, and model strong engineering practices.

आवश्यकताएँ

  • At least 8 years of software engineering experience.
  • One to two or more years of direct experience with LLM inference runtimes or production model serving.
  • A degree in computer science or a related discipline.
  • Familiarity with LLM inference engines such as vLLM, SGLang, TensorRT-LLM, TGI, or NVIDIA NIM, including experience modifying engine internals.
  • Strong knowledge of continuous batching, paged attention, KV-cache reuse and prefix caching, chunked prefill, quantization, and speculative decoding.
  • Working knowledge of tensor and pipeline parallelism, NCCL collective operations, GPU memory hierarchy, and interconnect behavior.
  • Advanced proficiency with Kubernetes platform architecture, including operators, custom resources, controllers, and scheduling.
  • Strong programming skills in Go and Python.
  • Ability to read, debug, and profile C++ and CUDA with tools such as Nsight.
  • Familiarity with debugging and profiling multi-tier workloads, including RAG and agent applications.
  • Excellent analytical, debugging, and problem-solving skills.
  • Preferred: Contributions to vLLM, SGLang, TensorRT-LLM, llm-d, LMCache, or KServe.
  • Preferred: Experience with disaggregated prefill and decode serving or large-scale KV-cache offload and reuse.
  • Preferred: Experience with RDMA, GPUDirect Storage, InfiniBand, or RoCE.
  • Preferred: Experience with MIG, fractional GPU allocation, and multi-tenant GPU isolation.
  • Preferred: Experience delivering software for on-premises, air-gapped, or regulated enterprise environments.

लाभ

  • Comprehensive benefits supporting physical health, financial security, and emotional wellbeing.
  • Programs supporting personal and professional growth.
  • Flexibility for work arrangements and personal needs.
  • An inclusive workplace culture.
  • Reasonable accommodations during the application or interview process for qualified applicants with disabilities.

संबंधित नौकरियाँ

FFS Fresh Food Services GmbH & Co. KG

Field Account Manager, Foodservice

FFS Fresh Food Services GmbH & Co. KG

Manage regional foodservice accounts for a specialist food wholesaler, advising customers and developing new business. The role covers sales performance, tailored product solutions, pricing and market monitoring.

खोलें
MOVYNG MEDIA

Content Agency Intern (Remote, Germany)

MOVYNG MEDIA

Year-long internship at a content agency, supporting video production planning. Work includes research, location scouting, and developing concepts for digital content.

खोलें
ProfitPath

Commercial Assistant, Preparatory Accounting (Cologne, Hybrid)

ProfitPath

Commercial assistant supporting bookkeeping and document management at FourByte, an Amazon sourcing software company. Help review and code invoices and support monthly processes.

खोलें
Venture Media

Remote B2B Sales Representative, Supply Chain and Logistics

Venture Media

Win Canadian business clients for Chit Chats’ shipping services, guiding prospects from outreach and discovery through proposals and qualification. Coordinate client handoffs and help businesses ship across Canada and internationally.

खोलें
CECO Environmental Corporation

Technical Sales Engineer, Water Treatment

CECO Environmental Corporation

Design, commission, and troubleshoot industrial water treatment systems for CECO Environmental. Partner with customers and commercial teams to develop technical solutions and support sustainable industrial operations.

खोलें
My Hero VA

Remote Healthcare Virtual Assistant (Mexico, Part-Time)

My Hero VA

Manage caregiver documentation, credentials, and training coordination for a U.S. staffing agency. This remote role is based in Mexico and offers 25 hours per week.

खोलें
epias GmbH

DevOps Engineer

epias GmbH

Join epias GmbH to support medical process management software through CI/CD, Kubernetes, infrastructure automation, and dependable platform operations.

खोलें
Labor Dr. Scheller GmbH

IT Systems Engineer, Infrastructure and Modern Workplace

Labor Dr. Scheller GmbH

Manage Windows infrastructure, VMware, Intune, and Microsoft 365 for a medical laboratory services provider. Support internal IT services and deliver infrastructure projects in Hamburg.

खोलें
S

IT Systems Engineer, Infrastructure and Modern Workplace

Sonic Healthcare Germany GmbH & Co. KG

Manage Windows, VMware, Intune, and Microsoft 365 systems supporting secure IT operations for Sonic Healthcare’s medical laboratories.

खोलें
SyncVR Medical

Mid-Level 3D XR Developer at SyncVR Medical (Remote, Serbia)

SyncVR Medical

Build AI-enhanced medical simulations and training experiences with Unity for SyncVR Medical’s healthcare platform. Develop scalable modules for hospitals and healthcare professionals.

खोलें