NVIDIA
NVIDIA
NVIDIA razvija tehnologije pospešenega računalništva in umetne inteligence, ki se uporabljajo v igrah, podatkovnih centrih, računalništvu v oblaku, zdravstvu, proizvodnji, avtomobilski industriji in robotiki. Njeno delo obsega grafične procesne enote, platforme umetne inteligence, simulacije in rešitve za posamezne panoge, vključno z NVIDIA Omniverse za sodelovalne 3D-delovne tokove, NVIDIA DRIVE za razvoj avtonomnih vozil in NVIDIA Clara za zdravstvene aplikacije. Podjetje združuje velike tehnične ekipe, ki delajo na infrastrukturi in programski opremi za napredno računalništvo, simulacije in analitiko, ki jo poganja umetna inteligenca.

Senior Deep Learning Software Engineer, Inference

Build and tune GPU-accelerated software for large-scale AI inference at NVIDIA. Improve open-source serving frameworks and model performance across NVIDIA accelerators.

Opis

  • Build and optimize GPU-accelerated software for AI applications.
  • Develop and maintain open-source frameworks for large-scale model serving and inference.
  • Enhance inference platforms and support language model deployment and serving.
  • Implement new algorithms for release through inference frameworks.
  • Drive performance gains for advanced LLM and generative AI models across NVIDIA accelerators.
  • Apply tools such as CUTLASS, OAI Triton, NCCL, and CUDA kernels to optimize model-serving pipelines.
  • Analyze and tune deep learning models in LLM, multimodal, and generative AI.
  • Scale model performance across architectures and NVIDIA accelerator types.
  • Contribute features and code to NVIDIA inference libraries, vLLM, SGLang, FlashInfer, and LLM software.
  • Work with teams across frameworks, NVIDIA libraries, and inference optimization solutions.

Zahteve

  • Master’s degree, PhD, or equivalent experience in a relevant field such as computer engineering, computer science, EECS, or AI.
  • At least five years of relevant software development experience.
  • Strong C/C++ programming and software design skills.
  • Agile software development experience is helpful.
  • Python experience is a plus.
  • Production experience training, deploying, or optimizing deep learning model inference is a plus.
  • Experience in performance modeling, profiling, debugging, and code optimization, or knowledge of CPU and GPU architecture, is a plus.
  • GPU programming experience with CUDA, OAI Triton, or CUTLASS is a plus.
  • Experience contributing to deep learning software projects such as PyTorch, vLLM, or SGLang.
  • Experience with multi-GPU communications, including NCCL or NVSHMEM.

Ugodnosti

  • Comprehensive benefits package.
  • Equity.

Sorodna delovna mesta

LINQ

Remote Weekend Client Services Specialist

LINQ

Provide remote support to corporate mobile device clients by phone, chat, and email. Handle tickets, activations, orders, migrations, and account issues for LINQ’s managed mobility services.

Odpri
BNY

Senior Director, Institutional Client Service

BNY

Lead high-touch service and onboarding for BNY’s institutional banking clients, building executive relationships and owning service quality. Oversee service commitments, escalations, and cross-functional work to resolve client issues.

Odpri
Aprio

Client Service Director, Talent Advisory

Aprio

Lead Aprio’s Talent Advisory practice, oversee client relationships and portfolio growth, and build the business nationally. Develop sales and recruiting teams while delivering talent solutions across the United States.

Odpri
Worldwide Clinical Trials

Senior Proposals and Client Services Specialist

Worldwide Clinical Trials

Coordinate clinical trial proposals, RFI responses, budgets, and client service at Worldwide Clinical Trials. Help improve submission quality and operational efficiency.

Odpri