STN Incorporated
STN Incorporated
STN Incorporated oferă servicii IT gestionate și infrastructură cloud pentru întreprinderi și echipe care dezvoltă software esențial pentru activitatea companiilor, sisteme de inteligență artificială și robotică. Serviciile sale includ clouduri private cu procesoare CPU, infrastructura de inteligență artificială GPU One, rețele și stocare securizate, precum și operațiuni cloud continue, susținute de asistență umană 24/7 și acorduri privind nivelul serviciilor pentru disponibilitate ridicată. Compania gestionează și operațiuni de securitate cibernetică și răspuns la incidente, conformitate și managementul riscurilor, copii de rezervă și recuperare, precum și achiziții tehnologice și gestionarea ciclului de viață al tehnologiei. STN deservește companii SaaS, dezvoltatori de soluții AI și de modele, firme de robotică și organizații reglementate, inclusiv furnizori de servicii medicale, cu infrastructură concepută pentru pregătirea auditurilor și pentru cadre precum SOC 2 Type II și HIPAA.

Senior Inference Workload Optimization Lead

Lead GPU performance tuning for customer AI workloads on STN’s autonomous data center platform. Turn optimization expertise into agent-executable fixes and oversee internal model serving.

Descriere

  • Analyze customer training and inference workloads to locate performance bottlenecks across data loading, collective communication, memory bandwidth, kernels, batching, and parallelism.
  • Set performance baselines for each hardware generation, beginning with current-generation NVIDIA systems.
  • Translate optimization expertise into fixes that agents can apply across customer clusters.
  • Tune workloads with committed-capacity customers, directly or through their operating teams.
  • As a secondary responsibility, manage internal model serving, including cost- and latency-aware routing and model-version migrations.
  • Advise on allocating GPUs between internal inference and customer workloads.

Cerințe

  • Bring deep GPU performance engineering expertise, including profiling, memory and bandwidth behavior, and kernel-level understanding.
  • Have hands-on knowledge of serving stacks such as vLLM, SGLang, or TensorRT-LLM, including batching, KV cache management, and quantization trade-offs.
  • Have experience with distributed training and inference at scale, including tensor, pipeline, and data parallelism.
  • Have experience tuning collective communication, such as NCCL.
  • Be fluent with profiling tools such as Nsight, DCGM, and framework-level profilers.
  • Be able to explain performance findings to customers and encode solutions for an agent.
  • Nice to have: CUDA kernel development, large-scale open-weight model deployment, benchmark design, and previous customer-facing technical experience.

Locuri de muncă similare

Gramian Consulting

AI Conversation Research and Evaluation Specialist

Gramian Consulting

Gramian Consulting is hiring an AI conversation evaluator to improve the quality of AI recommendations. The role uses structured qualitative analysis to assess interpersonal scenarios and identify missing context.

Deschide
CDW

AI Infrastructure Consulting Engineer, Compute and Storage

CDW

Design and validate GPU compute and high-performance storage solutions for enterprise AI and machine learning workloads. Help CDW customers implement infrastructure for AI training, fine-tuning, and inference.

Deschide
Salesforce

Senior AI Innovation Lead, Life Sciences

Salesforce

Lead Salesforce’s Life Sciences AI delivery strategy, developing reusable capabilities and advancing customer transformation. Guide a global team across product, engineering, and professional services.

Deschide