Associate Principal - Cloud Engineering

LTM is seeking an Associate Principal - Cloud Engineering to support a cloud-based GPU platform for AWS. The role focuses on deploying and operating NVIDIA AI Enterprise, EKS GPU workloads, model-serving infrastructure, GPU scheduling, autoscaling, telemetry, and inference performance optimization.

Responsibilities:

• Deploy and operate NVIDIA AI Enterprise NVAIE on EKS GPU Operator drivers CUDA runtime and DCGM
• Deploy and operate NIM microservices and NVIDIA Dynamo serving exposing the OpenAIcompatible API chatcompletions embeddings streaming batch
• Configure GPU sharing MIG where the SKU supports it and RunAI fractional GPU as the isolation baseline and clearly distinguish hardware vs software isolation
• Integrate RunAI for GPU scheduling quota and preemption and KEDA for replica autoscaling including scaletozero
• Instrument GPU telemetry via DCGM and drive inference performance validation and SLAtier binding
• Support the modelonboarding NIM packaging and inferencedeploy pipelines
• Tune GPUserving performance and troubleshoot CUDA driver and scheduling issues

Requirements:

• Mandatory Skills : AWS EKS
• • 8 years in infrastructureML engineering with handson NVIDIA GPU operations
• • NVIDIA GPU stack drivers CUDA GPU Operator and DCGM
• • Model serving Triton NVIDIA Dynamo NIM TensorRTLLM andor vLLM
• • Kubernetes GPU workloads and device plugins
• • GPU scheduling RunAI or equivalent and GPU partitioning MIG fractional GPU
• • Autoscaling KEDA and OpenAIcompatible inference API patterns
• Good to Have Skills : AWS Cloud Architecture, AWS CloudFormation
• • NVAIE on AWSEKS and edge GPU Outposts G7
• • LLM RAG serving and vector databases
• • Inference performance benchmarking and optimization