Software Engineering Intern, Dynamo - Fall 2026

NVIDIA is a leading technology company focused on AI and computing innovation. The Software Engineering Intern will work on the Dynamo project, contributing to the development of scalable AI systems and addressing challenges in distributed inference.

Responsibilities:

• Collaborate on the design and development of the Dynamo Kubernetes stack
• Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library; design, implement, and optimize distributed inference components in Rust and Python
• Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs)
• Improve intelligent routing and KV-cache management subsystems
• Contribute to open-source repositories, participate in code reviews, assist with issue triage on GitHub, work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture