Cloud Services Software Engineer

About This Role

Joining NVIDIA's DGX Cloud Team means contributing to the infrastructure that powers innovative AI research. This team focuses on optimizing efficiency and resiliency of ML workloads, as well as developing scalable AI infrastructure tools and services. The objective is to deliver a stable, scalable environment for AI researchers, providing them with the vital resources and scale to champion innovation.

Responsibilities

• Develop solutions at the intersection of machine learning, distributed systems, and high-performance computing, supplying to the advancement of AI technologies
• Design, develop, and optimize (micro-)services orchestrated by Kubernetes to provide large-scale AI training workflows on AI training supercomputers located at major CSPs, with resiliency and efficiency
• Co-design and implement the APIs that allow these services to integrate vertically with NVIDIA's resiliency stacks, ranging from tier-0 telemetry services to break/fix automation services to checkpoint and execution systems
• Craft a submission abstraction that enables model engineers and training platforms/frameworks to seamlessly submit long-running training jobs while hiding the complexity of handling infrastructure failures, running job lifecycles with auto-restarts on failure, ensuring full efficiency, and promptly advising users
• Craft these services to be modular, enabling them to be coordinated with and deployed onto on-premises AI clusters that apply NVIDIA Hardware and Cloud services

Requirements

• Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience)
• 5+ years of hands-on experience in backend development, preferably with Python, Go, C/C++, or similar high-performance languages
• Consistent track record of building and scaling large-scale distributed systems
• Experience with cloud computing platforms such as AWS, Azure, and GCP, as well as container technologies like Docker and Kubernetes, and HPC/AI platforms such as Slurm

Nice to have:

• Real world experience in DL frameworks, orchestrators like PyTorch, TensorFlow, JAX, and Ray
• Experience in developing a framework plugin architecture that allows the framework to be integrated with the cluster scheduler visibly to the users
• Strong understanding of NVIDIA GPUs, network technologies, and their failure patterns
• Experience with AI models and AI based tools
• Provide references to your code contributions

Benefits

• Equity
• Benefits

Important Details

• Application deadline: October 25, 2026

About the Company

NVIDIA leads the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, their invention, serves as the visual cortex of modern computers and is at the heart of their products and services. Their work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions, from artificial intelligence to autonomous cars. NVIDIA is looking for exceptional people to help accelerate the next wave of artificial intelligence!