Manager, Large Language Model Inference

<div><b>What You'll Be Doing:</b><br/><ul><li>Lead and grow a team responsible for specialized kernel development, runtime optimizations, and frameworks for LLM inference.</li><li>Drive the design, development, and delivery of production inference software, targeting NVIDIA's next-generation enterprise and edge hardware platforms.</li><li>Integrating cutting-edge technologies developed at NVIDIA and offering an intuitive developer experience for LLM deployment.</li><li>Lead software development execution, with responsibility for project planning, milestone delivery, and cross-functional coordination.</li></ul><br/><br/><b>What We Need to See:</b><br/><ul><li>MS, PhD, or equivalent experience in Computer Science, Computer Engineering, AI, or a related technical field.</li><li>7+ overall years of overall software engineering experience, including 3+ years of technical leadership experience.</li><li>Proven ability to lead and scale high-performing engineering teams, especially across distributed and cross-functional groups.</li><li>Strong background in C++ or Python, with expertise in software design and delivering production-quality software libraries.</li><li>Demonstrated expertise in large language models (LLM) and/or vision language models (VLM).</li></ul><br/><br/><b>Ways to Stand Out from the Crowd:</b><br/><ul><li>Deep understanding of GPU architecture, CUDA programming, and system-level performance tuning.</li><li>Background in LLM inference or working with frameworks such as TensorRT-LLM, vLLM, or SGLang.</li><li>Passion for building scalable, user-friendly APIs and enabling developers in the AI ecosystem.</li><li>Have a proven track record of growing and managing a team that encourages idea sharing, empowers team members, and provides opportunities for professional growth.</li></ul><br/><br/>#LI-Hybrid<br/><br/>Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 2, and 224,000 USD - 356,500 USD for Level 3.<br/><br/>You will also be eligible for equity and benefits.<br/><br/>Applications for this job will be accepted at least until March 26, 2026.<br/><br/>This posting is for an existing vacancy. <br/><br/>NVIDIA uses AI tools in its recruiting processes.</div>