Senior Manager, System Software Engineering - Metropolis Accelerated and Inferencing Software

NVIDIA is a world leader in physical AI, powering self-driving cars, humanoid robots, intelligent environments, medical devices, and more. Our software platforms are at the core of this mission, enabling innovators to build world-changing products that save lives, improve working conditions, and elevate standards of living across the globe. NVIDIA is looking for an engineering leader who is hands-on with deep learning—comfortable reading/modeling code, not just running it. You bring strong intuition for modern architectures (e.g., transformers, diffusion, VLMs etc), deep experience tuning for NVIDIA GPUs (kernels, memory, latency/efficiency trade-offs) / SOCs, and a proven record delivering robust, low-latency inference at scale. You have led teams that turn Accelerated Computing pipelines into reliable, measurable business impact for embedded and Enterprise platforms. You will work with a cohesive, high-performing team that’s been built and refined over the past nine years. An individual well aligned to experts in the industry is a great fit for this role! What you'll be doing: Lead, encourage, and develop world-class engineering teams distributed across various India locations. Drive Strategic Implementations of TensorRT, VLLM and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations. Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices. Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and build support. Apply customer insights to influence the composition and structure of upcoming SOC / GPU deep learning hardware. Scaling the team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep learning challenges. Representing Nvidia Deep learning solutions in webinars, conferences and partner events What we need to see: Masters in Computer Science/Electrical Engineering or equivalent experience. A minimum of 8 years of meaningful involvement in machine learning/deep learning research or practical experience, coupled with 6+ years of leadership background and overall 12+ years of industry experience. Over 10 years of validated expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multifaceted setting. Deep Knowledge of GPU, CPU and dedicated deep learning architecture fundamentals and low-level performance optimizations using heterogeneous computing. Hands-on experience with Multimedia Frameworks, Computer Vision, VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling. Strong expertise in large-scale data processing, systems build, or machine learning pipelines. Strong communication, careful planning, and technical leadership capabilities. Ways to Stand Out from the Crowd: We welcome candidates with a PhD or equivalent experience in a relevant field Leadership role in production deployment of Smart Spaces, Physical AI with a deep understanding of constraints and advancements of sensing, computing, and model architecture evolutions. Ability to lead and drive global teams across multiple continents and time zones Deep experience with CV, LLMs, VLMs, GenAI Models, and standards. With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous director-level engineer who loves challenges? Do you have a genuine passion for advancing the state of Data Science across a variety of industries? If so, we want to hear from you!