Principal Engineer, Distributed Systems - NIM Factory

NVIDIA has become the platform upon which every new AI-powered application is built. We are seeking a principal engineer to architect and build factory automation for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes and serves performant inferencing for every AI model. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self hosted infrastructure and locally on all NVIDIA GPUs. You will apply your deep technical expertise to design an efficient, scalable and reliable automated service that will take AI models to become NIMs that are validated for best in class performance and accuracy.NVIDIA is building a new category of products by intersecting our prowess in deep learning and computing with industry-leading technologies. You will harness groundbreaking technologies, and build highly efficient factory to power how NVIDIA builds and validates NIMs for Inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIAs workflows and build the cross functional infrastructure and software platform that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere. We are looking for a principal engineer to design and build our factory capabilities, including the underlying infrastructure, software platform, backends, containerized build, test harness, with metrics and traceability.What you'll be doing: Architect and build a software factory that will take an AI model and create deployable services across Cloud and On-prem Kubernetes environmentsDesign scalable services with resource efficiency to build and deploy distributed applicationsDefine and deliver rapid iterations of group's technical strategies and roadmaps for a scalable NIM factory systemDeliver a highly scalable and reliable factory architecture that operates with very high uptime while performantCollaborate with multiple AI model teams to understand their requirements and build an efficient infrastructure that improves productivityDefine metrics and drive improvements based on user feedbacksPartner with our NIM leadership to deliver a cohesive product to customersWhat we need to see: You possess advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologiesExperience on designing and implementing highly scalable Cloud Services with well defined APIs.Ability to work optimally with multi-functional teams, principals and architects, across organizational boundariesDeep technical expertise in Microservices, K8s, Cloud Endpoints, Temporal, Helm, Prometheus, KafkaPassion for building rich, microservice applications with automated build and test pipelineExcellent interpersonal skills and the ability to lead multi-functional effortsBS or MS in Computer Science, Computer Engineering or related field (or equivalent experience)12+ years of proven experience in performant microservice and/or cloud technical leadership roles in an agile software development environment.12+ years of demonstrated ability in build, debugging, performance analysis and optimizationWays to stand out from the crowd: Highly proficient in building distributed systems, Microservices, Cloud and On-prem deployments, and CI/CD pipelinesPrior experience in working with large scale full stack developmentWe are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative and autonomous with a real passion for technology we want to hear from you.The base salary range is 272,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time