Software Engineer - Platform

About UsWe believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.Overview:We are seeking highly motivated and skilled systems engineers to join our team to help in developing the CentML platform that offers a cost effective infrastructure for serving and training large scale machine learning models. As a systems engineer, you will play a crucial role in building a unified solution that brings our innovative in-house technologies such as Hidet compiler, DeepView, and other ML optimizations into a single, cohesive platform. Your expertise will drive the scalability, performance, and reliability of the platform, enabling our customers to seamlessly access and utilize a comprehensive suite of ML services that we offer.Responsibilities:Taking part in the design and development of the CentML platform.Designing and building solutions for scheduling large scale ML training and inference workloads on GPU clusters over multiple CSPs.Communicate with our product teams and define use cases, and develop methodology & benchmarks to evaluate different approaches.Qualifications:Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Graduate degree with research experience is a plus.Experience building large scale systems from scratch. Prior experience in container-based deployment systems like Kubernetes is a big plus.Strong coding skills (in at least one of Python and C++).Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc.Benefits & Perks- An open and inclusive culture and work environment- Fully stocked kitchen at the office- Full health and dental benefits- Parental Leave top-up for 6 months- Continuous education budget- Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just askAt CentML, we celebrate our differences and value cultivating an inclusive environment for all. We welcome applications of all kinds and are committed to providing an equal opportunity process.

#J-18808-Ljbffr