Machine Learning Research Scientist - Reinforcement Learning

Who We AreNuro exists to better everyday life through robotics. The company’s custom electric autonomous vehicles are designed to bring the things you need—from produce to prescriptions—right to your home. Nuro’s autonomous, goods-focused solution can give you valuable time back and more freedom to do what you love. This convenient, eco-friendly alternative to driving has the potential to make streets safer and cities more livable.About The RoleThe mandate of the research team is to use advanced machine learning techniques to accelerate software progress. In this role, you will work closely with the software vertical teams to understand their pain points and explore novel and advanced machine learning methods to solve practical real-world challenging problems. If you love solving challenging new problems with a mindset of deriving practical solutions to eventually be used on the vehicle, come join us!You will be primarily responsible for training RL model for planning in a real-world setting. It includes but is not limited to designing/using appropriate RL algorithms, improving value/risk estimation, tuning reward to shape good driving behavior, gathering appropriate training data, iterating and thinking about solutions from bad behaviors of the model, etc. The goal is to push RL performance to show that it can achieve comparable or better performance than traditional approaches for planning and that we can scale planning with more data and compute.You should have a deep understanding of how RL works, understand major RL algorithms and their tradeoffs, and have hands-on experience in training RL models and making them work. You should have a strong interest in the problem and deploy models to the product to handle real-world scenarios. It is a plus if you have the experience to apply RL to some real-world problems with safety constraints.In addition, you will participate in task solving using self-supervised learning to learn robust representations, exploring techniques for out-of-distribution detection to solve long tail problems, working on trajectory prediction and motion planning, investigating the robustness of models to mitigate uncertainties, or trying to build an end-to-end driving system.About The WorkResearch new machine learning problems and modelsWork on joint trajectory prediction and motion planningIterate on RL planner to make it better than traditional methods in real-world scenarios and prove it is a scalable solution to planningDevelop various types of reward models including those based on human feedbackCollaborate with autonomy teams to understand their pain points and priorities to define milestones of the corresponding roadmapsDerive practical solutions and deploy them on the NuroBotAbout YouYou have deep expertise and prior experience in some or many of the following areas:You have an M.Sc. plus 2-3 years of relevant work experience or a Ph.D. (preferable) focusing on one or more of the following areas: Computer Science, Artificial Intelligence, Mathematics, or a closely related fieldYou have subject matter expertise and research in one or more of the following areas: Machine Learning, Deep Learning, RoboticsDeep knowledge and understanding of reinforcement learning and experience in how to train it wellStrong intuition and creativity in how to apply their knowledge for RL planningPassionate about solving real-world challenging ML/Robotics problemsYou have strong problem solving and programming skills in C++ or PythonStrong culture fit and good team playerDemonstrated research publications in any of the major conferences (RSS, ICRA, CoRL, CVPR, ICLR, ICML, NeurIPS, ICCV, AAAI, etc.)At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected pay range is between $167,200 and $250,800/year for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

#J-18808-Ljbffr