Zoox
Sensor Fusion Internship/Co-op
Zoox, Foster City, California, United States, 94420
The Zoox Sensor Fusion Detection team is developing the next-generation Perception model to achieve the following goals:
1. Unify the existing PixelSpace Range View representation with the VoxelSpace Voxel representation into one architecture
2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes
3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)
4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs
5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views
Technical Qualifications & Language Requirements
Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problemsExperience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)Proficient in PyTorch model design, implementation, training and evaluationProficient in Python programmingComputer Science or Electrical Engineering background with PhD degreeBonus Qualifications
Experience writing C++ softwareGPU/CUDA programming experienceExperience with model deployment with TensorRTExperience working with LiDAR, Camera and Radar dataExperience in algorithm development for Autonomous Driving software
Compensation
The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We're looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
1. Unify the existing PixelSpace Range View representation with the VoxelSpace Voxel representation into one architecture
2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes
3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)
4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs
5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views
Technical Qualifications & Language Requirements
Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problemsExperience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)Proficient in PyTorch model design, implementation, training and evaluationProficient in Python programmingComputer Science or Electrical Engineering background with PhD degreeBonus Qualifications
Experience writing C++ softwareGPU/CUDA programming experienceExperience with model deployment with TensorRTExperience working with LiDAR, Camera and Radar dataExperience in algorithm development for Autonomous Driving software
Compensation
The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We're looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.