Zoox
Zoox
Zoox develops autonomous mobility technology and a purpose-built fleet for mobility-as-a-service. Its work brings together robotics, artificial intelligence, vehicle engineering, electric vehicles, and advanced sensing to create transportation designed to be safer, cleaner, and more enjoyable. The company is focused on reshaping how people experience personal mobility through fully autonomous vehicles built around the needs of riders.

Machine Learning Engineer, 3D Sensor Simulation

Build machine learning models and synthetic sensor data for Zoox’s autonomous vehicle fleet. Improve lidar, radar, and camera simulation using 3D reconstruction and generative methods.

Description

  • Develop and validate machine learning models that make simulated lidar, radar, and camera data more realistic in autonomous vehicle simulation pipelines.
  • Integrate 3D Gaussian Splatting and NeRF-based reconstruction with simulation across sensor modalities, working with Synthetic Data and HIL Simulation teams.
  • Create and maintain training datasets from real and simulated sensor data, using generative AI techniques for data augmentation.
  • Work with Simulation Verification and Validation and Perception engineers to set sensor realism metrics and address significant simulation-to-reality gaps.
  • Guide engineers and interns, and establish sound practices for training and deploying machine learning on Zoox sensor data.
  • Create high-fidelity synthetic data and hardware-in-the-loop simulation for training and evaluating autonomous vehicle AI.
  • Increase simulated sensor realism to help Zoox’s robotics autonomy stack learn and improve.

Requirements

  • At least 3 years of experience developing machine learning models in Python with PyTorch or TensorFlow.
  • Industry experience applying machine learning to sensor data, such as lidar, radar, or camera data.
  • A strong understanding of customizing, tuning, and validating machine learning training pipelines.
  • Experience with generative methods such as diffusion, flow matching, or variational autoencoders.
  • Experience with 3D reconstruction methods, including 3D Gaussian Splatting and NeRFs, or differentiable rendering.
  • Previous experience developing autonomy for autonomous vehicles or other robotics and computer vision applications.

Benefits

  • Paid sick leave, vacation, and bereavement leave.
  • Unpaid time off.
  • Zoox Stock Appreciation Rights.
  • Amazon Restricted Stock Units (RSUs).
  • Health insurance.
  • Long-term care insurance.
  • Long-term and short-term disability insurance.
  • Life insurance.
  • A sign-on bonus may be included in the compensation package.

Related Jobs