Testing the Safety of Self-driving Vehicles by Simulating Perception and Prediction

08/13/2020
by   Kelvin Wong, et al.
9

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs of the self-driving vehicle's perception and prediction system, enabling realistic motion planning testing. Specifically, we use paired data in the form of ground truth labels and real perception and prediction outputs to train a model that predicts what the online system will produce. Importantly, the inputs to our system consists of high definition maps, bounding boxes, and trajectories, which can be easily sketched by a test engineer in a matter of minutes. This makes our approach a much more scalable solution. Quantitative results on two large-scale datasets demonstrate that we can realistically test motion planning using our simulations.

READ FULL TEXT

page 10

page 26

page 27

page 28

page 29

page 30

08/13/2020

Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations

In this paper we propose a novel end-to-end learnable network that perfo...
11/16/2020

Recovering and Simulating Pedestrians in the Wild

Sensor simulation is a key component for testing the performance of self...
11/01/2020

Beelines: Evaluating Motion Prediction Impact on Self-Driving Safety and Comfort

The commonly used metrics for motion prediction do not correlate well wi...
06/25/2020

One Thousand and One Hours: Self-driving Motion Prediction Dataset

We present the largest self-driving dataset for motion prediction to dat...
08/13/2020

DSDNet: Deep Structured self-Driving Network

In this paper, we propose the Deep Structured self-Driving Network (DSDN...
06/04/2020

The Importance of Prior Knowledge in Precise Multimodal Prediction

Roads have well defined geometries, topologies, and traffic rules. While...
07/20/2022

A System-driven Automatic Ground Truth Generation Method for DL Inner-City Driving Corridor Detectors

Data-driven perception approaches are well-established in automated driv...