Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations

08/13/2020
by   Abbas Sadat, et al.
4

In this paper we propose a novel end-to-end learnable network that performs joint perception, prediction and motion planning for self-driving vehicles and produces interpretable intermediate representations. Unlike existing neural motion planners, our motion planning costs are consistent with our perception and prediction estimates. This is achieved by a novel differentiable semantic occupancy representation that is explicitly used as cost by the motion planning process. Our network is learned end-to-end from human demonstrations. The experiments in a large-scale manual-driving dataset and closed-loop simulation show that the proposed model significantly outperforms state-of-the-art planners in imitating the human behaviors while producing much safer trajectories.

READ FULL TEXT

page 14

page 23

page 24

page 25

page 26

page 27

page 28

research
08/13/2020

DSDNet: Deep Structured self-Driving Network

In this paper, we propose the Deep Structured self-Driving Network (DSDN...
research
11/02/2020

Perceive, Attend, and Drive: Learning Spatial Attention for Safe Self-Driving

In this paper, we propose an end-to-end self-driving network featuring a...
research
08/13/2020

Testing the Safety of Self-driving Vehicles by Simulating Perception and Prediction

We present a novel method for testing the safety of self-driving vehicle...
research
08/13/2020

Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D

The goal of perception for autonomous vehicles is to extract semantic re...
research
01/17/2021

Deep Multi-Task Learning for Joint Localization, Perception, and Prediction

Over the last few years, we have witnessed tremendous progress on many s...
research
03/01/2021

Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Map

While supervised learning is widely used for perception modules in conve...
research
01/18/2021

MP3: A Unified Model to Map, Perceive, Predict and Plan

High-definition maps (HD maps) are a key component of most modern self-d...

Please sign up or login with your details

Forgot password? Click here to reset