PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation

09/23/2021
by   Alexey Kamenev, et al.
0

Predicting the future motion of traffic agents is crucial for safe and efficient autonomous driving. To this end, we present PredictionNet, a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with the ego-vehicle's motion. All predictions are probabilistic and are represented in a simple top-down rasterization that allows an arbitrary number of agents. Conditioned on a multilayer map with lane information, the network outputs future positions, velocities, and backtrace vectors jointly for all agents including the ego-vehicle in a single pass. Trajectories are then extracted from the output. The network can be used to simulate realistic traffic, and it produces competitive results on popular benchmarks. More importantly, it has been used to successfully control a real-world vehicle for hundreds of kilometers, by combining it with a motion planning/control subsystem. The network runs faster than real-time on an embedded GPU, and the system shows good generalization (across sensory modalities and locations) due to the choice of input representation. Furthermore, we demonstrate that by extending the DNN with reinforcement learning (RL), it can better handle rare or unsafe events like aggressive maneuvers and crashes.

READ FULL TEXT

page 1

page 2

page 4

research
12/07/2020

On-Road Motion Planning for Automated Vehicles at Ulm University

The Institute of Measurement, Control and Microtechnology of the Univers...
research
08/11/2021

Capture Uncertainties in Deep Neural Networks for Safe Operation of Autonomous Driving Vehicles

Uncertainties in Deep Neural Network (DNN)-based perception and vehicle'...
research
11/11/2022

GET-DIPP: Graph-Embedded Transformer for Differentiable Integrated Prediction and Planning

Accurately predicting interactive road agents' future trajectories and p...
research
05/31/2023

TOFG: A Unified and Fine-Grained Environment Representation in Autonomous Driving

In autonomous driving, an accurate understanding of environment, e.g., t...
research
02/21/2022

RTGNN: A Novel Approach to Model Stochastic Traffic Dynamics

Modeling stochastic traffic dynamics is critical to developing self-driv...
research
12/03/2022

A Hierarchical Approach for Strategic Motion Planning in Autonomous Racing

We present an approach for safe trajectory planning, where a strategic t...
research
10/26/2022

Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Models

Reasoning with occluded traffic agents is a significant open challenge f...

Please sign up or login with your details

Forgot password? Click here to reset