Self-Supervised Action-Space Prediction for Automated Driving

09/21/2021
by   Faris Janjoš, et al.
0

Making informed driving decisions requires reliable prediction of other vehicles' trajectories. In this paper, we present a novel learned multi-modal trajectory prediction architecture for automated driving. It achieves kinematically feasible predictions by casting the learning problem into the space of accelerations and steering angles – by performing action-space prediction, we can leverage valuable model knowledge. Additionally, the dimensionality of the action manifold is lower than that of the state manifold, whose intrinsically correlated states are more difficult to capture in a learned manner. For the purpose of action-space prediction, we present the simple Feed-Forward Action-Space Prediction (FFW-ASP) architecture. Then, we build on this notion and introduce the novel Self-Supervised Action-Space Prediction (SSP-ASP) architecture that outputs future environment context features in addition to trajectories. A key element in the self-supervised architecture is that, based on an observed action history and past context features, future context features are predicted prior to future trajectories. The proposed methods are evaluated on real-world datasets containing urban intersections and roundabouts, and show accurate predictions, outperforming state-of-the-art for kinematically feasible predictions in several prediction metrics.

READ FULL TEXT

page 1

page 6

research
06/06/2023

Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervision

Accurate vehicle trajectory prediction is an unsolved problem in autonom...
research
04/29/2020

Action Sequence Predictions of Vehicles in Urban Environments using Map and Social Context

This work studies the problem of predicting the sequence of future actio...
research
11/26/2021

StarNet: Joint Action-Space Prediction with Star Graphs and Implicit Global Frame Self-Attention

In this work, we present a novel multi-modal multi-agent trajectory pred...
research
03/12/2017

Prediction and Control with Temporal Segment Models

We introduce a method for learning the dynamics of complex nonlinear sys...
research
04/01/2021

LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agents

In this paper, we address the problem of predicting the future motion of...
research
02/08/2018

Practical Issues of Action-conditioned Next Image Prediction

The problem of action-conditioned image prediction is to predict the exp...
research
01/14/2021

Instance-Aware Predictive Navigation in Multi-Agent Environments

In this work, we aim to achieve efficient end-to-end learning of driving...

Please sign up or login with your details

Forgot password? Click here to reset