InteractionNet: Joint Planning and Prediction for Autonomous Driving with Transformers

09/07/2023
by   Jiawei Fu, et al.
0

Planning and prediction are two important modules of autonomous driving and have experienced tremendous advancement recently. Nevertheless, most existing methods regard planning and prediction as independent and ignore the correlation between them, leading to the lack of consideration for interaction and dynamic changes of traffic scenarios. To address this challenge, we propose InteractionNet, which leverages transformer to share global contextual reasoning among all traffic participants to capture interaction and interconnect planning and prediction to achieve joint. Besides, InteractionNet deploys another transformer to help the model pay extra attention to the perceived region containing critical or unseen vehicles. InteractionNet outperforms other baselines in several benchmarks, especially in terms of safety, which benefits from the joint consideration of planning and forecasting. The code will be available at https://github.com/fujiawei0724/InteractionNet.

READ FULL TEXT

page 1

page 3

page 6

research
10/20/2021

A Survey on Deep-Learning Approaches for Vehicle Trajectory Prediction in Autonomous Driving

With the rapid development of machine learning, autonomous driving has b...
research
09/19/2022

Efficient Speed Planning for Autonomous Driving in Dynamic Environment with Interaction Point Model

Safely interacting with other traffic participants is one of the core re...
research
12/25/2020

Prediction by Anticipation: An Action-Conditional Prediction Method based on Interaction Learning

In autonomous driving (AD), accurately predicting changes in the environ...
research
11/27/2019

Social Attention for Autonomous Decision-Making in Dense Traffic

We study the design of learning architectures for behavioural planning i...
research
12/07/2022

Towards Explainable Motion Prediction using Heterogeneous Graph Representations

Motion prediction systems aim to capture the future behavior of traffic ...
research
12/31/2021

An Intelligent Self-driving Truck System For Highway Transportation

Recently, there have been many advances in autonomous driving society, a...
research
03/22/2021

Multimodal Motion Prediction with Stacked Transformers

Predicting multiple plausible future trajectories of the nearby vehicles...

Please sign up or login with your details

Forgot password? Click here to reset