Class-Aware Attention for Multimodal Trajectory Prediction

08/31/2022
by   Bimsara Pathiraja, et al.
0

Predicting the possible future trajectories of the surrounding dynamic agents is an essential requirement in autonomous driving. These trajectories mainly depend on the surrounding static environment, as well as the past movements of those dynamic agents. Furthermore, the multimodal nature of agent intentions makes the trajectory prediction problem more challenging. All of the existing models consider the target agent as well as the surrounding agents similarly, without considering the variation of physical properties. In this paper, we present a novel deep-learning based framework for multimodal trajectory prediction in autonomous driving, which considers the physical properties of the target and surrounding vehicles such as the object class and their physical dimensions through a weighted attention module, that improves the accuracy of the predictions. Our model has achieved the highest results in the nuScenes trajectory prediction benchmark, out of the models which use rasterized maps to input environment information. Furthermore, our model is able to run in real-time, achieving a high inference rate of over 300 FPS.

READ FULL TEXT

page 3

page 5

research
04/19/2022

Importance is in your attention: agent importance prediction for autonomous driving

Trajectory prediction is an important task in autonomous driving. State-...
research
03/06/2020

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Multi-agent trajectory forecasting in autonomous driving requires an age...
research
07/06/2020

Traffic Agent Trajectory Prediction Using Social Convolution and Attention Mechanism

The trajectory prediction is significant for the decision-making of auto...
research
09/05/2019

Occ-Traj120: Occupancy Maps with Associated Trajectories

Trajectory modelling had been the principal research area for understand...
research
08/17/2023

XVTP3D: Cross-view Trajectory Prediction Using Shared 3D Queries for Autonomous Driving

Trajectory prediction with uncertainty is a critical and challenging tas...
research
01/24/2023

Topological Trajectory Prediction with Homotopy Classes

Trajectory prediction in a cluttered environment is key to many importan...
research
04/28/2019

Dynamic Environment Prediction in Urban Scenes using Recurrent Representation Learning

A key challenge for autonomous driving is safe trajectory planning in cl...

Please sign up or login with your details

Forgot password? Click here to reset