DeepAI AI Chat
Log In Sign Up

Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representation

by   Kaouther Messaoud, et al.
University of California, San Diego

Predicting the trajectories of surrounding agents is an essential ability for robots navigating complex real-world environments. Autonomous vehicles (AV) in particular, can generate safe and efficient path plans by predicting the motion of surrounding road users. Future trajectories of agents can be inferred using two tightly linked cues: the locations and past motion of agents, and the static scene structure. The configuration of the agents may uncover which part of the scene is more relevant, while the scene structure can determine the relative influence of agents on each other's motion. To better model the interdependence of the two cues, we propose a multi-head attention-based model that uses a joint representation of the static scene and agent configuration for generating both keys and values for the attention heads. Moreover, to address the multimodality of future agent motion, we propose to use each attention head to generate a distinct future trajectory of the agent. Our model achieves state of the art results on the publicly available nuScenes dataset and generates diverse future trajectories compliant with scene structure and agent configuration. Additionally, the visualization of attention maps adds a layer of interpretability to the trajectories predicted by the model.


Multi-Head Attention with Joint Agent-Map Representation for Trajectory Prediction in Autonomous Driving

For autonomous vehicles to navigate in urban environment, the ability to...

Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Grids

Forecasting long-term human motion is a challenging task due to the non-...

Physically constrained short-term vehicle trajectory forecasting with naive semantic maps

Urban environments manifest a high level of complexity, and therefore it...

Traffic Agent Trajectory Prediction Using Social Convolution and Attention Mechanism

The trajectory prediction is significant for the decision-making of auto...

Latent Variable Nested Set Transformers AutoBots

Humans have the innate ability to attend to the most relevant actors in ...