ReCoG: A Deep Learning Framework with Heterogeneous Graph for Interaction-Aware Trajectory Prediction

by   Xiaoyu Mo, et al.

Predicting the future trajectory of surrounding vehicles is essential for the navigation of autonomous vehicles in complex real-world driving scenarios. It is challenging as a vehicle's motion is affected by many factors, including its surrounding infrastructures and vehicles. In this work, we develop the ReCoG (Recurrent Convolutional and Graph Neural Networks), which is a general scheme that represents vehicle interactions with infrastructure information as a heterogeneous graph and applies graph neural networks (GNNs) to model the high-level interactions for trajectory prediction. Nodes in the graph contain corresponding features, where a vehicle node contains its sequential feature encoded using Recurrent Neural Network (RNN), and an infrastructure node contains spatial feature encoded using Convolutional Neural Network (CNN). Then the ReCoG predicts the future trajectory of the target vehicle by jointly considering all of the features. Experiments are conducted by using the INTERACTION dataset. Experimental results show that the proposed ReCoG outperforms other state-of-the-art methods in terms of different types of displacement error, validating the feasibility and effectiveness of the developed approach.



There are no comments yet.


page 1


Interaction-Aware Trajectory Prediction of Connected Vehicles using CNN-LSTM Networks

Predicting the future trajectory of a surrounding vehicle in congested t...

Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving

Forecasting the trajectories of neighbor vehicles is a crucial step for ...

Joint Interaction and Trajectory Prediction for Autonomous Driving using Graph Neural Networks

In this work, we aim to predict the future motion of vehicles in a traff...

CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attention

Predicting the motion of surrounding vehicles is essential for autonomou...

DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highways

Vehicle trajectory prediction is an essential task for enabling many int...

SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUs

Autonomous vehicles navigate in dynamically changing environments under ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.