Meta-path Analysis on Spatio-Temporal Graphs for Pedestrian Trajectory Prediction

02/27/2022
by   Aamir Hasan, et al.
0

Spatio-temporal graphs (ST-graphs) have been used to model time series tasks such as traffic forecasting, human motion modeling, and action recognition. The high-level structure and corresponding features from ST-graphs have led to improved performance over traditional architectures. However, current methods tend to be limited by simple features, despite the rich information provided by the full graph structure, which leads to inefficiencies and suboptimal performance in downstream tasks. We propose the use of features derived from meta-paths, walks across different types of edges, in ST-graphs to improve the performance of Structural Recurrent Neural Network. In this paper, we present the Meta-path Enhanced Structural Recurrent Neural Network (MESRNN), a generic framework that can be applied to any spatio-temporal task in a simple and scalable manner. We employ MESRNN for pedestrian trajectory prediction, utilizing these meta-path based features to capture the relationships between the trajectories of pedestrians at different points in time and space. We compare our MESRNN against state-of-the-art ST-graph methods on standard datasets to show the performance boost provided by meta-path information. The proposed model consistently outperforms the baselines in trajectory prediction over long time horizons by over 32%, and produces more socially compliant trajectories in dense crowds. For more information please refer to the project website at https://sites.google.com/illinois.edu/mesrnn/home.

READ FULL TEXT
research
11/17/2015

Structural-RNN: Deep Learning on Spatio-Temporal Graphs

Deep Recurrent Neural Network architectures, though remarkably capable a...
research
11/27/2022

Spatio-Temporal Meta-Graph Learning for Traffic Forecasting

Traffic forecasting as a canonical task of multivariate time series fore...
research
12/12/2022

MegaCRN: Meta-Graph Convolutional Recurrent Network for Spatio-Temporal Modeling

Spatio-temporal modeling as a canonical task of multivariate time series...
research
05/08/2020

STINet: Spatio-Temporal-Interactive Network for Pedestrian Detection and Trajectory Prediction

Detecting pedestrians and predicting future trajectories for them are cr...
research
05/06/2020

UST: Unifying Spatio-Temporal Context for Trajectory Prediction in Autonomous Driving

Trajectory prediction has always been a challenging problem for autonomo...
research
04/27/2022

Global Trajectory Helps Person Retrieval in a Camera Network

We are concerned about retrieving a query person from the videos taken b...
research
10/24/2019

Spatiotemporal Tile-based Attention-guided LSTMs for Traffic Video Prediction

This extended abstract describes our solution for the Traffic4Cast Chall...

Please sign up or login with your details

Forgot password? Click here to reset