Social-STAGE: Spatio-Temporal Multi-Modal Future Trajectory Forecast

11/10/2020
by   Srikanth Malla, et al.
0

This paper considers the problem of multi-modal future trajectory forecast with ranking. Here, multi-modality and ranking refer to the multiple plausible path predictions and the confidence in those predictions, respectively. We propose Social-STAGE, Social interaction-aware Spatio-Temporal multi-Attention Graph convolution network with novel Evaluation for multi-modality. Our main contributions include analysis and formulation of multi-modality with ranking using interaction and multi-attention, and introduction of new metrics to evaluate the diversity and associated confidence of multi-modal predictions. We evaluate our approach on existing public datasets ETH and UCY and show that the proposed algorithm outperforms the state of the arts on these datasets.

READ FULL TEXT
research
02/27/2022

Dual-Branched Spatio-temporal Fusion Network for Multi-horizon Tropical Cyclone Track Forecast

Tropical cyclone (TC) is an extreme tropical weather system and its traj...
research
08/23/2022

DeepInteraction: 3D Object Detection via Modality Interaction

Existing top-performance 3D object detectors typically rely on the multi...
research
02/19/2022

Multi-Modal Recurrent Fusion for Indoor Localization

This paper considers indoor localization using multi-modal wireless sign...
research
09/17/2019

NEMO: Future Object Localization Using Noisy Ego Priors

Predictive models for forecasting future behavior of road agents should ...
research
02/25/2022

On Modality Bias Recognition and Reduction

Making each modality in multi-modal data contribute is of vital importan...
research
10/23/2018

Deep Neural Ranking for Crowdsourced Geopolitical Event Forecasting

There are many examples of 'wisdom of the crowd' effects in which the la...
research
04/26/2020

On the Limits to Multi-Modal Popularity Prediction on Instagram – A New Robust, Efficient and Explainable Baseline

The predictability of social media popularity is a topic of much scienti...

Please sign up or login with your details

Forgot password? Click here to reset