Multi-Modal Graph Interaction for Multi-Graph Convolution Network in Urban Spatiotemporal Forecasting

05/27/2019
by   Xu Geng, et al.
2

Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, like region-wise distance or functional similarity. To incorporate multiple relationships into spatial feature extraction, we define the problem as a multi-modal machine learning problem on multi-graph convolution networks. Leveraging the advantage of multi-modal machine learning, we propose to develop modality interaction mechanisms for this problem, in order to reduce generalization error by reinforcing the learning of multimodal coordinated representations. In this work, we propose two interaction techniques for handling features in lower layers and higher layers respectively. In lower layers, we propose grouped GCN to combine the graph connectivity from different modalities for more complete spatial feature extraction. In higher layers, we adapt multi-linear relationship networks to GCN by exploring the dimension transformation and freezing part of the covariance structure. The adapted approach, called multi-linear relationship GCN, learns more generalized features to overcome the train-test divergence induced by time shifting. We evaluated our model on ridehailing demand forecasting problem using two real-world datasets. The proposed technique outperforms state-of-the art baselines in terms of prediction accuracy, training efficiency, interpretability and model robustness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2021

GACAN: Graph Attention-Convolution-Attention Networks for Traffic Forecasting Based on Multi-granularity Time Series

Traffic forecasting is an integral part of intelligent transportation sy...
research
04/08/2019

Large Margin Multi-modal Multi-task Feature Extraction for Image Classification

The features used in many image analysis-based applications are frequent...
research
03/03/2023

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

Multi-modal integration and classification based on graph learning is am...
research
01/20/2021

Ensemble manifold based regularized multi-modal graph convolutional network for cognitive ability prediction

Objective: Multi-modal functional magnetic resonance imaging (fMRI) can ...
research
12/15/2021

Joint Demand Prediction for Multimodal Systems: A Multi-task Multi-relational Spatiotemporal Graph Neural Network Approach

Dynamic demand prediction is crucial for the efficient operation and man...
research
03/15/2021

S-AT GCN: Spatial-Attention Graph Convolution Network based Feature Enhancement for 3D Object Detection

3D object detection plays a crucial role in environmental perception for...
research
12/18/2021

GCN-Geo: A Graph Convolution Network-based Fine-grained IP Geolocation Framework

Classical fine-grained measurement-based IP geolocation algorithms often...

Please sign up or login with your details

Forgot password? Click here to reset