Graph Random Neural Network

05/22/2020
by   Wenzheng Feng, et al.
57

Graph neural networks (GNNs) have generalized deep learning methods into graph-structured data with promising performance on graph mining tasks. However, existing GNNs often meet complex graph structures with scarce labeled nodes and suffer from the limitations of non-robustness, over-smoothing, and overfitting. To address these issues, we propose a simple yet effective GNN framework—Graph Random Neural Network (Grand). Different from the deterministic propagation in existing GNNs, Grand adopts a random propagation strategy to enhance model robustness. This strategy also naturally enables Grand to decouple the propagation from feature transformation, reducing the risks of over-smoothing and overfitting. Moreover, random propagation acts as an efficient method for graph data augmentation. Based on this, we propose the consistency regularization for Grand by leveraging the distributional consistency of unlabeled nodes in multiple augmentations, improving the generalization capacity of the model. Extensive experiments on graph benchmark datasets suggest that Grand significantly outperforms state-of-the-art GNN baselines on semi-supervised graph learning tasks. Finally, we show that Grand mitigates the issues of over-smoothing and overfitting, and its performance is married with robustness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2021

Graph Attention Networks with LSTM-based Path Reweighting

Graph Neural Networks (GNNs) have been extensively used for mining graph...
research
08/02/2021

Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training data

There has been a recent surge of interest in designing Graph Neural Netw...
research
03/12/2022

GRAND+: Scalable Graph Random Neural Networks

Graph neural networks (GNNs) have been widely adopted for semi-supervise...
research
09/07/2019

Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View

Graph Neural Networks (GNNs) have achieved promising performance on a wi...
research
06/14/2020

Joint Adaptive Feature Smoothing and Topology Extraction via Generalized PageRank GNNs

In many important applications, the acquired graph-structured data inclu...
research
06/28/2023

Graph Interpolation via Fast Fused-Gromovization

Graph data augmentation has proven to be effective in enhancing the gene...
research
03/06/2023

Graph Positional Encoding via Random Feature Propagation

Two main families of node feature augmentation schemes have been explore...

Please sign up or login with your details

Forgot password? Click here to reset