Pre-train and Learn: Preserve Global Information for Graph Neural Networks

by   Danhao Zhu, et al.

Graph neural networks (GNNs) have shown great power in learning on attributed graphs. However, it is still a challenge for GNNs to utilize information faraway from the source node. Moreover, general GNNs require graph attributes as input, so they cannot be appled to plain graphs. In the paper, we propose new models named G-GNNs (Global information for GNNs) to address the above limitations. First, the global structure and attribute features for each node are obtained via unsupervised pre-training, which preserve the global information associated to the node. Then, using the global features and the raw network attributes, we propose a parallel framework of GNNs to learn different aspects from these features. The proposed learning methods can be applied to both plain graphs and attributed graphs. Extensive experiments have shown that G-GNNs can outperform other state-of-the-art models on three standard evaluation graphs. Specially, our methods establish new benchmark records on Cora (84.31%) and Pubmed (80.95%) when learning on attributed graphs.


page 1

page 2

page 3

page 4


On Node Features for Graph Neural Networks

Graph neural network (GNN) is a deep model for graph representation lear...

Collaborative Graph Neural Networks for Attributed Network Embedding

Graph neural networks (GNNs) have shown prominent performance on attribu...

Tree Mover's Distance: Bridging Graph Metrics and Stability of Graph Neural Networks

Understanding generalization and robustness of machine learning models f...

Learning on Large-scale Text-attributed Graphs via Variational Inference

This paper studies learning on text-attributed graphs (TAGs), where each...

MentorGNN: Deriving Curriculum for Pre-Training GNNs

Graph pre-training strategies have been attracting a surge of attention ...

Graph Attentional Autoencoder for Anticancer Hyperfood Prediction

Recent research efforts have shown the possibility to discover anticance...

Substitutional Alloying Using Crystal Graph Neural Networks

Materials discovery, especially for applications that require extreme op...

Please sign up or login with your details

Forgot password? Click here to reset