Network In Graph Neural Network

by   Xiang Song, et al.

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this regard, various strategies have been proposed in the past to improve the expressiveness of GNNs. For example, one straightforward option is to simply increase the parameter size by either expanding the hid-den dimension or increasing the number of GNN layers. However, wider hidden layers can easily lead to overfitting, and incrementally adding more GNN layers can potentially result in over-smoothing.In this paper, we present a model-agnostic methodology, namely Network In Graph Neural Network (NGNN ), that allows arbitrary GNN models to increase their model capacity by making the model deeper. However, instead of adding or widening GNN layers, NGNN deepens a GNN model by inserting non-linear feedforward neural network layer(s) within each GNN layer. An analysis of NGNN as applied to a GraphSage base GNN on ogbn-products data demonstrate that it can keep the model stable against either node feature or graph structure perturbations. Furthermore, wide-ranging evaluation results on both node classification and link prediction tasks show that NGNN works reliably across diverse GNN architectures.For instance, it improves the test accuracy of GraphSage on the ogbn-products by 1.6 improves the hits@100 score of SEAL on ogbl-ppa by 7.08 of GraphSage+Edge-Attr on ogbl-ppi by 6.22 submission, it achieved two first places on the OGB link prediction leaderboard.


page 1

page 2

page 3

page 4


NDGGNET-A Node Independent Gate based Graph Neural Networks

Graph Neural Networks (GNNs) is an architecture for structural data, and...

Efficient and effective training of language and graph neural network models

Can we combine heterogenous graph structure with text to learn high-qual...

NENET: An Edge Learnable Network for Link Prediction in Scene Text

Text detection in scenes based on deep neural networks have shown promis...

Analyzing the Performance of Graph Neural Networks with Pipe Parallelism

Many interesting datasets ubiquitous in machine learning and deep learni...

Decouple Graph Neural Networks: Train Multiple Simple GNNs Simultaneously Instead of One

Graph neural networks (GNN) suffer from severe inefficiency. It is mainl...

GROWL: Group Detection With Link Prediction

Interaction group detection has been previously addressed with bottom-up...

A Robust Stacking Framework for Training Deep Graph Models with Multifaceted Node Features

Graph Neural Networks (GNNs) with numerical node features and graph stru...

Please sign up or login with your details

Forgot password? Click here to reset