NDGGNET-A Node Independent Gate based Graph Neural Networks

05/11/2022
by   Ye Tang, et al.
0

Graph Neural Networks (GNNs) is an architecture for structural data, and has been adopted in a mass of tasks and achieved fabulous results, such as link prediction, node classification, graph classification and so on. Generally, for a certain node in a given graph, a traditional GNN layer can be regarded as an aggregation from one-hop neighbors, thus a set of stacked layers are able to fetch and update node status within multi-hops. For nodes with sparse connectivity, it is difficult to obtain enough information through a single GNN layer as not only there are only few nodes directly connected to them but also can not propagate the high-order neighbor information. However, as the number of layer increases, the GNN model is prone to over-smooth for nodes with the dense connectivity, which resulting in the decrease of accuracy. To tackle this issue, in this thesis, we define a novel framework that allows the normal GNN model to accommodate more layers. Specifically, a node-degree based gate is employed to adjust weight of layers dynamically, that try to enhance the information aggregation ability and reduce the probability of over-smoothing. Experimental results show that our proposed model can effectively increase the model depth and perform well on several datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/23/2021

Network In Graph Neural Network

Graph Neural Networks (GNNs) have shown success in learning from graph s...
research
10/29/2021

GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily

Graph Neural Networks (GNNs) are widely used on a variety of graph-based...
research
11/28/2022

DGI: Easy and Efficient Inference for GNNs

While many systems have been developed to train Graph Neural Networks (G...
research
11/12/2021

Simplifying approach to Node Classification in Graph Neural Networks

Graph Neural Networks have become one of the indispensable tools to lear...
research
05/19/2022

Spatial Autoregressive Coding for Graph Neural Recommendation

Graph embedding methods including traditional shallow models and deep Gr...
research
08/01/2023

PVG: Progressive Vision Graph for Vision Recognition

Convolution-based and Transformer-based vision backbone networks process...
research
05/30/2021

Hop-Aware Dimension Optimization for Graph Neural Networks

In Graph Neural Networks (GNNs), the embedding of each node is obtained ...

Please sign up or login with your details

Forgot password? Click here to reset