Get Rid of Suspended Animation Problem: Deep Diffusive Neural Network on Graph Semi-Supervised Classification

01/22/2020
by   Jiawei Zhang, et al.
5

Existing graph neural networks may suffer from the "suspended animation problem" when the model architecture goes deep. Meanwhile, for some graph learning scenarios, e.g., nodes with text/image attributes or graphs with long-distance node correlations, deep graph neural networks will be necessary for effective graph representation learning. In this paper, we propose a new graph neural network, namely DIFNET (Graph Diffusive Neural Network), for graph representation learning and node classification. DIFNET utilizes both neural gates and graph residual learning for node hidden state modeling, and includes an attention mechanism for node neighborhood information diffusion. Extensive experiments will be done in this paper to compare DIFNET against several state-of-the-art graph neural network models. The experimental results can illustrate both the learning performance advantages and effectiveness of DIFNET, especially in addressing the "suspended animation problem".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2019

On Node Features for Graph Neural Networks

Graph neural network (GNN) is a deep model for graph representation lear...
research
04/17/2019

Inductive Graph Representation Learning with Recurrent Graph Neural Networks

In this paper, we study the problem of node representation learning with...
research
08/01/2019

Graph Neural Networks for Small Graph and Giant Network Representation Learning: An Overview

Graph neural networks denote a group of neural network models introduced...
research
07/11/2023

Supervised Attention Using Homophily in Graph Neural Networks

Graph neural networks have become the standard approach for dealing with...
research
06/08/2020

Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization

Deep representation learning on non-Euclidean data types, such as graphs...
research
09/29/2020

Direct Multi-hop Attention based Graph Neural Network

Introducing self-attention mechanism in graph neural networks (GNNs) ach...
research
06/05/2019

DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classification

Graph data widely exist in many high-impact applications. Inspired by th...

Please sign up or login with your details

Forgot password? Click here to reset