GTNet: A Tree-Based Deep Graph Learning Architecture

04/27/2022
by   Nan Wu, et al.
13

We propose Graph Tree Networks (GTNets), a deep graph learning architecture with a new general message passing scheme that originates from the tree representation of graphs. In the tree representation, messages propagate upward from the leaf nodes to the root node, and each node preserves its initial information prior to receiving information from its child nodes (neighbors). We formulate a general propagation rule following the nature of message passing in the tree to update a node's feature by aggregating its initial feature and its neighbor nodes' updated features. Two graph representation learning models are proposed within this GTNet architecture - Graph Tree Attention Network (GTAN) and Graph Tree Convolution Network (GTCN), with experimentally demonstrated state-of-the-art performance on several popular benchmark datasets. Unlike the vanilla Graph Attention Network (GAT) and Graph Convolution Network (GCN) which have the "over-smoothing" issue, the proposed GTAN and GTCN models can go deep as demonstrated by comprehensive experiments and rigorous theoretical analysis.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 9

page 10

research
02/28/2023

Framelet Message Passing

Graph neural networks (GNNs) have achieved champion in wide applications...
research
02/03/2023

Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing

Most graph neural networks follow the message passing mechanism. However...
research
10/17/2022

AMPNet: Attention as Message Passing for Graph Neural Networks

Feature-level interactions between nodes can carry crucial information f...
research
06/06/2022

A Simple yet Effective Method for Graph Classification

In deep neural networks, better results can often be obtained by increas...
research
10/03/2021

Graph Representation Learning for Spatial Image Steganalysis

In this paper, we introduce a graph representation learning architecture...
research
09/06/2021

Reasoning Graph Networks for Kinship Verification: from Star-shaped to Hierarchical

In this paper, we investigate the problem of facial kinship verification...
research
05/12/2023

AGFormer: Efficient Graph Representation with Anchor-Graph Transformer

To alleviate the local receptive issue of GCN, Transformers have been ex...

Please sign up or login with your details

Forgot password? Click here to reset