Graph Symbiosis Learning

06/10/2021
by   Liang Zeng, et al.
13

We introduce a framework for learning from multiple generated graph views, named graph symbiosis learning (GraphSym). In GraphSym, graph neural networks (GNN) developed in multiple generated graph views can adaptively exchange parameters with each other and fuse information stored in linkage structures and node features. Specifically, we propose a novel adaptive exchange method to iteratively substitute redundant channels in the weight matrix of one GNN with informative channels of another GNN in a layer-by-layer manner. GraphSym does not rely on specific methods to generate multiple graph views and GNN architectures. Thus, existing GNNs can be seamlessly integrated into our framework. On 3 semi-supervised node classification datasets, GraphSym outperforms previous single-graph and multiple-graph GNNs without knowledge distillation, and achieves new state-of-the-art results. We also conduct a series of experiments on 15 public benchmarks, 8 popular GNN models, and 3 graph tasks – node classification, graph classification, and edge prediction – and show that GraphSym consistently achieves better performance than existing popular GNNs by 1.9%∼3.9% on average and their ensembles. Extensive ablation studies and experiments on the few-shot setting also demonstrate the effectiveness of GraphSym.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2020

Bayesian Graph Neural Networks with Adaptive Connection Sampling

We propose a unified framework for adaptive connection sampling in graph...
research
12/24/2022

Multi-duplicated Characterization of Graph Structures using Information Gain Ratio for Graph Neural Networks

Various graph neural networks (GNNs) have been proposed to solve node cl...
research
10/12/2022

Boosting Graph Neural Networks via Adaptive Knowledge Distillation

Graph neural networks (GNNs) have shown remarkable performance on divers...
research
11/10/2019

Improving Node Classification by Co-training Node Pair Classification: A Novel Training Framework for General Graph Neural Networks

Semi-supervised learning is a widely used training framework for graph n...
research
07/01/2020

A Novel Higher-order Weisfeiler-Lehman Graph Convolution

Current GNN architectures use a vertex neighborhood aggregation scheme, ...
research
06/25/2023

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

While graph heterophily has been extensively studied in recent years, a ...
research
11/25/2021

AutoHEnsGNN: Winning Solution to AutoGraph Challenge for KDD Cup 2020

Graph Neural Networks (GNNs) have become increasingly popular and achiev...

Please sign up or login with your details

Forgot password? Click here to reset