Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approach

09/17/2022
by   Wendong Bi, et al.
1

Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some researchers turn their attention to designing GNNs for heterophily graphs by adjusting the message passing mechanism or enlarging the receptive field of the message passing. Different from existing works that mitigate the issues of heterophily from model design perspective, we propose to study heterophily graphs from an orthogonal perspective by rewiring the graph structure to reduce heterophily and making the traditional GNNs perform better. Through comprehensive empirical studies and analysis, we verify the potential of the rewiring methods. To fully exploit its potential, we propose a method named Deep Heterophily Graph Rewiring (DHGR) to rewire graphs by adding homophilic edges and pruning heterophilic edges. The detailed way of rewiring is determined by comparing the similarity of label/feature-distribution of node neighbors. Besides, we design a scalable implementation for DHGR to guarantee high efficiency. DHRG can be easily used as a plug-in module, i.e., a graph pre-processing step, for any GNNs, including both GNN for homophily and heterophily, to boost their performance on the node classification task. To the best of our knowledge, it is the first work studying graph rewiring for heterophily graphs. Extensive experiments on 11 public graph datasets demonstrate the superiority of our proposed methods.

READ FULL TEXT

page 3

page 9

research
10/06/2022

Expander Graph Propagation

Deploying graph neural networks (GNNs) on whole-graph classification or ...
research
10/21/2022

Efficient Automatic Machine Learning via Design Graphs

Despite the success of automated machine learning (AutoML), which aims t...
research
10/21/2022

FoSR: First-order spectral rewiring for addressing oversquashing in GNNs

Graph neural networks (GNNs) are able to leverage the structure of graph...
research
06/11/2020

Pointer Graph Networks

Graph neural networks (GNNs) are typically applied to static graphs that...
research
04/03/2023

Uncertainty Propagation in Node Classification

Quantifying predictive uncertainty of neural networks has recently attra...
research
06/21/2023

Spatial Heterophily Aware Graph Neural Networks

Graph Neural Networks (GNNs) have been broadly applied in many urban app...
research
06/30/2021

Informed Machine Learning for Improved Similarity Assessment in Process-Oriented Case-Based Reasoning

Currently, Deep Learning (DL) components within a Case-Based Reasoning (...

Please sign up or login with your details

Forgot password? Click here to reset