GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

06/25/2023
by   Shuaicheng Zhang, et al.
0

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)? In this paper, we aim to demystify the impact of graph heterophily on GNN spectral filters. Our theoretical results show that it is essential to design adaptive polynomial filters that adapts different degrees of graph heterophily to guarantee the generalization performance of GNNs. Inspired by our theoretical findings, we propose a simple yet powerful GNN named GPatcher by leveraging the MLP-Mixer architectures. Our approach comprises two main components: (1) an adaptive patch extractor function that automatically transforms each node's non-Euclidean graph representations to Euclidean patch representations given different degrees of heterophily, and (2) an efficient patch mixer function that learns salient node representation from both the local context information and the global positional information. Through extensive experiments, the GPatcher model demonstrates outstanding performance on node classification compared with popular homophily GNNs and state-of-the-art heterophily GNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2021

Node-wise Localization of Graph Neural Networks

Graph neural networks (GNNs) emerge as a powerful family of representati...
research
02/16/2022

When Does A Spectral Graph Neural Network Fail in Node Classification?

Spectral Graph Neural Networks (GNNs) with various graph filters have re...
research
03/26/2021

Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphs

Graph neural networks (GNNs) have been extensively studied for predictio...
research
06/10/2021

Graph Symbiosis Learning

We introduce a framework for learning from multiple generated graph view...
research
03/24/2023

LONGNN: Spectral GNNs with Learnable Orthonormal Basis

In recent years, a plethora of spectral graph neural networks (GNN) meth...
research
11/19/2021

Positional Encoder Graph Neural Networks for Geographic Data

Graph neural networks (GNNs) provide a powerful and scalable solution fo...
research
08/15/2022

Learnable Filters for Geometric Scattering Modules

We propose a new graph neural network (GNN) module, based on relaxations...

Please sign up or login with your details

Forgot password? Click here to reset