Node-oriented Spectral Filtering for Graph Neural Networks

12/07/2022
by   Shuai Zheng, et al.
0

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In general, since the real-world graphs are often a complex mixture of diverse subgraph patterns, learning a universal spectral filter on the graph from the global perspective as in most current works may still suffer from great difficulty in adapting to the variation of local patterns. On the basis of the theoretical analysis on local patterns, we rethink the existing spectral filtering methods and propose the Node-oriented spectral Filtering for Graph Neural Network (namely NFGNN). By estimating the node-oriented spectral filter for each node, NFGNN is provided with the capability of precise local node positioning via the generalized translated operator, thus discriminating the variations of local homophily patterns adaptively. Meanwhile, the utilization of re-parameterization brings a good trade-off between global consistency and local sensibility for learning the node-oriented spectral filters. Furthermore, we theoretically analyze the localization property of NFGNN, demonstrating that the signal after adaptive filtering is still positioned around the corresponding node. Extensive experimental results demonstrate that the proposed NFGNN achieves more favorable performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2022

When Does A Spectral Graph Neural Network Fail in Node Classification?

Spectral Graph Neural Networks (GNNs) with various graph filters have re...
research
05/23/2022

How Powerful are Spectral Graph Neural Networks

Spectral Graph Neural Network is a kind of Graph Neural Network (GNN) ba...
research
03/26/2021

Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphs

Graph neural networks (GNNs) have been extensively studied for predictio...
research
03/02/2023

Specformer: Spectral Graph Neural Networks Meet Transformers

Spectral graph neural networks (GNNs) learn graph representations via sp...
research
09/06/2021

Pointspectrum: Equivariance Meets Laplacian Filtering for Graph Representation Learning

Graph Representation Learning (GRL) has become essential for modern grap...
research
05/24/2023

Size Generalizability of Graph Neural Networks on Biological Data: Insights and Practices from the Spectral Perspective

We investigate the question of whether the knowledge learned by graph ne...
research
07/18/2023

Sharpness-Aware Graph Collaborative Filtering

Graph Neural Networks (GNNs) have achieved impressive performance in col...

Please sign up or login with your details

Forgot password? Click here to reset