When Does A Spectral Graph Neural Network Fail in Node Classification?

02/16/2022
by   Zhixian Chen, et al.
0

Spectral Graph Neural Networks (GNNs) with various graph filters have received extensive affirmation due to their promising performance in graph learning problems. However, it is known that GNNs do not always perform well. Although graph filters provide theoretical foundations for model explanations, it is unclear when a spectral GNN will fail. In this paper, focusing on node classification problems, we conduct a theoretical analysis of spectral GNNs performance by investigating their prediction error. With the aid of graph indicators including homophily degree and response efficiency we proposed, we establish a comprehensive understanding of complex relationships between graph structure, node labels, and graph filters. We indicate that graph filters with low response efficiency on label difference are prone to fail. To enhance GNNs performance, we provide a provably better strategy for filter design from our theoretical analysis - using data-driven filter banks, and propose simple models for empirical validation. Experimental results show consistency with our theoretical results and support our strategy.

READ FULL TEXT
research
01/26/2023

Graph Neural Networks can Recover the Hidden Features Solely from the Graph Structure

Graph Neural Networks (GNNs) are popular models for graph learning probl...
research
12/07/2022

Node-oriented Spectral Filtering for Graph Neural Networks

Graph neural networks (GNNs) have shown remarkable performance on homoph...
research
06/25/2023

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

While graph heterophily has been extensively studied in recent years, a ...
research
06/09/2021

Scaling Up Graph Neural Networks Via Graph Coarsening

Scalability of graph neural networks remains one of the major challenges...
research
07/16/2023

Automated Polynomial Filter Learning for Graph Neural Networks

Polynomial graph filters have been widely used as guiding principles in ...
research
06/25/2022

Infinite Impulse Response Graph Neural Networks for Cyberattack Localization in Smart Grids

This study employs Infinite Impulse Response (IIR) Graph Neural Networks...
research
07/08/2023

Manifold Filter-Combine Networks

We introduce a class of manifold neural networks (MNNs) that we call Man...

Please sign up or login with your details

Forgot password? Click here to reset