Automated Polynomial Filter Learning for Graph Neural Networks

07/16/2023
by   Wendi Yu, et al.
0

Polynomial graph filters have been widely used as guiding principles in the design of Graph Neural Networks (GNNs). Recently, the adaptive learning of the polynomial graph filters has demonstrated promising performance for modeling graph signals on both homophilic and heterophilic graphs, owning to their flexibility and expressiveness. In this work, we conduct a novel preliminary study to explore the potential and limitations of polynomial graph filter learning approaches, revealing a severe overfitting issue. To improve the effectiveness of polynomial graph filters, we propose Auto-Polynomial, a novel and general automated polynomial graph filter learning framework that efficiently learns better filters capable of adapting to various complex graph signals. Comprehensive experiments and ablation studies demonstrate significant and consistent performance improvements on both homophilic and heterophilic graphs across multiple learning settings considering various labeling ratios, which unleashes the potential of polynomial filter learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/07/2021

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Graph Neural Networks (GNNs) exploit signals from node features and the ...
research
06/21/2021

BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation

Many representative graph neural networks, e.g., GPR-GNN and ChebyNet, a...
research
01/05/2019

Graph Neural Networks with convolutional ARMA filters

Recent graph neural networks implement convolutional layers based on pol...
research
02/16/2022

When Does A Spectral Graph Neural Network Fail in Node Classification?

Spectral Graph Neural Networks (GNNs) with various graph filters have re...
research
02/03/2018

GeniePath: Graph Neural Networks with Adaptive Receptive Paths

We present, GeniePath, a scalable approach for learning adaptive recepti...
research
05/09/2022

Wiener filters on graphs and distributed polynomial approximation algorithms

In this paper, we consider Wiener filters to reconstruct deterministic a...
research
02/24/2023

Graph Neural Networks with Learnable and Optimal Polynomial Bases

Polynomial filters, a kind of Graph Neural Networks, typically use a pre...

Please sign up or login with your details

Forgot password? Click here to reset