Towards Better Graph Representation Learning with Parameterized Decomposition Filtering

05/10/2023
by   Mingqi Yang, et al.
0

Proposing an effective and flexible matrix to represent a graph is a fundamental challenge that has been explored from multiple perspectives, e.g., filtering in Graph Fourier Transforms. In this work, we develop a novel and general framework which unifies many existing GNN models from the view of parameterized decomposition and filtering, and show how it helps to enhance the flexibility of GNNs while alleviating the smoothness and amplification issues of existing models. Essentially, we show that the extensively studied spectral graph convolutions with learnable polynomial filters are constrained variants of this formulation, and releasing these constraints enables our model to express the desired decomposition and filtering simultaneously. Based on this generalized framework, we develop models that are simple in implementation but achieve significant improvements and computational efficiency on a variety of graph learning tasks. Code is available at https://github.com/qslim/PDF.

READ FULL TEXT
research
03/02/2023

Specformer: Spectral Graph Neural Networks Meet Transformers

Spectral graph neural networks (GNNs) learn graph representations via sp...
research
05/31/2023

Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popu...
research
04/26/2021

Graph Neural Networks with Adaptive Frequency Response Filter

Graph Neural Networks have recently become a prevailing paradigm for var...
research
05/03/2021

UniGNN: a Unified Framework for Graph and Hypergraph Neural Networks

Hypergraph, an expressive structure with flexibility to model the higher...
research
03/15/2023

Graph-less Collaborative Filtering

Graph neural networks (GNNs) have shown the power in representation lear...
research
09/04/2020

About Graph Degeneracy, Representation Learning and Scalability

Graphs or networks are a very convenient way to represent data with lots...
research
04/03/2021

Adaptive Filters and Aggregator Fusion for Efficient Graph Convolutions

Training and deploying graph neural networks (GNNs) remains difficult du...

Please sign up or login with your details

Forgot password? Click here to reset