Graph Neural Networks with Low-rank Learnable Local Filters

08/04/2020
by   Xiuyuan Cheng, et al.
0

For the classification of graph data consisting of features sampled on an irregular coarse mesh like landmark points on face and human body, graph neural network (gnn) models based on global graph Laplacians may lack expressiveness to capture local features on graph. The current paper introduces a new gnn layer type with learnable low-rank local graph filters, which significantly reduces the complexity of traditional locally connected gnn. The architecture provides a unified framework for both spectral and spatial convolutional gnn constructions. The new gnn layer is provably more expressive than gnn based on global graph Laplacians, and to improve model robustness, regularization by local graph Laplacians is introduced. The representation stability against input graph data perturbation is theoretically proved, making use of the graph filter locality and the local graph regularization. Experiments on spherical mesh data, real-world facial expression recognition/skeleton-based action recognition data, and data with simulated graph noise show the empirical advantage of the proposed model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2023

Local-to-global Perspectives on Graph Neural Networks

This thesis presents a local-to-global perspective on graph neural netwo...
research
11/13/2022

Learning Stable Graph Neural Networks via Spectral Regularization

Stability of graph neural networks (GNNs) characterizes how GNNs react t...
research
11/09/2020

Graph Neural Network with Automorphic Equivalence Filters

Graph neural network (GNN) has recently been established as an effective...
research
05/28/2019

LatentGNN: Learning Efficient Non-local Relations for Visual Recognition

Capturing long-range dependencies in feature representations is crucial ...
research
03/02/2023

Technical report: Graph Neural Networks go Grammatical

This paper proposes a new GNN design strategy. This strategy relies on C...
research
06/25/2022

Infinite Impulse Response Graph Neural Networks for Cyberattack Localization in Smart Grids

This study employs Infinite Impulse Response (IIR) Graph Neural Networks...
research
02/01/2022

GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed Graph Neural Networks

Recovering global rankings from pairwise comparisons is an important pro...

Please sign up or login with your details

Forgot password? Click here to reset