Distributional Signals for Node Classification in Graph Neural Networks

04/07/2023
by   Feng Ji, et al.
0

In graph neural networks (GNNs), both node features and labels are examples of graph signals, a key notion in graph signal processing (GSP). While it is common in GSP to impose signal smoothness constraints in learning and estimation tasks, it is unclear how this can be done for discrete node labels. We bridge this gap by introducing the concept of distributional graph signals. In our framework, we work with the distributions of node labels instead of their values and propose notions of smoothness and non-uniformity of such distributional graph signals. We then propose a general regularization method for GNNs that allows us to encode distributional smoothness and non-uniformity of the model output in semi-supervised node classification tasks. Numerical experiments demonstrate that our method can significantly improve the performance of most base GNN models in different problem settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2020

A Collective Learning Framework to Boost GNN Expressiveness

Graph Neural Networks (GNNs) have recently been used for node and graph ...
research
12/08/2021

Improving the Training of Graph Neural Networks with Consistency Regularization

Graph neural networks (GNNs) have achieved notable success in the semi-s...
research
06/01/2022

Graph Neural Networks with Precomputed Node Features

Most Graph Neural Networks (GNNs) cannot distinguish some graphs or inde...
research
04/29/2023

Leveraging Label Non-Uniformity for Node Classification in Graph Neural Networks

In node classification using graph neural networks (GNNs), a typical mod...
research
05/11/2019

Dissecting Graph Neural Networks on Graph Classification

Graph Neural Nets (GNNs) have received increasing attentions, partially ...
research
08/02/2021

Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training data

There has been a recent surge of interest in designing Graph Neural Netw...
research
07/24/2023

Addressing the Impact of Localized Training Data in Graph Neural Networks

Graph Neural Networks (GNNs) have achieved notable success in learning f...

Please sign up or login with your details

Forgot password? Click here to reset