Is Signed Message Essential for Graph Neural Networks?

01/21/2023
by   Yoonhyuk Choi, et al.
0

Message-passing Graph Neural Networks (GNNs), which collect information from adjacent nodes, achieve satisfying results on homophilic graphs. However, their performances are dismal in heterophilous graphs, and many researchers have proposed a plethora of schemes to solve this problem. Especially, flipping the sign of edges is rooted in a strong theoretical foundation, and attains significant performance enhancements. Nonetheless, previous analyses assume a binary class scenario and they may suffer from confined applicability. This paper extends the prior understandings to multi-class scenarios and points out two drawbacks: (1) the sign of multi-hop neighbors depends on the message propagation paths and may incur inconsistency, (2) it also increases the prediction uncertainty (e.g., conflict evidence) which can impede the stability of the algorithm. Based on the theoretical understanding, we introduce a novel strategy that is applicable to multi-class graphs. The proposed scheme combines confidence calibration to secure robustness while reducing uncertainty. We show the efficacy of our theorem through extensive experiments on six benchmark graph datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2021

Multi-Level Attention Pooling for Graph Neural Networks: Unifying Graph Representations with Multiple Localities

Graph neural networks (GNNs) have been widely used to learn vector repre...
research
03/20/2022

LEReg: Empower Graph Neural Networks with Local Energy Regularization

Researches on analyzing graphs with Graph Neural Networks (GNNs) have be...
research
09/20/2021

Edge-similarity-aware Graph Neural Networks

Graph are a ubiquitous data representation, as they represent a flexible...
research
10/28/2019

Diffusion Improves Graph Learning

Graph convolution is the core of most Graph Neural Networks (GNNs) and u...
research
03/02/2023

Steering Graph Neural Networks with Pinning Control

In the semi-supervised setting where labeled data are largely limited, i...
research
04/03/2023

Uncertainty Propagation in Node Classification

Quantifying predictive uncertainty of neural networks has recently attra...
research
06/23/2022

Reducing the Error Floor of the Sign-Preserving Min-Sum LDPC Decoder via Message Weighting of Low-Degree Variable Nodes

Some low-complexity LDPC decoders suffer from error floors. We apply ite...

Please sign up or login with your details

Forgot password? Click here to reset