Are Graph Neural Networks Miscalibrated?

05/07/2019
by   Leonardo Teixeira, et al.
0

Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we analyze the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2021

Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration

Despite Graph Neural Networks (GNNs) have achieved remarkable accuracy, ...
research
04/03/2021

Medical Entity Disambiguation Using Graph Neural Networks

Medical knowledge bases (KBs), distilled from biomedical literature and ...
research
10/12/2022

What Makes Graph Neural Networks Miscalibrated?

Given the importance of getting calibrated predictions and reliable unce...
research
06/25/2022

SiMa: Effective and Efficient Data Silo Federation Using Graph Neural Networks

Virtually every sizable organization nowadays is building a form of a da...
research
02/25/2020

Towards an Efficient and General Framework of Robust Training for Graph Neural Networks

Graph Neural Networks (GNNs) have made significant advances on several f...
research
11/25/2021

Demystifying Graph Neural Network Explanations

Graph neural networks (GNNs) are quickly becoming the standard approach ...
research
04/28/2022

Learning cosmology and clustering with cosmic graphs

We train deep learning models on thousands of galaxy catalogues from the...

Please sign up or login with your details

Forgot password? Click here to reset