DeepAI
Log In Sign Up

Are Graph Neural Networks Miscalibrated?

05/07/2019
by   Leonardo Teixeira, et al.
0

Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we analyze the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/29/2021

Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration

Despite Graph Neural Networks (GNNs) have achieved remarkable accuracy, ...
04/03/2021

Medical Entity Disambiguation Using Graph Neural Networks

Medical knowledge bases (KBs), distilled from biomedical literature and ...
10/12/2022

What Makes Graph Neural Networks Miscalibrated?

Given the importance of getting calibrated predictions and reliable unce...
06/03/2022

On Calibration of Graph Neural Networks for Node Classification

Graphs can model real-world, complex systems by representing entities an...
10/21/2022

Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks

Unsupervised image segmentation is an important task in many real-world ...
06/25/2022

SiMa: Effective and Efficient Data Silo Federation Using Graph Neural Networks

Virtually every sizable organization nowadays is building a form of a da...
02/25/2020

Towards an Efficient and General Framework of Robust Training for Graph Neural Networks

Graph Neural Networks (GNNs) have made significant advances on several f...

Code Repositories