Log In Sign Up

Are Graph Neural Networks Miscalibrated?

by   Leonardo Teixeira, et al.

Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we analyze the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.


page 1

page 2

page 3

page 4


Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration

Despite Graph Neural Networks (GNNs) have achieved remarkable accuracy, ...

Medical Entity Disambiguation Using Graph Neural Networks

Medical knowledge bases (KBs), distilled from biomedical literature and ...

What Makes Graph Neural Networks Miscalibrated?

Given the importance of getting calibrated predictions and reliable unce...

On Calibration of Graph Neural Networks for Node Classification

Graphs can model real-world, complex systems by representing entities an...

Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks

Unsupervised image segmentation is an important task in many real-world ...

SiMa: Effective and Efficient Data Silo Federation Using Graph Neural Networks

Virtually every sizable organization nowadays is building a form of a da...

Towards an Efficient and General Framework of Robust Training for Graph Neural Networks

Graph Neural Networks (GNNs) have made significant advances on several f...

Code Repositories