Uncertainty Aware Semi-Supervised Learning on Graph Data

10/24/2020
by   Xujiang Zhao, et al.
7

Thanks to graph neural networks (GNNs), semi-supervised node classification has shown the state-of-the-art performance in graph data. However, GNNs have not considered different types of uncertainties associated with class probabilities to minimize risk of increasing misclassification under uncertainty in real life. In this work, we propose a multi-source uncertainty framework using a GNN that reflects various types of predictive uncertainties in both deep learning and belief/evidence theory domains for node classification predictions. By collecting evidence from the given labels of training nodes, the Graph-based Kernel Dirichlet distribution Estimation (GKDE) method is designed for accurately predicting node-level Dirichlet distributions and detecting out-of-distribution (OOD) nodes. We validated the outperformance of our proposed model compared to the state-of-the-art counterparts in terms of misclassification detection and OOD detection based on six real network datasets. We found that dissonance-based detection yielded the best results on misclassification detection while vacuity-based detection was the best for OOD detection. To clarify the reasons behind the results, we provided the theoretical proof that explains the relationships between different types of uncertainties considered in this work.

READ FULL TEXT
research
10/15/2019

Quantifying Classification Uncertainty using Regularized Evidential Neural Networks

Traditional deep neural nets (NNs) have shown the state-of-the-art perfo...
research
07/04/2021

Leveraging Evidential Deep Learning Uncertainties with Graph-based Clustering to Detect Anomalies

Understanding and representing traffic patterns are key to detecting ano...
research
10/26/2021

Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification

The interdependence between nodes in graphs is key to improve class pred...
research
06/22/2022

Descent Steps of a Relation-Aware Energy Produce Heterogeneous Graph Neural Networks

Heterogeneous graph neural networks (GNNs) achieve strong performance on...
research
04/20/2023

Multidimensional Uncertainty Quantification for Deep Neural Networks

Deep neural networks (DNNs) have received tremendous attention and achie...
research
10/31/2021

Graph Tree Neural Networks

Graph neural networks (GNNs) have recently shown good performance in var...
research
10/20/2020

Towards Maximizing the Representation Gap between In-Domain & Out-of-Distribution Examples

Among existing uncertainty estimation approaches, Dirichlet Prior Networ...

Please sign up or login with your details

Forgot password? Click here to reset