Uncertainty Evaluation Metric for Brain Tumour Segmentation

05/28/2020
by   Raghav Mehta, et al.
20

In this paper, we develop a metric designed to assess and rank uncertainty measures for the task of brain tumour sub-tissue segmentation in the BraTS 2019 sub-challenge on uncertainty quantification. The metric is designed to: (1) reward uncertainty measures where high confidence is assigned to correct assertions, and where incorrect assertions are assigned low confidence and (2) penalize measures that have higher percentages of under-confident correct assertions. Here, the workings of the components of the metric are explored based on a number of popular uncertainty measures evaluated on the BraTS 2019 dataset.

READ FULL TEXT
research
11/03/2022

Uncertainty Quantification for Rule-Based Models

Rule-based classification models described in the language of logic dire...
research
05/30/2023

Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models

Large language models (LLMs) specializing in natural language generation...
research
09/13/2019

Evaluating and Boosting Uncertainty Quantification in Classification

Emergence of artificial intelligence techniques in biomedical applicatio...
research
10/23/2022

A study of uncertainty quantification in overparametrized high-dimensional models

Uncertainty quantification is a central challenge in reliable and trustw...
research
08/15/2023

Confidence Contours: Uncertainty-Aware Annotation for Medical Semantic Segmentation

Medical image segmentation modeling is a high-stakes task where understa...
research
03/03/2022

NUQ: A Noise Metric for Diffusion MRI via Uncertainty Discrepancy Quantification

Diffusion MRI (dMRI) is the only non-invasive technique sensitive to tis...
research
03/01/2020

Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain

Uncertainty presents a problem for both human and machine decision-mak...

Please sign up or login with your details

Forgot password? Click here to reset