Hypernet-Ensemble Learning of Segmentation Probability for Medical Image Segmentation with Ambiguous Labels

12/13/2021
by   Sungmin Hong, et al.
17

Despite the superior performance of Deep Learning (DL) on numerous segmentation tasks, the DL-based approaches are notoriously overconfident about their prediction with highly polarized label probability. This is often not desirable for many applications with the inherent label ambiguity even in human annotations. This challenge has been addressed by leveraging multiple annotations per image and the segmentation uncertainty. However, multiple per-image annotations are often not available in a real-world application and the uncertainty does not provide full control on segmentation results to users. In this paper, we propose novel methods to improve the segmentation probability estimation without sacrificing performance in a real-world scenario that we have only one ambiguous annotation per image. We marginalize the estimated segmentation probability maps of networks that are encouraged to under-/over-segment with the varying Tversky loss without penalizing balanced segmentation. Moreover, we propose a unified hypernetwork ensemble method to alleviate the computational burden of training multiple networks. Our approaches successfully estimated the segmentation probability maps that reflected the underlying structures and provided the intuitive control on segmentation for the challenging 3D medical image segmentation. Although the main focus of our proposed methods is not to improve the binary segmentation performance, our approaches marginally outperformed the state-of-the-arts. The codes are available at <https://github.com/sh4174/HypernetEnsemble>.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 13

research
08/16/2023

Hierarchical Uncertainty Estimation for Medical Image Segmentation Networks

Learning a medical image segmentation model is an inherently ambiguous t...
research
06/15/2023

Annotator Consensus Prediction for Medical Image Segmentation with Diffusion Models

A major challenge in the segmentation of medical images is the large int...
research
12/14/2020

D-LEMA: Deep Learning Ensembles from Multiple Annotations – Application to Skin Lesion Segmentation

Medical image segmentation annotations suffer from inter/intra-observer ...
research
06/10/2020

Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertainty

In image segmentation, there is often more than one plausible solution f...
research
03/21/2023

The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detector

Deep learning-based edge detectors heavily rely on pixel-wise labels whi...
research
07/17/2020

Superpixel-Guided Label Softening for Medical Image Segmentation

Segmentation of objects of interest is one of the central tasks in medic...
research
07/31/2023

Multispectral Image Segmentation in Agriculture: A Comprehensive Study on Fusion Approaches

Multispectral imagery is frequently incorporated into agricultural tasks...

Please sign up or login with your details

Forgot password? Click here to reset