Multi-rater Prism: Learning self-calibrated medical image segmentation from multiple raters

12/01/2022
by   Junde Wu, et al.
0

In medical image segmentation, it is often necessary to collect opinions from multiple experts to make the final decision. This clinical routine helps to mitigate individual bias. But when data is multiply annotated, standard deep learning models are often not applicable. In this paper, we propose a novel neural network framework, called Multi-Rater Prism (MrPrism) to learn the medical image segmentation from multiple labels. Inspired by the iterative half-quadratic optimization, the proposed MrPrism will combine the multi-rater confidences assignment task and calibrated segmentation task in a recurrent manner. In this recurrent process, MrPrism can learn inter-observer variability taking into account the image semantic properties, and finally converges to a self-calibrated segmentation result reflecting the inter-observer agreement. Specifically, we propose Converging Prism (ConP) and Diverging Prism (DivP) to process the two tasks iteratively. ConP learns calibrated segmentation based on the multi-rater confidence maps estimated by DivP. DivP generates multi-rater confidence maps based on the segmentation masks estimated by ConP. The experimental results show that by recurrently running ConP and DivP, the two tasks can achieve mutual improvement. The final converged segmentation result of MrPrism outperforms state-of-the-art (SOTA) strategies on a wide range of medical image segmentation tasks.

READ FULL TEXT

page 20

page 21

research
06/10/2022

Learning self-calibrated optic disc and cup segmentation from multi-rater annotations

The segmentation of optic disc(OD) and optic cup(OC) from fundus images ...
research
08/21/2021

Systematic Clinical Evaluation of A Deep Learning Method for Medical Image Segmentation: Radiosurgery Application

We systematically evaluate a Deep Learning (DL) method in a 3D medical i...
research
09/26/2021

Using Soft Labels to Model Uncertainty in Medical Image Segmentation

Medical image segmentation is inherently uncertain. For a given image, t...
research
07/21/2023

Probabilistic Modeling of Inter- and Intra-observer Variability in Medical Image Segmentation

Medical image segmentation is a challenging task, particularly due to in...
research
02/14/2022

Opinions Vary? Diagnosis First!

In medical image segmentation, images are usually annotated by several d...
research
11/15/2021

Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration

Medical image segmentation is one of the fundamental problems for artifi...
research
06/01/2023

Evaluation of Multi-indicator And Multi-organ Medical Image Segmentation Models

In recent years, "U-shaped" neural networks featuring encoder and decode...

Please sign up or login with your details

Forgot password? Click here to reset