Towards a Guideline for Evaluation Metrics in Medical Image Segmentation

02/10/2022
by   Dominik Müller, et al.
0

In the last decade, research on artificial intelligence has seen rapid growth with deep learning models, especially in the field of medical image segmentation. Various studies demonstrated that these models have powerful prediction capabilities and achieved similar results as clinicians. However, recent studies revealed that the evaluation in image segmentation studies lacks reliable model performance assessment and showed statistical bias by incorrect metric implementation or usage. Thus, this work provides an overview and interpretation guide on the following metrics for medical image segmentation evaluation in binary as well as multi-class problems: Dice similarity coefficient, Jaccard, Sensitivity, Specificity, Rand index, ROC curves, Cohen's Kappa, and Hausdorff distance. As a summary, we propose a guideline for standardized medical image segmentation evaluation to improve evaluation quality, reproducibility, and comparability in the research field.

READ FULL TEXT
research
01/23/2022

MISeval: a Metric Library for Medical Image Segmentation Evaluation

Correct performance assessment is crucial for evaluating modern artifici...
research
04/22/2022

Development of an algorithm for medical image segmentation of bone tissue in interaction with metallic implants

This preliminary study focuses on the development of a medical image seg...
research
08/21/2021

Systematic Clinical Evaluation of A Deep Learning Method for Medical Image Segmentation: Radiosurgery Application

We systematically evaluate a Deep Learning (DL) method in a 3D medical i...
research
09/08/2021

SSEGEP: Small SEGment Emphasized Performance evaluation metric for medical image segmentation

Automatic image segmentation is a critical component of medical image an...
research
03/30/2021

Assessing the Role of Random Forests in Medical Image Segmentation

Neural networks represent a field of research that can quickly achieve v...
research
11/03/2020

Distribution-aware Margin Calibration for Medical Image Segmentation

The Jaccard index, also known as Intersection-over-Union (IoU score), is...
research
08/02/2023

Data-Centric Diet: Effective Multi-center Dataset Pruning for Medical Image Segmentation

This paper seeks to address the dense labeling problems where a signific...

Please sign up or login with your details

Forgot password? Click here to reset