Annotating 8,000 Abdominal CT Volumes for Multi-Organ Segmentation in Three Weeks

05/16/2023
by   Chongyu Qu, et al.
0

Annotating medical images, particularly for organ segmentation, is laborious and time-consuming. For example, annotating an abdominal organ requires an estimated rate of 30-60 minutes per CT volume based on the expertise of an annotator and the size, visibility, and complexity of the organ. Therefore, publicly available datasets for multi-organ segmentation are often limited in data size and organ diversity. This paper proposes a systematic and efficient method to expedite the annotation process for organ segmentation. We have created the largest multi-organ dataset (by far) with the spleen, liver, kidneys, stomach, gallbladder, pancreas, aorta, and IVC annotated in 8,448 CT volumes, equating to 3.2 million slices. The conventional annotation methods would take an experienced annotator up to 1,600 weeks (or roughly 30.8 years) to complete this task. In contrast, our annotation method has accomplished this task in three weeks (based on an 8-hour workday, five days a week) while maintaining a similar or even better annotation quality. This achievement is attributed to three unique properties of our method: (1) label bias reduction using multiple pre-trained segmentation models, (2) effective error detection in the model predictions, and (3) attention guidance for annotators to make corrections on the most salient errors. Furthermore, we summarize the taxonomy of common errors made by AI algorithms and annotators. This allows for continuous refinement of both AI and annotations and significantly reduces the annotation costs required to create large-scale datasets for a wider variety of medical imaging tasks.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 12

page 13

research
10/13/2021

MedNet: Pre-trained Convolutional Neural Network Model for the Medical Imaging Tasks

Deep Learning (DL) requires a large amount of training data to provide q...
research
07/11/2023

Estimating label quality and errors in semantic segmentation data via any model

The labor-intensive annotation process of semantic segmentation datasets...
research
04/27/2020

Towards Efficient COVID-19 CT Annotation: A Benchmark for Lung and Infection Segmentation

Accurate segmentation of lung and infection in COVID-19 CT scans plays a...
research
05/06/2023

Annotation-efficient learning for OCT segmentation

Deep learning has been successfully applied to OCT segmentation. However...
research
03/23/2022

MONAI Label: A framework for AI-assisted Interactive Labeling of 3D Medical Images

The lack of annotated datasets is a major challenge in training new task...
research
03/17/2022

Using the Order of Tomographic Slices as a Prior for Neural Networks Pre-Training

The technical advances in Computed Tomography (CT) allow to obtain immen...
research
01/24/2020

VerSe: A Vertebrae Labelling and Segmentation Benchmark

In this paper we report the challenge set-up and results of the Large Sc...

Please sign up or login with your details

Forgot password? Click here to reset