by   Junlong Cheng, et al.

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent research indicate that directly applying the pretrained SAM to medical image segmentation does not yield satisfactory performance. This limitation primarily arises from significant domain gap between natural images and medical images. To bridge this gap, we introduce SAM-Med2D, the most comprehensive studies on applying SAM to medical 2D images. Specifically, we first collect and curate approximately 4.6M images and 19.7M masks from public and private datasets, constructing a large-scale medical image segmentation dataset encompassing various modalities and objects. Then, we comprehensively fine-tune SAM on this dataset and turn it into SAM-Med2D. Unlike previous methods that only adopt bounding box or point prompts as interactive segmentation approach, we adapt SAM to medical image segmentation through more comprehensive prompts involving bounding boxes, points, and masks. We additionally fine-tune the encoder and decoder of the original SAM to obtain a well-performed SAM-Med2D, leading to the most comprehensive fine-tuning strategies to date. Finally, we conducted a comprehensive evaluation and analysis to investigate the performance of SAM-Med2D in medical image segmentation across various modalities, anatomical structures, and organs. Concurrently, we validated the generalization capability of SAM-Med2D on 9 datasets from MICCAI 2023 challenge. Overall, our approach demonstrated significantly superior performance and generalization capability compared to SAM.


page 2

page 3

page 5

page 6

page 12

page 13


Segment Anything in Medical Images

Segment anything model (SAM) has revolutionized natural image segmentati...

Accuracy of Segment-Anything Model (SAM) in medical image segmentation tasks

The segment-anything model (SAM), was introduced as a fundamental model ...

When SAM Meets Sonar Images

Segment Anything Model (SAM) has revolutionized the way of segmentation....

MedLocker: A Transferable Adversarial Watermarking for Preventing Unauthorized Analysis of Medical Image Dataset

The collection of medical image datasets is a demanding and laborious pr...

AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encoder

The recently introduced Segment Anything Model (SAM) combines a clever a...

Segment Anything Model for Medical Images?

The Segment Anything Model (SAM) is the first foundation model for gener...

Interactive Image Segmentation Using Constrained Dominant Sets

We propose a new approach to interactive image segmentation based on som...

Please sign up or login with your details

Forgot password? Click here to reset