Few Shot Medical Image Segmentation with Cross Attention Transformer

03/24/2023
by   Yi Lin, et al.
0

Medical image segmentation has made significant progress in recent years. Deep learning-based methods are recognized as data-hungry techniques, requiring large amounts of data with manual annotations. However, manual annotation is expensive in the field of medical image analysis, which requires domain-specific expertise. To address this challenge, few-shot learning has the potential to learn new classes from only a few examples. In this work, we propose a novel framework for few-shot medical image segmentation, termed CAT-Net, based on cross masked attention Transformer. Our proposed network mines the correlations between the support image and query image, limiting them to focus only on useful foreground information and boosting the representation capacity of both the support prototype and query features. We further design an iterative refinement framework that refines the query image segmentation iteratively and promotes the support feature in turn. We validated the proposed method on three public datasets: Abd-CT, Abd-MRI, and Card-MRI. Experimental results demonstrate the superior performance of our method compared to state-of-the-art methods and the effectiveness of each component. we will release the source codes of our method upon acceptance.

READ FULL TEXT

page 7

page 12

research
04/19/2023

Cross-Reference Transformer for Few-shot Medical Image Segmentation

Due to the contradiction of medical image processing, that is, the appli...
research
08/02/2021

Recurrent Mask Refinement for Few-Shot Medical Image Segmentation

Although having achieved great success in medical image segmentation, de...
research
06/08/2023

Unsupervised augmentation optimization for few-shot medical image segmentation

The augmentation parameters matter to few-shot semantic segmentation sin...
research
09/09/2023

Few-Shot Medical Image Segmentation via a Region-enhanced Prototypical Transformer

Automated segmentation of large volumes of medical images is often plagu...
research
08/24/2022

Q-Net: Query-Informed Few-Shot Medical Image Segmentation

Deep learning has achieved tremendous success in computer vision, while ...
research
11/19/2020

Bidirectional RNN-based Few Shot Learning for 3D Medical Image Segmentation

Segmentation of organs of interest in 3D medical images is necessary for...
research
04/22/2021

A Data-Adaptive Loss Function for Incomplete Data and Incremental Learning in Semantic Image Segmentation

In the last years, deep learning has dramatically improved the performan...

Please sign up or login with your details

Forgot password? Click here to reset