Multi-scale guided attention for medical image segmentation

06/07/2019
by   Ashish Sinha, et al.
10

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a redundant use of information, where similar low-level features are extracted multiple times at multiple scales. Second, long-range feature dependencies are not efficiently modeled, resulting in non-optimal discriminative feature representations associated with each semantic class. In this paper we attempt to overcome these limitations with the proposed architecture, by capturing richer contextual dependencies based on the use of guided self-attention mechanisms. This approach is able to integrate local features with their corresponding global dependencies, as well as highlight interdependent channel maps in an adaptive manner. Further, the additional loss between different modules guides the attention mechanisms to remove the noise and focus on more discriminant regions of the image by emphasizing relevant feature associations. We evaluate the proposed model in the context of abdominal organ segmentation on magnetic resonance imaging (MRI). A series of ablation experiments support the importance of these attention modules in the proposed architecture. In addition, compared to other state-of-the-art segmentation networks our model yields better segmentation performance, increasing the accuracy of the predictions while reducing the standard deviation. This demonstrates the efficiency of our approach to generate precise and reliable automatic segmentations of medical images. Our code and the trained model are made publicly available at: https://github.com/sinAshish/Multi-Scale-Attention

READ FULL TEXT

page 1

page 8

page 9

research
07/27/2023

MCPA: Multi-scale Cross Perceptron Attention Network for 2D Medical Image Segmentation

The UNet architecture, based on Convolutional Neural Networks (CNN), has...
research
12/20/2020

MA-Unet: An improved version of Unet based on multi-scale and attention mechanism for medical image segmentation

Although convolutional neural networks (CNNs) are promoting the developm...
research
06/08/2023

Channel prior convolutional attention for medical image segmentation

Characteristics such as low contrast and significant organ shape variati...
research
09/15/2020

Multi-scale Attention U-Net (MsAUNet): A Modified U-Net Architecture for Scene Segmentation

Despite the growing success of Convolution neural networks (CNN) in the ...
research
04/27/2019

Non-Local Context Encoder: Robust Biomedical Image Segmentation against Adversarial Attacks

Recent progress in biomedical image segmentation based on deep convoluti...
research
09/02/2021

Studying the Effects of Self-Attention for Medical Image Analysis

When the trained physician interprets medical images, they understand th...
research
09/19/2023

Multi-level feature fusion network combining attention mechanisms for polyp segmentation

Clinically, automated polyp segmentation techniques have the potential t...

Please sign up or login with your details

Forgot password? Click here to reset