Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images

08/22/2018
by   Jo Schlemper, et al.
6

We propose a novel attention gate (AG) model for medical image analysis that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules when using convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN models such as VGG or U-Net architectures with minimal computational overhead while increasing the model sensitivity and prediction accuracy. The proposed AG models are evaluated on a variety of tasks, including medical image classification and segmentation. For classification, we demonstrate the use case of AGs in scan plane detection for fetal ultrasound screening. We show that the proposed attention mechanism can provide efficient object localisation while improving the overall prediction performance by reducing false positives. For segmentation, the proposed architecture is evaluated on two large 3D CT abdominal datasets with manual annotations for multiple organs. Experimental results show that AG models consistently improve the prediction performance of the base architectures across different datasets and training sizes while preserving computational efficiency. Moreover, AGs guide the model activations to be focused around salient regions, which provides better insights into how model predictions are made. The source code for the proposed AG models is publicly available.

READ FULL TEXT

page 9

page 18

page 24

page 25

page 26

research
04/11/2018

Attention U-Net: Learning Where to Look for the Pancreas

We propose a novel attention gate (AG) model for medical imaging that au...
research
07/07/2021

AGD-Autoencoder: Attention Gated Deep Convolutional Autoencoder for Brain Tumor Segmentation

Brain tumor segmentation is a challenging problem in medical image analy...
research
07/31/2020

A Novel Global Spatial Attention Mechanism in Convolutional Neural Network for Medical Image Classification

Spatial attention has been introduced to convolutional neural networks (...
research
04/15/2018

Attention-Gated Networks for Improving Ultrasound Scan Plane Detection

In this work, we apply an attention-gated network to real-time automated...
research
06/06/2022

Dual Decomposition of Convex Optimization Layers for Consistent Attention in Medical Images

A key concern in integrating machine learning models in medicine is the ...
research
10/28/2022

IB-U-Nets: Improving medical image segmentation tasks with 3D Inductive Biased kernels

Despite the success of convolutional neural networks for 3D medical-imag...
research
07/29/2020

Learning To Pay Attention To Mistakes

As evidenced in visual results in <cit.><cit.><cit.><cit.><cit.>, the pe...

Please sign up or login with your details

Forgot password? Click here to reset