A Novel Global Spatial Attention Mechanism in Convolutional Neural Network for Medical Image Classification

07/31/2020
by   Linchuan Xu, et al.
14

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a weight map which represents the relative importance of activations within the same layer or channel. All existing attention mechanisms are local attentions in the sense that weight maps are image-specific. However, in the medical field, there are cases that all the images should share the same weight map because the set of images record the same kind of symptom related to the same object and thereby share the same structural content. In this paper, we thus propose a novel global spatial attention mechanism in CNNs mainly for medical image classification. The global weight map is instantiated by a decision boundary between important pixels and unimportant pixels. And we propose to realize the decision boundary by a binary classifier in which the intensities of all images at a pixel are the features of the pixel. The binary classification is integrated into an image classification CNN and is to be optimized together with the CNN. Experiments on two medical image datasets and one facial expression dataset showed that with the proposed attention, not only the performance of four powerful CNNs which are GoogleNet, VGG, ResNet, and DenseNet can be improved, but also meaningful attended regions can be obtained, which is beneficial for understanding the content of images of a domain.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 7

page 9

page 10

page 13

page 16

page 17

page 19

08/22/2018

Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images

We propose a novel attention gate (AG) model for medical image analysis ...
06/29/2021

Towards Understanding the Effectiveness of Attention Mechanism

Attention Mechanism is a widely used method for improving the performanc...
02/21/2021

A Hierarchical Conditional Random Field-based Attention Mechanism Approach for Gastric Histopathology Image Classification

In the Gastric Histopathology Image Classification (GHIC) tasks, which i...
07/28/2021

Content-aware Directed Propagation Network with Pixel Adaptive Kernel Attention

Convolutional neural networks (CNNs) have been not only widespread but a...
11/13/2020

Structured Attention Graphs for Understanding Deep Image Classifications

Attention maps are a popular way of explaining the decisions of convolut...
02/20/2021

Hard-Attention for Scalable Image Classification

Deep neural networks (DNNs) are typically optimized for a specific input...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.