Attention in Attention Network for Image Super-Resolution

04/19/2021
by   Haoyu Chen, et al.
10

Convolutional neural networks have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Among recent advances in SISR, attention mechanisms are crucial for high performance SR models. However, few works really discuss why attention works and how it works. In this work, we attempt to quantify and visualize the static attention mechanisms and show that not all attention modules are equally beneficial. We then propose attention in attention network (A^2N) for highly accurate image SR. Specifically, our A^2N consists of a non-attention branch and a coupling attention branch. Attention dropout module is proposed to generate dynamic attention weights for these two branches based on input features that can suppress unwanted attention adjustments. This allows attention modules to specialize to beneficial examples without otherwise penalties and thus greatly improve the capacity of the attention network with little parameter overhead. Experiments have demonstrated that our model could achieve superior trade-off performances comparing with state-of-the-art lightweight networks. Experiments on local attribution maps also prove attention in attention (A^2) structure can extract features from a wider range.

READ FULL TEXT

page 3

page 7

research
11/29/2018

RAM: Residual Attention Module for Single Image Super-Resolution

Attention mechanisms are a design trend of deep neural networks that sta...
research
11/22/2020

Interpreting Super-Resolution Networks with Local Attribution Maps

Image super-resolution (SR) techniques have been developing rapidly, ben...
research
08/20/2020

Single Image Super-Resolution via a Holistic Attention Network

Informative features play a crucial role in the single image super-resol...
research
10/23/2021

Dense Dual-Attention Network for Light Field Image Super-Resolution

Light field (LF) images can be used to improve the performance of image ...
research
12/13/2018

Wider Channel Attention Network for Remote Sensing Image Super-resolution

Recently, deep convolutional neural networks (CNNs) have obtained promis...
research
10/12/2022

Efficient Image Super-Resolution using Vast-Receptive-Field Attention

The attention mechanism plays a pivotal role in designing advanced super...
research
04/25/2022

IMDeception: Grouped Information Distilling Super-Resolution Network

Single-Image-Super-Resolution (SISR) is a classical computer vision prob...

Please sign up or login with your details

Forgot password? Click here to reset