SwinIR: Image Restoration Using Swin Transformer

08/23/2021
by   Jingyun Liang, et al.
5

Image restoration is a long-standing low-level vision problem that aims to restore high-quality images from low-quality images (e.g., downscaled, noisy and compressed images). While state-of-the-art image restoration methods are based on convolutional neural networks, few attempts have been made with Transformers which show impressive performance on high-level vision tasks. In this paper, we propose a strong baseline model SwinIR for image restoration based on the Swin Transformer. SwinIR consists of three parts: shallow feature extraction, deep feature extraction and high-quality image reconstruction. In particular, the deep feature extraction module is composed of several residual Swin Transformer blocks (RSTB), each of which has several Swin Transformer layers together with a residual connection. We conduct experiments on three representative tasks: image super-resolution (including classical, lightweight and real-world image super-resolution), image denoising (including grayscale and color image denoising) and JPEG compression artifact reduction. Experimental results demonstrate that SwinIR outperforms state-of-the-art methods on different tasks by up to 0.14∼0.45dB, while the total number of parameters can be reduced by up to 67

READ FULL TEXT

page 3

page 6

page 7

page 8

research
05/14/2022

Dense residual Transformer for image denoising

Image denoising is an important low-level computer vision task, which ai...
research
04/01/2020

Rethinking Data Augmentation for Image Super-resolution: A Comprehensive Analysis and a New Strategy

Data augmentation is an effective way to improve the performance of deep...
research
04/14/2022

Residual Swin Transformer Channel Attention Network for Image Demosaicing

Image demosaicing is problem of interpolating full- resolution color ima...
research
10/09/2019

Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusion

In this paper, we propose a novel deep convolutional neural network to s...
research
03/16/2023

A Framework for Real-time Object Detection and Image Restoration

Object detection and single image super-resolution are classic problems ...
research
10/19/2019

Image Restoration Using Deep Regulated Convolutional Networks

While the depth of convolutional neural networks has attracted substanti...
research
05/19/2023

RAMiT: Reciprocal Attention Mixing Transformer for Lightweight Image Restoration

Although many recent works have made advancements in the image restorati...

Please sign up or login with your details

Forgot password? Click here to reset