HST: Hierarchical Swin Transformer for Compressed Image Super-resolution

08/21/2022
by   Bingchen Li, et al.
0

Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted image with the simple cooperation of super-resolution and compression artifacts removing. In this paper, we take a step forward to propose the Hierarchical Swin Transformer (HST) network to restore the low-resolution compressed image, which jointly captures the hierarchical feature representations and enhances each-scale representation with Swin transformer, respectively. Moreover, we find that the pretraining with Super-resolution (SR) task is vital in compressed image super-resolution. To explore the effects of different SR pretraining, we take the commonly-used SR tasks (e.g., bicubic and different real super-resolution simulations) as our pretraining tasks, and reveal that SR plays an irreplaceable role in the compressed image super-resolution. With the cooperation of HST and pre-training, our HST achieves the fifth place in AIM 2022 challenge on the low-quality compressed image super-resolution track, with the PSNR of 23.51dB. Extensive experiments and ablation studies have validated the effectiveness of our proposed methods.

READ FULL TEXT

page 3

page 10

page 12

page 14

research
01/16/2022

CISRNet: Compressed Image Super-Resolution Network

In recent years, tons of research has been conducted on Single Image Sup...
research
09/19/2017

CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks

In recent years, much research has been conducted on image super-resolut...
research
12/12/2021

Implicit Transformer Network for Screen Content Image Continuous Super-Resolution

Nowadays, there is an explosive growth of screen contents due to the wid...
research
08/17/2023

SRMAE: Masked Image Modeling for Scale-Invariant Deep Representations

Due to the prevalence of scale variance in nature images, we propose to ...
research
10/17/2022

ITSRN++: Stronger and Better Implicit Transformer Network for Continuous Screen Content Image Super-Resolution

Nowadays, online screen sharing and remote cooperation are becoming ubiq...
research
01/19/2021

Hyperspectral Image Super-Resolution with Spectral Mixup and Heterogeneous Datasets

This work studies Hyperspectral image (HSI) super-resolution (SR). HSI S...
research
08/11/2023

Revolutionizing Space Health (Swin-FSR): Advancing Super-Resolution of Fundus Images for SANS Visual Assessment Technology

The rapid accessibility of portable and affordable retinal imaging devic...

Please sign up or login with your details

Forgot password? Click here to reset