DCS-RISR: Dynamic Channel Splitting for Efficient Real-world Image Super-Resolution

12/15/2022
by   Junbo Qiao, et al.
0

Real-world image super-resolution (RISR) has received increased focus for improving the quality of SR images under unknown complex degradation. Existing methods rely on the heavy SR models to enhance low-resolution (LR) images of different degradation levels, which significantly restricts their practical deployments on resource-limited devices. In this paper, we propose a novel Dynamic Channel Splitting scheme for efficient Real-world Image Super-Resolution, termed DCS-RISR. Specifically, we first introduce the light degradation prediction network to regress the degradation vector to simulate the real-world degradations, upon which the channel splitting vector is generated as the input for an efficient SR model. Then, a learnable octave convolution block is proposed to adaptively decide the channel splitting scale for low- and high-frequency features at each block, reducing computation overhead and memory cost by offering the large scale to low-frequency features and the small scale to the high ones. To further improve the RISR performance, Non-local regularization is employed to supplement the knowledge of patches from LR and HR subspace with free-computation inference. Extensive experiments demonstrate the effectiveness of DCS-RISR on different benchmark datasets. Our DCS-RISR not only achieves the best trade-off between computation/parameter and PSNR/SSIM metric, and also effectively handles real-world images with different degradation levels.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 12

page 13

research
03/27/2022

Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolution

Efficient and effective real-world image super-resolution (Real-ISR) is ...
research
10/20/2021

Toward Real-world Image Super-resolution via Hardware-based Adaptive Degradation Models

Most single image super-resolution (SR) methods are developed on synthet...
research
08/01/2020

Joint Generative Learning and Super-Resolution For Real-World Camera-Screen Degradation

In real-world single image super-resolution (SISR) task, the low-resolut...
research
05/30/2023

Toward Real-World Light Field Super-Resolution

Deep learning has opened up new possibilities for light field super-reso...
research
12/11/2020

Learning Omni-frequency Region-adaptive Representations for Real Image Super-Resolution

Traditional single image super-resolution (SISR) methods that focus on s...
research
12/21/2019

Style-based Variational Autoencoder for Real-World Super-Resolution

Real-world image super-resolution is a challenging image translation pro...
research
08/05/2020

Component Divide-and-Conquer for Real-World Image Super-Resolution

In this paper, we present a large-scale Diverse Real-world image Super-R...

Please sign up or login with your details

Forgot password? Click here to reset