Content-adaptive Representation Learning for Fast Image Super-resolution

05/20/2021
by   Yukai Shi, et al.
18

Deep convolutional networks have attracted great attention in image restoration and enhancement. Generally, restoration quality has been improved by building more and more convolutional block. However, these methods mostly learn a specific model to handle all images and ignore difficulty diversity. In other words, an area in the image with high frequency tend to lose more information during compressing while an area with low frequency tends to lose less. In this article, we adrress the efficiency issue in image SR by incorporating a patch-wise rolling network(PRN) to content-adaptively recover images according to difficulty levels. In contrast to existing studies that ignore difficulty diversity, we adopt different stage of a neural network to perform image restoration. In addition, we propose a rolling strategy that utilizes the parameters of each stage more flexible. Extensive experiments demonstrate that our model not only shows a significant acceleration but also maintain state-of-the-art performance.

READ FULL TEXT

page 3

page 4

page 7

page 8

page 9

research
04/11/2019

Difficulty-aware Image Super Resolution via Deep Adaptive Dual-Network

Recently, deep learning based single image super-resolution(SR) approach...
research
03/15/2023

ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution

Adapting the Diffusion Probabilistic Model (DPM) for direct image super-...
research
02/28/2023

TextIR: A Simple Framework for Text-based Editable Image Restoration

Most existing image restoration methods use neural networks to learn str...
research
06/04/2021

MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution

Reference-based image super-resolution (RefSR) has shown promising succe...
research
11/10/2022

ClassPruning: Speed Up Image Restoration Networks by Dynamic N:M Pruning

Image restoration tasks have achieved tremendous performance improvement...
research
08/09/2023

Feature Modulation Transformer: Cross-Refinement of Global Representation via High-Frequency Prior for Image Super-Resolution

Transformer-based methods have exhibited remarkable potential in single ...
research
06/14/2023

Taming Reversible Halftoning via Predictive Luminance

Traditional halftoning usually drops colors when dithering images with b...

Please sign up or login with your details

Forgot password? Click here to reset