Fast Adaptation to Super-Resolution Networks via Meta-Learning

01/09/2020
by   Seobin Park, et al.
24

Conventional supervised super-resolution (SR) approaches are trained with massive external SR datasets but fail to exploit desirable properties of the given test image. On the other hand, self-supervised SR approaches utilize the internal information within a test image but suffer from computational complexity in run-time. In this work, we observe the opportunity for further improvement of the performance of SISR without changing the architecture of conventional SR networks by practically exploiting additional information given from the input image. In the training stage, we train the network via meta-learning; thus, the network can quickly adapt to any input image at test time. Then, in the test stage, parameters of this meta-learned network are rapidly fine-tuned with only a few iterations by only using the given low-resolution image. The adaptation at the test time takes full advantage of patch-recurrence property observed in natural images. Our method effectively handles unknown SR kernels and can be applied to any existing model. We demonstrate that the proposed model-agnostic approach consistently improves the performance of conventional SR networks on various benchmark SR datasets.

READ FULL TEXT

page 5

page 7

page 8

research
11/09/2020

DynaVSR: Dynamic Adaptive Blind Video Super-Resolution

Most conventional supervised super-resolution (SR) algorithms assume tha...
research
09/14/2019

Blind Super-Resolution Kernel Estimation using an Internal-GAN

Super resolution (SR) methods typically assume that the low-resolution (...
research
01/09/2020

Self-Supervised Fast Adaptation for Denoising via Meta-Learning

Under certain statistical assumptions of noise, recent self-supervised a...
research
04/06/2021

Test-Time Adaptation for Super-Resolution: You Only Need to Overfit on a Few More Images

Existing reference (RF)-based super-resolution (SR) models try to improv...
research
08/05/2021

Ada-VSR: Adaptive Video Super-Resolution with Meta-Learning

Most of the existing works in supervised spatio-temporal video super-res...
research
03/18/2021

Self-Supervised Adaptation for Video Super-Resolution

Recent single-image super-resolution (SISR) networks, which can adapt th...
research
04/22/2015

Self-Tuned Deep Super Resolution

Deep learning has been successfully applied to image super resolution (S...

Please sign up or login with your details

Forgot password? Click here to reset