Meta-Transfer Learning for Zero-Shot Super-Resolution

02/27/2020
by   Jae Woong Soh, et al.
8

Convolutional neural networks (CNNs) have shown dramatic improvements in single image super-resolution (SISR) by using large-scale external samples. Despite their remarkable performance based on the external dataset, they cannot exploit internal information within a specific image. Another problem is that they are applicable only to the specific condition of data that they are supervised. For instance, the low-resolution (LR) image should be a "bicubic" downsampled noise-free image from a high-resolution (HR) one. To address both issues, zero-shot super-resolution (ZSSR) has been proposed for flexible internal learning. However, they require thousands of gradient updates, i.e., long inference time. In this paper, we present Meta-Transfer Learning for Zero-Shot Super-Resolution (MZSR), which leverages ZSSR. Precisely, it is based on finding a generic initial parameter that is suitable for internal learning. Thus, we can exploit both external and internal information, where one single gradient update can yield quite considerable results. (See Figure 1). With our method, the network can quickly adapt to a given image condition. In this respect, our method can be applied to a large spectrum of image conditions within a fast adaptation process.

READ FULL TEXT

page 1

page 7

page 8

page 13

page 14

research
08/05/2021

Ada-VSR: Adaptive Video Super-Resolution with Meta-Learning

Most of the existing works in supervised spatio-temporal video super-res...
research
03/31/2017

Single Image Super Resolution - When Model Adaptation Matters

In the recent years impressive advances were made for single image super...
research
12/17/2017

"Zero-Shot" Super-Resolution using Deep Internal Learning

Deep Learning has led to a dramatic leap in Super-Resolution (SR) perfor...
research
04/15/2022

Super Resolution for Turbulent Flows in 2D: Stabilized Physics Informed Neural Networks

We propose a new design of a neural network for solving a zero shot supe...
research
03/12/2015

Designing A Composite Dictionary Adaptively From Joint Examples

We study the complementary behaviors of external and internal examples i...
research
12/09/2019

DCIL: Deep Contextual Internal Learning for Image Restoration and Image Retargeting

Recently, there is a vast interest in developing methods which are indep...
research
04/06/2016

How Does the Low-Rank Matrix Decomposition Help Internal and External Learnings for Super-Resolution

Wisely utilizing the internal and external learning methods is a new cha...

Please sign up or login with your details

Forgot password? Click here to reset