DynaVSR: Dynamic Adaptive Blind Video Super-Resolution

11/09/2020
by   Suyoung Lee, et al.
7

Most conventional supervised super-resolution (SR) algorithms assume that low-resolution (LR) data is obtained by downscaling high-resolution (HR) data with a fixed known kernel, but such an assumption often does not hold in real scenarios. Some recent blind SR algorithms have been proposed to estimate different downscaling kernels for each input LR image. However, they suffer from heavy computational overhead, making them infeasible for direct application to videos. In this work, we present DynaVSR, a novel meta-learning-based framework for real-world video SR that enables efficient downscaling model estimation and adaptation to the current input. Specifically, we train a multi-frame downscaling module with various types of synthetic blur kernels, which is seamlessly combined with a video SR network for input-aware adaptation. Experimental results show that DynaVSR consistently improves the performance of the state-of-the-art video SR models by a large margin, with an order of magnitude faster inference time compared to the existing blind SR approaches.

READ FULL TEXT

page 2

page 7

page 8

research
08/18/2021

Temporal Kernel Consistency for Blind Video Super-Resolution

Deep learning-based blind super-resolution (SR) methods have recently ac...
research
01/09/2020

Fast Adaptation to Super-Resolution Networks via Meta-Learning

Conventional supervised super-resolution (SR) approaches are trained wit...
research
05/06/2021

Real-Time Video Super-Resolution by Joint Local Inference and Global Parameter Estimation

The state of the art in video super-resolution (SR) are techniques based...
research
11/19/2020

Recursive Deep Prior Video: a Super Resolution algorithm for Time-Lapse Microscopy of organ-on-chip experiments

Biological experiments based on organ-on-chips (OOCs) exploit light Time...
research
12/15/2022

Meta-Learned Kernel For Blind Super-Resolution Kernel Estimation

Recent image degradation estimation methods have enabled single-image su...
research
08/16/2023

S2R: Exploring a Double-Win Transformer-Based Framework for Ideal and Blind Super-Resolution

Nowadays, deep learning based methods have demonstrated impressive perfo...
research
12/03/2020

Unsupervised Alternating Optimization for Blind Hyperspectral Imagery Super-resolution

Despite the great success of deep model on Hyperspectral imagery (HSI) s...

Please sign up or login with your details

Forgot password? Click here to reset