On the Generalization of BasicVSR++ to Video Deblurring and Denoising

04/11/2022
by   Kelvin C. K. Chan, et al.
14

The exploitation of long-term information has been a long-standing problem in video restoration. The recent BasicVSR and BasicVSR++ have shown remarkable performance in video super-resolution through long-term propagation and effective alignment. Their success has led to a question of whether they can be transferred to different video restoration tasks. In this work, we extend BasicVSR++ to a generic framework for video restoration tasks. In tasks where inputs and outputs possess identical spatial size, the input resolution is reduced by strided convolutions to maintain efficiency. With only minimal changes from BasicVSR++, the proposed framework achieves compelling performance with great efficiency in various video restoration tasks including video deblurring and denoising. Notably, BasicVSR++ achieves comparable performance to Transformer-based approaches with up to 79 speedup. The promising results demonstrate the importance of propagation and alignment in video restoration tasks beyond just video super-resolution. Code and models are available at https://github.com/ckkelvinchan/BasicVSR_PlusPlus.

READ FULL TEXT

page 3

page 5

research
11/30/2021

Revisiting Temporal Alignment for Video Restoration

Long-range temporal alignment is critical yet challenging for video rest...
research
04/27/2021

BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment

A recurrent structure is a popular framework choice for the task of vide...
research
12/03/2020

EVRNet: Efficient Video Restoration on Edge Devices

Video transmission applications (e.g., conferencing) are gaining momentu...
research
03/29/2023

Unlocking Masked Autoencoders as Loss Function for Image and Video Restoration

Image and video restoration has achieved a remarkable leap with the adve...
research
09/06/2022

Video Restoration with a Deep Plug-and-Play Prior

This paper presents a novel method for restoring digital videos via a De...
research
08/07/2017

MemNet: A Persistent Memory Network for Image Restoration

Recently, very deep convolutional neural networks (CNNs) have been attra...
research
03/25/2023

Toward DNN of LUTs: Learning Efficient Image Restoration with Multiple Look-Up Tables

The widespread usage of high-definition screens on edge devices stimulat...

Please sign up or login with your details

Forgot password? Click here to reset