Revisiting Temporal Alignment for Video Restoration

11/30/2021
by   Kun Zhou, et al.
4

Long-range temporal alignment is critical yet challenging for video restoration tasks. Recently, some works attempt to divide the long-range alignment into several sub-alignments and handle them progressively. Although this operation is helpful in modeling distant correspondences, error accumulation is inevitable due to the propagation mechanism. In this work, we present a novel, generic iterative alignment module which employs a gradual refinement scheme for sub-alignments, yielding more accurate motion compensation. To further enhance the alignment accuracy and temporal consistency, we develop a non-parametric re-weighting method, where the importance of each neighboring frame is adaptively evaluated in a spatial-wise way for aggregation. By virtue of the proposed strategies, our model achieves state-of-the-art performance on multiple benchmarks across a range of video restoration tasks including video super-resolution, denoising and deblurring. Our project is available in <https://github.com/redrock303/Revisiting-Temporal-Alignment-for-Video-Restoration.git>.

READ FULL TEXT

page 6

page 7

page 8

page 11

page 12

page 13

page 14

page 15

research
04/11/2022

On the Generalization of BasicVSR++ to Video Deblurring and Denoising

The exploitation of long-term information has been a long-standing probl...
research
01/28/2022

VRT: A Video Restoration Transformer

Video restoration (e.g., video super-resolution) aims to restore high-qu...
research
06/05/2022

Recurrent Video Restoration Transformer with Guided Deformable Attention

Video restoration aims at restoring multiple high-quality frames from mu...
research
03/21/2023

SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation

In this paper, we propose a scribble-based video colorization network wi...
research
03/31/2022

Bringing Old Films Back to Life

We present a learning-based framework, recurrent transformer network (RT...
research
12/15/2021

Transcoded Video Restoration by Temporal Spatial Auxiliary Network

In most video platforms, such as Youtube, and TikTok, the played videos ...
research
03/17/2022

Neural Compression-Based Feature Learning for Video Restoration

How to efficiently utilize the temporal features is crucial, yet challen...

Please sign up or login with your details

Forgot password? Click here to reset