Non-Local ConvLSTM for Video Compression Artifact Reduction

10/27/2019
by   Yi Xu, et al.
21

Video compression artifact reduction aims to recover high-quality videos from low-quality compressed videos. Most existing approaches use a single neighboring frame or a pair of neighboring frames (preceding and/or following the target frame) for this task. Furthermore, as frames of high quality overall may contain low-quality patches, and high-quality patches may exist in frames of low quality overall, current methods focusing on nearby peak-quality frames (PQFs) may miss high-quality details in low-quality frames. To remedy these shortcomings, in this paper we propose a novel end-to-end deep neural network called non-local ConvLSTM (NL-ConvLSTM in short) that exploits multiple consecutive frames. An approximate non-local strategy is introduced in NL-ConvLSTM to capture global motion patterns and trace the spatiotemporal dependency in a video sequence. This approximate strategy makes the non-local module work in a fast and low space-cost way. Our method uses the preceding and following frames of the target frame to generate a residual, from which a higher quality frame is reconstructed. Experiments on two datasets show that NL-ConvLSTM outperforms the existing methods.

READ FULL TEXT

page 3

page 4

page 6

page 8

research
05/31/2021

Boosting the Performance of Video Compression Artifact Reduction with Reference Frame Proposals and Frequency Domain Information

Many deep learning based video compression artifact removal algorithms h...
research
02/26/2019

MFQE 2.0: A New Approach for Multi-frame Quality Enhancement on Compressed Video

The past few years have witnessed great success in applying deep learnin...
research
08/04/2021

Recursive Fusion and Deformable Spatiotemporal Attention for Video Compression Artifact Reduction

A number of deep learning based algorithms have been proposed to recover...
research
03/13/2018

Multi-Frame Quality Enhancement for Compressed Video

The past few years have witnessed great success in applying deep learnin...
research
08/15/2023

Shortcut-V2V: Compression Framework for Video-to-Video Translation based on Temporal Redundancy Reduction

Video-to-video translation aims to generate video frames of a target dom...
research
10/19/2019

Utilising Low Complexity CNNs to Lift Non-Local Redundancies in Video Coding

Digital media is ubiquitous and produced in ever-growing quantities. Thi...
research
10/22/2021

Wide and Narrow: Video Prediction from Context and Motion

Video prediction, forecasting the future frames from a sequence of input...

Please sign up or login with your details

Forgot password? Click here to reset