DVC-P: Deep Video Compression with Perceptual Optimizations

09/22/2021
by   Saiping Zhang, et al.
5

Recent years have witnessed the significant development of learning-based video compression methods, which aim at optimizing objective or perceptual quality and bit rates. In this paper, we introduce deep video compression with perceptual optimizations (DVC-P), which aims at increasing perceptual quality of decoded videos. Our proposed DVC-P is based on Deep Video Compression (DVC) network, but improves it with perceptual optimizations. Specifically, a discriminator network and a mixed loss are employed to help our network trade off among distortion, perception and rate. Furthermore, nearest-neighbor interpolation is used to eliminate checkerboard artifacts which can appear in sequences encoded with DVC frameworks. Thanks to these two improvements, the perceptual quality of decoded sequences is improved. Experimental results demonstrate that, compared with the baseline DVC, our proposed method can generate videos with higher perceptual quality achieving 12.27 perceptual BD-rate equivalent, on average.

READ FULL TEXT
research
02/04/2019

Vignette: Perceptual Compression for Video Storage and Processing Systems

Compressed videos constitute 70 rates far outpace compute and storage im...
research
04/20/2020

Adversarial Distortion for Learned Video Compression

In this paper, we present a novel adversarial lossy video compression mo...
research
07/10/2018

The Helmholtz Method: Using Perceptual Compression to Reduce Machine Learning Complexity

This paper proposes a fundamental answer to a frequently asked question ...
research
06/21/2022

Optimally Controllable Perceptual Lossy Compression

Recent studies in lossy compression show that distortion and perceptual ...
research
08/02/2020

Deep Multi-modality Soft-decoding of Very Low Bit-rate Face Videos

We propose a novel deep multi-modality neural network for restoring very...
research
03/13/2018

Effect of Eye Dominance on the Perception of Stereoscopic 3D Video

Asymmetric schemes have widespread applications in the 3D video transmis...
research
11/15/2016

One-to-Many Network for Visually Pleasing Compression Artifacts Reduction

We consider the compression artifacts reduction problem, where a compres...

Please sign up or login with your details

Forgot password? Click here to reset