Deep Predictive Video Compression with Bi-directional Prediction

04/05/2019
by   Woonsung Park, et al.
0

Recently, deep image compression has shown a big progress in terms of coding efficiency and image quality improvement. However, relatively less attention has been put on video compression using deep learning networks. In the paper, we first propose a deep learning based bi-predictive coding network, called BP-DVC Net, for video compression. Learned from the lesson of the conventional video coding, a B-frame coding structure is incorporated in our BP-DVC Net. While the bi-predictive coding in the conventional video codecs requires to transmit to decoder sides the motion vectors for block motion and the residues from prediction, our BP-DVC Net incorporates optical flow estimation networks in both encoder and decoder sides so as not to transmit the motion information to the decoder sides for coding efficiency improvement. Also, a bi-prediction network in the BP-DVC Net is proposed and used to precisely predict the current frame and to yield the resulting residues as small as possible. Furthermore, our BP-DVC Net allows for the compressive feature maps to be entropy-coded using the temporal context among the feature maps of adjacent frames. The BP-DVC Net has an end-to-end video compression architecture with newly designed flow and prediction losses. Experimental results show that the compression performance of our proposed method is comparable to those of H.264, HEVC in terms of PSNR and MS-SSIM.

READ FULL TEXT

page 3

page 4

page 8

page 11

page 13

page 14

research
12/31/2018

Deep Frame Prediction for Video Coding

We propose a novel frame prediction method using a deep neural network (...
research
11/30/2018

DVC: An End-to-end Deep Video Compression Framework

Conventional video compression approaches use the predictive coding arch...
research
12/14/2020

Learned Video Codec with Enriched Reconstruction for CLIC P-frame Coding

This paper proposes a learning-based video codec, specifically used for ...
research
12/30/2019

A Hybrid Architecture of Jointly Learning Image Compression and Quality Enhancement with Improved Entropy Minimization

Recently, learned image compression methods have been actively studied. ...
research
04/20/2020

End-to-End Learning for Video Frame Compression with Self-Attention

One of the core components of conventional (i.e., non-learned) video cod...
research
04/26/2018

Learning for Video Compression

One key challenge to learning-based video compression is that motion pre...
research
09/30/2021

Deep Contextual Video Compression

Most of the existing neural video compression methods adopt the predicti...

Please sign up or login with your details

Forgot password? Click here to reset