CANF-VC: Conditional Augmented Normalizing Flows for Video Compression

07/12/2022
by   Yung-Han Ho, et al.
0

This paper presents an end-to-end learning-based video compression system, termed CANF-VC, based on conditional augmented normalizing flows (ANF). Most learned video compression systems adopt the same hybrid-based coding architecture as the traditional codecs. Recent research on conditional coding has shown the sub-optimality of the hybrid-based coding and opens up opportunities for deep generative models to take a key role in creating new coding frameworks. CANF-VC represents a new attempt that leverages the conditional ANF to learn a video generative model for conditional inter-frame coding. We choose ANF because it is a special type of generative model, which includes variational autoencoder as a special case and is able to achieve better expressiveness. CANF-VC also extends the idea of conditional coding to motion coding, forming a purely conditional coding framework. Extensive experimental results on commonly used datasets confirm the superiority of CANF-VC to the state-of-the-art methods.

READ FULL TEXT
research
09/05/2022

B-CANF: Adaptive B-frame Coding with Conditional Augmented Normalizing Flows

This work introduces a B-frame coding framework, termed B-CANF, that exp...
research
10/15/2022

Learned Video Compression for YUV 4:2:0 Content Using Flow-based Conditional Inter-frame Coding

This paper proposes a learning-based video compression framework for var...
research
12/15/2021

Generalized Difference Coder: A Novel Conditional Autoencoder Structure for Video Compression

Motion compensated inter prediction is a common component of all video c...
research
09/11/2023

CANF-VC++: Enhancing Conditional Augmented Normalizing Flows for Video Compression with Advanced Techniques

Video has become the predominant medium for information dissemination, d...
research
06/07/2021

A Stochastic Model for Block Segmentation of Images Based on the Quadtree and the Bayes Code for It

In information theory, lossless compression of general data is based on ...
research
07/27/2022

A Hybrid Deep Animation Codec for Low-bitrate Video Conferencing

Deep generative models, and particularly facial animation schemes, can b...
research
10/14/2022

On Benefits and Challenges of Conditional Interframe Video Coding in Light of Information Theory

The rise of variational autoencoders for image and video compression has...

Please sign up or login with your details

Forgot password? Click here to reset