CAESR: Conditional Autoencoder and Super-Resolution for Learned Spatial Scalability

02/01/2022
by   Charles Bonnineau, et al.
0

In this paper, we present CAESR, an hybrid learning-based coding approach for spatial scalability based on the versatile video coding (VVC) standard. Our framework considers a low-resolution signal encoded with VVC intra-mode as a base-layer (BL), and a deep conditional autoencoder with hyperprior (AE-HP) as an enhancement-layer (EL) model. The EL encoder takes as inputs both the upscaled BL reconstruction and the original image. Our approach relies on conditional coding that learns the optimal mixture of the source and the upscaled BL image, enabling better performance than residual coding. On the decoder side, a super-resolution (SR) module is used to recover high-resolution details and invert the conditional coding process. Experimental results have shown that our solution is competitive with the VVC full-resolution intra coding while being scalable.

READ FULL TEXT

page 2

page 4

research
06/28/2016

Scalable image coding based on epitomes

In this paper, we propose a novel scheme for scalable image coding based...
research
04/16/2021

Multitask Learning for VVC Quality Enhancement and Super-Resolution

The latest video coding standard, called versatile video coding (VVC), i...
research
04/08/2022

Deep Learning-Based Intra Mode Derivation for Versatile Video Coding

In intra coding, Rate Distortion Optimization (RDO) is performed to achi...
research
08/26/2022

Laplacian Pyramid-like Autoencoder

In this paper, we develop the Laplacian pyramid-like autoencoder (LPAE) ...
research
05/12/2019

Ensemble Super-Resolution with A Reference Dataset

By developing sophisticated image priors or designing deep(er) architect...
research
07/29/2020

Video compression with low complexity CNN-based spatial resolution adaptation

It has recently been demonstrated that spatial resolution adaptation can...
research
05/09/2023

Improved Screen Content Coding in VVC Using Soft Context Formation

Screen content images (SCIs) often contain a mix of natural and syntheti...

Please sign up or login with your details

Forgot password? Click here to reset