A Hierarchical Coding Scheme for Glasses-free 3D Displays Based on Scalable Hybrid Layered Representation of Real-World Light Fields

04/19/2021
by   Joshitha R, et al.
0

This paper presents a novel hierarchical coding scheme for light fields based on transmittance patterns of low-rank multiplicative layers and Fourier disparity layers. The proposed scheme learns stacked multiplicative layers from subsets of light field views determined from different scanning orders. The multiplicative layers are optimized using a fast data-driven convolutional neural network (CNN). The spatial correlation in layer patterns is exploited with varying low ranks in factorization derived from singular value decomposition on a Krylov subspace. Further, encoding with HEVC efficiently removes intra-view and inter-view correlation in low-rank approximated layers. The initial subset of approximated decoded views from multiplicative representation is used to construct Fourier disparity layer (FDL) representation. The FDL model synthesizes second subset of views which is identified by a pre-defined hierarchical prediction order. The correlations between the prediction residue of synthesized views is further eliminated by encoding the residual signal. The set of views obtained from decoding the residual is employed in order to refine the FDL model and predict the next subset of views with improved accuracy. This hierarchical procedure is repeated until all light field views are encoded. The critical advantage of proposed hybrid layered representation and coding scheme is that it utilizes not just spatial and temporal redundancies, but efficiently exploits the strong intrinsic similarities among neighboring sub-aperture images in both horizontal and vertical directions as specified by different predication orders. Besides, the scheme is flexible to realize a range of multiple bitrates at the decoder within a single integrated system. The compression performance analyzed with real light field shows substantial bitrate savings, maintaining good reconstruction quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
10/04/2022

A Novel Light Field Coding Scheme Based on Deep Belief Network and Weighted Binary Images for Additive Layered Displays

Light field display caters to the viewer's immersive experience by provi...
research
01/21/2019

A Fourier Disparity Layer representation for Light Fields

In this paper, we present a new Light Field representation for efficient...
research
10/12/2016

Light Field Compression with Disparity Guided Sparse Coding based on Structural Key Views

Recent imaging technologies are rapidly evolving for sampling richer and...
research
06/09/2022

Novel projection schemes for graph-based Light Field coding

In Light Field compression, graph-based coding is powerful to exploit si...
research
02/25/2019

HMLFC: Hierarchical Motion-Compensated Light Field Compression for Interactive Rendering

We present a new motion-compensated hierarchical compression scheme (HML...

Please sign up or login with your details

Forgot password? Click here to reset