Geometry-Aware Graph Transforms for Light Field Compact Representation

03/08/2019
by   Mira Rizkallah, et al.
0

The paper addresses the problem of energy compaction of dense 4D light fields by designing geometry-aware local graph-based transforms. Local graphs are constructed on super-rays that can be seen as a grouping of spatially and geometry-dependent angularly correlated pixels. Both non separable and separable transforms are considered. Despite the local support of limited size defined by the super-rays, the Laplacian matrix of the non separable graph remains of high dimension and its diagonalization to compute the transform eigen vectors remains computationally expensive. To solve this problem, we then perform the local spatio-angular transform in a separable manner. We show that when the shape of corresponding super-pixels in the different views is not isometric, the basis functions of the spatial transforms are not coherent, resulting in decreased correlation between spatial transform coefficients. We hence propose a novel transform optimization method that aims at preserving angular correlation even when the shapes of the super-pixels are not isometric. Experimental results show the benefit of the approach in terms of energy compaction. A coding scheme is also described to assess the rate-distortion perfomances of the proposed transforms and is compared to state of the art encoders namely HEVC and JPEG Pleno VM 1.1.

READ FULL TEXT

page 5

page 12

page 17

research
03/08/2019

Prediction and Sampling with Local Graph Transforms for Quasi-Lossless Light Field Compression

Graph-based transforms have been shown to be powerful tools in terms of ...
research
11/16/2019

Parametric Graph-based Separable Transforms for Video Coding

In many video coding systems, separable transforms (such as two-dimensio...
research
06/09/2022

Novel projection schemes for graph-based Light Field coding

In Light Field compression, graph-based coding is powerful to exploit si...
research
09/03/2019

Graph-based Transforms for Video Coding

In many state-of-the-art compression systems, signal transformation is a...
research
11/30/2021

Light Field Implicit Representation for Flexible Resolution Reconstruction

Inspired by the recent advances in implicitly representing signals with ...
research
04/05/2020

Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization

Light field (LF) images acquired by hand-held devices usually suffer fro...
research
03/29/2020

High-Order Residual Network for Light Field Super-Resolution

Plenoptic cameras usually sacrifice the spatial resolution of their SAIs...

Please sign up or login with your details

Forgot password? Click here to reset