A Fourier Disparity Layer representation for Light Fields

01/21/2019
by   Mikaël Le Pendu, et al.
10

In this paper, we present a new Light Field representation for efficient Light Field processing and rendering called Fourier Disparity Layers (FDL). The proposed FDL representation samples the Light Field in the depth (or equivalently the disparity) dimension by decomposing the scene as a discrete sum of layers. The layers can be constructed from various types of Light Field inputs including a set of sub-aperture images, a focal stack, or even a combination of both. From our derivations in the Fourier domain, the layers are simply obtained by a regularized least square regression performed independently at each spatial frequency, which is efficiently parallelized in a GPU implementation. Our model is also used to derive a gradient descent based calibration step that estimates the input view positions and an optimal set of disparity values required for the layer construction. Once the layers are known, they can be simply shifted and filtered to produce different viewpoints of the scene while controlling the focus and simulating a camera aperture of arbitrary shape and size. Our implementation in the Fourier domain allows real time Light Field rendering. Finally, direct applications such as view interpolation or extrapolation and denoising are presented and evaluated.

READ FULL TEXT

page 1

page 6

page 7

page 9

page 10

research
06/20/2022

Geo-NI: Geometry-aware Neural Interpolation for Light Field Rendering

In this paper, we present a Geometry-aware Neural Interpolation (Geo-NI)...
research
04/14/2021

Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network

The light field (LF) reconstruction is mainly confronted with two challe...
research
03/30/2021

Machine learning method for light field refocusing

Light field imaging introduced the capability to refocus an image after ...
research
03/07/2019

Stratified Labeling for Surface Consistent Parallax Correction and Occlusion Completion

The light field faithfully records the spatial and angular configuration...
research
04/19/2021

A Hierarchical Coding Scheme for Glasses-free 3D Displays Based on Scalable Hybrid Layered Representation of Real-World Light Fields

This paper presents a novel hierarchical coding scheme for light fields ...
research
10/10/2019

Interactive Light Field Tilt-Shift Refocus with Generalized Shift-and-Sum

Since their introduction more than two decades ago, light fields have ga...

Please sign up or login with your details

Forgot password? Click here to reset