Learning-Based View Synthesis for Light Field Cameras

09/09/2016
by   Nima Khademi Kalantari, et al.
0

With the introduction of consumer light field cameras, light field imaging has recently become widespread. However, there is an inherent trade-off between the angular and spatial resolution, and thus, these cameras often sparsely sample in either spatial or angular domain. In this paper, we use machine learning to mitigate this trade-off. Specifically, we propose a novel learning-based approach to synthesize new views from a sparse set of input views. We build upon existing view synthesis techniques and break down the process into disparity and color estimation components. We use two sequential convolutional neural networks to model these two components and train both networks simultaneously by minimizing the error between the synthesized and ground truth images. We show the performance of our approach using only four corner sub-aperture views from the light fields captured by the Lytro Illum camera. Experimental results show that our approach synthesizes high-quality images that are superior to the state-of-the-art techniques on a variety of challenging real-world scenes. We believe our method could potentially decrease the required angular resolution of consumer light field cameras, which allows their spatial resolution to increase.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

page 9

research
10/14/2019

Light Field Synthesis by Training Deep Network in the Refocused Image Domain

Light field imaging, which captures spatio-angular information of incide...
research
08/12/2020

Self-supervised Light Field View Synthesis Using Cycle Consistency

High angular resolution is advantageous for practical applications of li...
research
11/30/2021

Light Field Implicit Representation for Flexible Resolution Reconstruction

Inspired by the recent advances in implicitly representing signals with ...
research
05/08/2017

Light Field Video Capture Using a Learning-Based Hybrid Imaging System

Light field cameras have many advantages over traditional cameras, as th...
research
05/04/2015

Light-field Microscopy with a Consumer Light-field Camera

We explore the use of inexpensive consumer light- field camera technolog...
research
09/07/2020

Light Field View Synthesis via Aperture Flow and Propagation Confidence Map

This paper presents a learning-based approach to synthesize the view fro...
research
05/31/2018

Light Field Denoising via Anisotropic Parallax Analysis in a CNN Framework

Light field (LF) cameras provide perspective information of scenes by ta...

Please sign up or login with your details

Forgot password? Click here to reset