Semantic See-Through Rendering on Light Fields

03/26/2018
by   Huangjie Yu, et al.
0

We present a novel semantic light field (LF) refocusing technique that can achieve unprecedented see-through quality. Different from prior art, our semantic see-through (SST) differentiates rays in their semantic meaning and depth. Specifically, we combine deep learning and stereo matching to provide each ray a semantic label. We then design tailored weighting schemes for blending the rays. Although simple, our solution can effectively remove foreground residues when focusing on the background. At the same time, SST maintains smooth transitions in varying focal depths. Comprehensive experiments on synthetic and new real indoor and outdoor datasets demonstrate the effectiveness and usefulness of our technique.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 8

page 9

research
08/02/2017

A Learning-based Framework for Hybrid Depth-from-Defocus and Stereo Matching

Depth from defocus (DfD) and stereo matching are two most studied passiv...
research
09/04/2023

ImmersiveNeRF: Hybrid Radiance Fields for Unbounded Immersive Light Field Reconstruction

This paper proposes a hybrid radiance field representation for unbounded...
research
10/15/2018

Deep Surface Light Fields

A surface light field represents the radiance of rays originating from a...
research
11/29/2017

Deep Eyes: Binocular Depth-from-Focus on Focal Stack Pairs

Human visual system relies on both binocular stereo cues and monocular f...
research
03/31/2022

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

Recent research explosion on Neural Radiance Field (NeRF) shows the enco...
research
03/18/2019

Self-calibrating Deep Photometric Stereo Networks

This paper proposes an uncalibrated photometric stereo method for non-La...
research
11/29/2017

Sparse Photometric 3D Face Reconstruction Guided by Morphable Models

We present a novel 3D face reconstruction technique that leverages spars...

Please sign up or login with your details

Forgot password? Click here to reset