Depth Reconstruction of Translucent Objects from a Single Time-of-Flight Camera using Deep Residual Networks

09/28/2018
by   Seongjong Song, et al.
6

We propose a novel approach to recovering the translucent objects from a single time-of-flight (ToF) depth camera using deep residual networks. When recording the translucent objects using the ToF depth camera, their depth values are severely contaminated due to complex light interactions with the surrounding environment. While existing methods suggested new capture systems or developed the depth distortion models, their solutions were less practical because of strict assumptions or heavy computational complexity. In this paper, we adopt the deep residual networks for modeling the ToF depth distortion caused by translucency. To fully utilize both the local and semantic information of objects, multi-scale patches are used to predict the depth value. Based on the quantitative and qualitative evaluation on our benchmark database, we show the effectiveness and robustness of the proposed algorithm.

READ FULL TEXT

page 6

page 9

page 10

page 11

page 12

research
07/13/2019

Structure-Aware Residual Pyramid Network for Monocular Depth Estimation

Monocular depth estimation is an essential task for scene understanding....
research
08/17/2019

Matching-based Depth Camera and Mirrors for 3D Reconstruction

Reconstructing 3D object models is playing an important role in many app...
research
06/30/2023

Achieving RGB-D level Segmentation Performance from a Single ToF Camera

Depth is a very important modality in computer vision, typically used as...
research
04/25/2019

Learning the Depths of Moving People by Watching Frozen People

We present a method for predicting dense depth in scenarios where both a...
research
02/20/2018

Novel View Synthesis for Large-scale Scene using Adversarial Loss

Novel view synthesis aims to synthesize new images from different viewpo...
research
07/26/2018

Tackling 3D ToF Artifacts Through Learning and the FLAT Dataset

Scene motion, multiple reflections, and sensor noise introduce artifacts...
research
02/06/2021

Improving Model and Search for Computer Go

The standard for Deep Reinforcement Learning in games, following Alpha Z...

Please sign up or login with your details

Forgot password? Click here to reset