Polarimetric iToF: Measuring High-Fidelity Depth through Scattering Media

06/30/2023
by   Daniel S. Jeon, et al.
0

Indirect time-of-flight (iToF) imaging allows us to capture dense depth information at a low cost. However, iToF imaging often suffers from multipath interference (MPI) artifacts in the presence of scattering media, resulting in severe depth-accuracy degradation. For instance, iToF cameras cannot measure depth accurately through fog because ToF active illumination scatters back to the sensor before reaching the farther target surface. In this work, we propose a polarimetric iToF imaging method that can capture depth information robustly through scattering media. Our observations on the principle of indirect ToF imaging and polarization of light allow us to formulate a novel computational model of scattering-aware polarimetric phase measurements that enables us to correct MPI errors. We first devise a scattering-aware polarimetric iToF model that can estimate the phase of unpolarized backscattered light. We then combine the optical filtering of polarization and our computational modeling of unpolarized backscattered light via scattering analysis of phase and amplitude. This allows us to tackle the MPI problem by estimating the scattering energy through the participating media. We validate our method on an experimental setup using a customized off-the-shelf iToF camera. Our method outperforms baseline methods by a significant margin by means of our scattering model and polarimetric phase measurements.

READ FULL TEXT

page 8

page 13

page 14

page 15

page 16

page 17

page 18

page 19

research
06/02/2020

Automatic Differentiation for All Photons Imaging to See Inside Volumetric Scattering Media

Imaging through dense scattering media - such as biological tissue, fog,...
research
01/20/2015

A Light Transport Model for Mitigating Multipath Interference in TOF Sensors

Continuous-wave Time-of-flight (TOF) range imaging has become a commerci...
research
04/01/2019

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Three-dimensional (3D) reconstruction and scene depth estimation from 2-...
research
05/23/2018

DeepToF: Off-the-Shelf Real-Time Correction of Multipath Interference in Time-of-Flight Imaging

Time-of-flight (ToF) imaging has become a widespread technique for depth...
research
12/07/2021

Wild ToFu: Improving Range and Quality of Indirect Time-of-Flight Depth with RGB Fusion in Challenging Environments

Indirect Time-of-Flight (I-ToF) imaging is a widespread way of depth est...
research
03/12/2021

iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imaging

Indirect Time-of-Flight (iToF) cameras are a promising depth sensing tec...
research
10/13/2013

Dense Scattering Layer Removal

We propose a new model, together with advanced optimization, to separate...

Please sign up or login with your details

Forgot password? Click here to reset