Steady-state Non-Line-of-Sight Imaging

11/24/2018
by   Wenzheng Chen, et al.
0

Conventional intensity cameras recover objects in the direct line-of-sight of the camera, while occluded scene parts are considered lost in the image formation process. Non-line-of-sight imaging (NLOS) aims at recovering these occluded objects by analyzing their indirect reflections on visible scene surfaces. Existing NLOS methods temporally probe the indirect light transport to unmix light paths based on their travel time, which mandates instrumentation with low photon efficiency, high cost, and mechanical scanning. We depart from temporal probing and demonstrate steady-state non-line-of-sight imaging using conventional intensity sensors and continuous illumination. Instead of assuming perfectly isotropic scattering, the proposed method exploits directionality of reflectance on object surfaces resulting in spatial variation of the indirect reflections for varying illumination patterns. To tackle the shape-dependence of these variations, we propose a trainable architecture which learns from synthetic data to map steady-state diffuse indirect reflections to unknown scene reflectance. Relying on consumer color image sensors, with high fill-factor, quantum efficiency and low read-out noise, we demonstrate high-fidelity full-color NLOS imaging in setup scenarios identical to recent pulsed systems with picosecond resolution.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
03/23/2021

Virtual light transport matrices for non-line-of-sight imaging

The light transport matrix (LTM) is an instrumental tool in line-of-sigh...
research
04/03/2023

Role of Transients in Two-Bounce Non-Line-of-Sight Imaging

The goal of non-line-of-sight (NLOS) imaging is to image objects occlude...
research
12/13/2019

Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

Conventional sensor systems record information about directly visible ob...
research
05/28/2019

Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification

Non-line-of-sight (NLOS) imaging of objects not visible to either the ca...
research
07/26/2023

Virtual Mirrors: Non-Line-of-Sight Imaging Beyond the Third Bounce

Non-line-of-sight (NLOS) imaging methods are capable of reconstructing c...
research
05/25/2021

Polarimetric Spatio-Temporal Light Transport Probing

Light can undergo complex interactions with multiple scene surfaces of d...
research
06/03/2016

Optically lightweight tracking of objects around a corner

The observation of objects located in inaccessible regions is a recurrin...

Please sign up or login with your details

Forgot password? Click here to reset