Multi-modal Non-line-of-sight Passive Imaging

07/06/2018
by   Andre Beckus, et al.
4

We consider the non-line-of-sight (NLOS) imaging of an object using light reflected off a diffusive wall. The wall scatters incident light such that a lens is no longer useful to form an image. Instead, we exploit the four-dimensional spatial coherence function to reconstruct a two-dimensional projection of the obscured object. The approach is completely passive in the sense that no control over the light illuminating the object is assumed, and is compatible with the partially coherent fields ubiquitous in both indoor and outdoor environments. We formulate a multi-criteria convex optimization problem for reconstruction, which fuses reflected field's intensity and spatial coherence information at different scales. Our formulation leverages established optics models of light propagation and scattering and exploits the sparsity common to many images in different bases. We also develop an algorithm based on the Alternating Direction Method of Multipliers to efficiently solve the convex program proposed. A means for analyzing the null space of the measurement matrices is provided, as well as a means for weighing the contribution of individual measurements to the reconstruction. This work holds promise to advance passive imaging in challenging NLOS regimes in which the intensity does not necessarily retain distinguishable features, and provides a framework for multi-modal information fusion for efficient scene reconstruction.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
11/29/2019

Enhancing Passive Non-Line-of-Sight Imaging Using Polarization Cues

This paper presents a method of passive non-line-of-sight (NLOS) imaging...
research
09/16/2021

Towards Non-Line-of-Sight Photography

Non-line-of-sight (NLOS) imaging is based on capturing the multi-bounce ...
research
05/22/2018

A scene perception system for visually impaired based on object detection and classification using multi-modal DCNN

This paper represents a cost-effective scene perception system aimed tow...
research
05/25/2021

Polarimetric Spatio-Temporal Light Transport Probing

Light can undergo complex interactions with multiple scene surfaces of d...
research
03/22/2018

Generalized Scene Reconstruction

A new passive approach called Generalized Scene Reconstruction (GSR) ena...
research
08/30/2021

What You Can Learn by Staring at a Blank Wall

We present a passive non-line-of-sight method that infers the number of ...
research
06/16/2020

Two-Dimensional Non-Line-of-Sight Scene Estimation from a Single Edge Occluder

Passive non-line-of-sight imaging methods are often faster and stealthie...

Please sign up or login with your details

Forgot password? Click here to reset