Automatic calibration of time of flight based non-line-of-sight reconstruction

by   Subhash Chandra Sadhu, et al.

Time of flight based Non-line-of-sight (NLOS) imaging approaches require precise calibration of illumination and detector positions on the visible scene to produce reasonable results. If this calibration error is sufficiently high, reconstruction can fail entirely without any indication to the user. In this work, we highlight the necessity of building autocalibration into NLOS reconstruction in order to handle mis-calibration. We propose a forward model of NLOS measurements that is differentiable with respect to both, the hidden scene albedo, and virtual illumination and detector positions. With only a mean squared error loss and no regularization, our model enables joint reconstruction and recovery of calibration parameters by minimizing the measurement residual using gradient descent. We demonstrate our method is able to produce robust reconstructions using simulated and real data where the calibration error applied causes other state of the art algorithms to fail.



There are no comments yet.


page 1

page 2

page 4

page 5

page 6

page 8


Cross-calibration of Time-of-flight and Colour Cameras

Time-of-flight cameras provide depth information, which is complementary...

Optimal Calibration for Computer Model Prediction with Finite Samples

This paper considers the computer model prediction in a non-asymptotic f...

Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification

Non-line-of-sight (NLOS) imaging of objects not visible to either the ca...

Joint Reconstruction and Calibration using Regularization by Denoising

Regularization by denoising (RED) is a broadly applicable framework for ...

Hybrid calibration procedure for fringe projection profilometry based on stereo-vision and polynomial fitting

The key to accurate 3D shape measurement in Fringe Projection Profilomet...

Two-Dimensional Non-Line-of-Sight Scene Estimation from a Single Edge Occluder

Passive non-line-of-sight imaging methods are often faster and stealthie...

Automatic Detection of Calibration Grids in Time-of-Flight Images

It is convenient to calibrate time-of-flight cameras by established meth...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.