Count-Free Single-Photon 3D Imaging with Race Logic

07/10/2023
by   Atul Ingle, et al.
0

Single-photon cameras (SPCs) have emerged as a promising technology for high-resolution 3D imaging. A single-photon 3D camera determines the round-trip time of a laser pulse by capturing the arrival of individual photons at each camera pixel. Constructing photon-timestamp histograms is a fundamental operation for a single-photon 3D camera. However, in-pixel histogram processing is computationally expensive and requires large amount of memory per pixel. Digitizing and transferring photon timestamps to an off-sensor histogramming module is bandwidth and power hungry. Here we present an online approach for distance estimation without explicitly storing photon counts. The two key ingredients of our approach are (a) processing photon streams using race logic, which maintains photon data in the time-delay domain, and (b) constructing count-free equi-depth histograms. Equi-depth histograms are a succinct representation for “peaky” distributions, such as those obtained by an SPC pixel from a laser pulse reflected by a surface. Our approach uses a binner element that converges on the median (or, more generally, to another quantile) of a distribution. We cascade multiple binners to form an equi-depth histogrammer that produces multi-bin histograms. Our evaluation shows that this method can provide an order of magnitude reduction in bandwidth and power consumption while maintaining similar distance reconstruction accuracy as conventional processing methods.

READ FULL TEXT

page 1

page 10

page 12

page 24

page 25

page 28

research
06/15/2021

A Hybrid mmWave and Camera System for Long-Range Depth Imaging

mmWave radars offer excellent depth resolution owing to their high bandw...
research
12/08/2016

Imaging around corners with single-pixel detector by computational ghost imaging

We have designed a single-pixel camera with imaging around corners based...
research
11/01/2022

Frequency Cam: Imaging Periodic Signals in Real-Time

Due to their high temporal resolution and large dynamic range event came...
research
01/09/2019

Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera

Depth sensing is crucial for 3D reconstruction and scene understanding. ...
research
11/20/2020

Robust super-resolution depth imaging via a multi-feature fusion deep network

Three-dimensional imaging plays an important role in imaging application...
research
08/18/2019

Asynchronous Single-Photon 3D Imaging

Single-photon avalanche diodes (SPADs) are becoming popular in time-of-f...
research
05/17/2013

Flying Triangulation - towards the 3D movie camera

Flying Triangulation sensors enable a free-hand and motion-robust 3D dat...

Please sign up or login with your details

Forgot password? Click here to reset