A direct time-of-flight image sensor with in-pixel surface detection and dynamic vision

09/23/2022
by   Istvan Gyongy, et al.
0

3D flash LIDAR is an alternative to the traditional scanning LIDAR systems, promising precise depth imaging in a compact form factor, and free of moving parts, for applications such as self-driving cars, robotics and augmented reality (AR). Typically implemented using single-photon, direct time-of-flight (dToF) receivers in image sensor format, the operation of the devices can be hindered by the large number of photon events needing to be processed and compressed in outdoor scenarios, limiting frame rates and scalability to larger arrays. We here present a 64x32 pixel (256x128 SPAD) dToF imager that overcomes these limitations by using pixels with embedded histogramming, which lock onto and track the return signal. This reduces the size of output data frames considerably, enabling maximum frame rates in the 10 kFPS range or 100 kFPS for direct depth readings. The sensor offers selective readout of pixels detecting surfaces, or those sensing motion, leading to reduced power consumption and off-chip processing requirements. We demonstrate the application of the sensor in mid-range LIDAR.

READ FULL TEXT

page 4

page 12

page 15

page 16

page 19

page 20

research
10/19/2022

Video super-resolution for single-photon LIDAR

3D Time-of-Flight (ToF) image sensors are used widely in applications su...
research
07/28/2021

High-speed object detection with a single-photon time-of-flight image sensor

3D time-of-flight (ToF) imaging is used in a variety of applications suc...
research
02/13/2019

Gated2Depth: Real-time Dense Lidar from Gated Images

We present an imaging framework which converts three images from a gated...
research
12/17/2021

All-photon Polarimetric Time-of-Flight Imaging

Time-of-flight (ToF) sensors provide an imaging modality fueling diverse...
research
12/27/2019

3D Sensing of a Moving Object with a Nodding 2D LIDAR and Reconfigurable Mirrors

Perception in 3D has become standard practice for a large part of roboti...
research
08/22/2022

Physical LiDAR Simulation in Real-Time Engine

Designing and validating sensor applications and algorithms in simulatio...
research
04/14/2023

Near Field iToF LIDAR Depth Improvement from Limited Number of Shots

Indirect Time of Flight LiDARs can indirectly calculate the scene's dept...

Please sign up or login with your details

Forgot password? Click here to reset