Quanta Burst Photography

06/21/2020
by   Sizhuo Ma, et al.
0

Single-photon avalanche diodes (SPADs) are an emerging sensor technology capable of detecting individual incident photons, and capturing their time-of-arrival with high timing precision. While these sensors were limited to single-pixel or low-resolution devices in the past, recently, large (up to 1 MPixel) SPAD arrays have been developed. These single-photon cameras (SPCs) are capable of capturing high-speed sequences of binary single-photon images with no read noise. We present quanta burst photography, a computational photography technique that leverages SPCs as passive imaging devices for photography in challenging conditions, including ultra low-light and fast motion. Inspired by recent success of conventional burst photography, we design algorithms that align and merge binary sequences captured by SPCs into intensity images with minimal motion blur and artifacts, high signal-to-noise ratio (SNR), and high dynamic range. We theoretically analyze the SNR and dynamic range of quanta burst photography, and identify the imaging regimes where it provides significant benefits. We demonstrate, via a recently developed SPAD array, that the proposed method is able to generate high-quality images for scenes with challenging lighting, complex geometries, high dynamic range and moving objects. With the ongoing development of SPAD arrays, we envision quanta burst photography finding applications in both consumer and scientific photography.

READ FULL TEXT

page 8

page 10

page 11

page 12

page 22

page 24

page 25

page 27

research
02/26/2019

High Flux Passive Imaging with Single-Photon Sensors

Single-photon avalanche diodes (SPADs) are an emerging technology with a...
research
04/11/2022

Single-Photon Structured Light

We present a novel structured light technique that uses Single Photon Av...
research
07/23/2021

Photon-Starved Scene Inference using Single Photon Cameras

Scene understanding under low-light conditions is a challenging problem....
research
09/07/2023

Panoramas from Photons

Scene reconstruction in the presence of high-speed motion and low illumi...
research
03/31/2021

Passive Inter-Photon Imaging

Digital camera pixels measure image intensities by converting incident l...
research
10/07/2022

Simulating single-photon detector array sensors for depth imaging

Single-Photon Avalanche Detector (SPAD) arrays are a rapidly emerging te...
research
11/24/2020

Impact of Power Supply Noise on Image Sensor Performance in Automotive Applications

Vision Systems are quickly becoming a large component of Active Automoti...

Please sign up or login with your details

Forgot password? Click here to reset