HDR Imaging with Quanta Image Sensors: Theoretical Limits and Optimal Reconstruction

11/06/2020
by   Abhiram Gnanasambandam, et al.
0

High dynamic range (HDR) imaging is one of the biggest achievements in modern photography. Traditional solutions to HDR imaging are designed for and applied to CMOS image sensors (CIS). However, the mainstream one-micron CIS cameras today generally have a high read noise and low frame-rate. These, in turn, limit the acquisition speed and quality, making the cameras slow in the HDR mode. In this paper, we propose a new computational photography technique for HDR imaging. Recognizing the limitations of CIS, we use the Quanta Image Sensor (QIS) to trade the spatial-temporal resolution with bit-depth. QIS is a single-photon image sensor that has comparable pixel pitch to CIS but substantially lower dark current and read noise. We provide a complete theoretical characterization of the sensor in the context of HDR imaging, by proving the fundamental limits in the dynamic range that QIS can offer and the trade-offs with noise and speed. In addition, we derive an optimal reconstruction algorithm for single-bit and multi-bit QIS. Our algorithm is theoretically optimal for all linear reconstruction schemes based on exposure bracketing. Experimental results confirm the validity of the theory and algorithm, based on synthetic and real QIS data.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 8

page 12

page 13

page 14

research
03/21/2019

Megapixel Photon-Counting Color Imaging using Quanta Image Sensor

Quanta Image Sensor (QIS) is a single-photon detector designed for extre...
research
07/16/2020

Dynamic Low-light Imaging with Quanta Image Sensors

Imaging in low light is difficult because the number of photons arriving...
research
07/05/2017

Robust Multi-Image HDR Reconstruction for the Modulo Camera

Photographing scenes with high dynamic range (HDR) poses great challenge...
research
02/21/2017

Lensless Photography with only an image sensor

Photography usually requires optics in conjunction with a recording devi...
research
12/09/2021

MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding

The ability to image high-dynamic-range (HDR) scenes is crucial in many ...
research
11/06/2018

A `Little Bit' Too Much? High Speed Imaging from Sparse Photon Counts

Recent advances in photographic sensing technologies have made it possib...
research
08/06/2017

Intensity Video Guided 4D Fusion for Improved Highly Dynamic 3D Reconstruction

The availability of high-speed 3D video sensors has greatly facilitated ...

Please sign up or login with your details

Forgot password? Click here to reset