Learn to See Faster: Pushing the Limits of High-Speed Camera with Deep Underexposed Image Denoising

11/29/2022
by   Weihao Zhuang, et al.
0

The ability to record high-fidelity videos at high acquisition rates is central to the study of fast moving phenomena. The difficulty of imaging fast moving scenes lies in a trade-off between motion blur and underexposure noise: On the one hand, recordings with long exposure times suffer from motion blur effects caused by movements in the recorded scene. On the other hand, the amount of light reaching camera photosensors decreases with exposure times so that short-exposure recordings suffer from underexposure noise. In this paper, we propose to address this trade-off by treating the problem of high-speed imaging as an underexposed image denoising problem. We combine recent advances on underexposed image denoising using deep learning and adapt these methods to the specificity of the high-speed imaging problem. Leveraging large external datasets with a sensor-specific noise model, our method is able to speedup the acquisition rate of a High-Speed Camera over one order of magnitude while maintaining similar image quality.

READ FULL TEXT

page 2

page 12

page 15

page 16

page 17

page 18

page 19

page 20

research
12/08/2020

Digital Gimbal: End-to-end Deep Image Stabilization with Learnable Exposure Times

Mechanical image stabilization using actuated gimbals enables capturing ...
research
11/23/2018

LSD_2 - Joint Denoising and Deblurring of Short and Long Exposure Images with Convolutional Neural Networks

This paper addresses the challenging problem of acquiring high-quality p...
research
09/16/2023

Dual-Camera Joint Deblurring-Denoising

Recent image enhancement methods have shown the advantages of using a pa...
research
12/07/2016

Embedded Line Scan Image Sensors: The Low Cost Alternative for High Speed Imaging

In this paper we propose a low-cost high-speed imaging line scan system....
research
02/14/2021

Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning

Optical flow is a method aimed at predicting the movement velocity of an...
research
08/12/2021

Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography

The lensless pinhole camera is perhaps the earliest and simplest form of...
research
04/14/2022

Learning Spatially Varying Pixel Exposures for Motion Deblurring

Computationally removing the motion blur introduced by camera shake or o...

Please sign up or login with your details

Forgot password? Click here to reset