Dual-Camera Joint Deblurring-Denoising

09/16/2023
by   Shayan Shekarforoush, et al.
0

Recent image enhancement methods have shown the advantages of using a pair of long and short-exposure images for low-light photography. These image modalities offer complementary strengths and weaknesses. The former yields an image that is clean but blurry due to camera or object motion, whereas the latter is sharp but noisy due to low photon count. Motivated by the fact that modern smartphones come equipped with multiple rear-facing camera sensors, we propose a novel dual-camera method for obtaining a high-quality image. Our method uses a synchronized burst of short exposure images captured by one camera and a long exposure image simultaneously captured by another. Having a synchronized short exposure burst alongside the long exposure image enables us to (i) obtain better denoising by using a burst instead of a single image, (ii) recover motion from the burst and use it for motion-aware deblurring of the long exposure image, and (iii) fuse the two results to further enhance quality. Our method is able to achieve state-of-the-art results on synthetic dual-camera images from the GoPro dataset with five times fewer training parameters compared to the next best method. We also show that our method qualitatively outperforms competing approaches on real synchronized dual-camera captures.

READ FULL TEXT

page 5

page 7

page 8

page 14

page 16

page 17

page 18

page 19

research
12/08/2020

Digital Gimbal: End-to-end Deep Image Stabilization with Learnable Exposure Times

Mechanical image stabilization using actuated gimbals enables capturing ...
research
11/23/2018

LSD_2 - Joint Denoising and Deblurring of Short and Long Exposure Images with Convolutional Neural Networks

This paper addresses the challenging problem of acquiring high-quality p...
research
07/07/2022

D2HNet: Joint Denoising and Deblurring with Hierarchical Network for Robust Night Image Restoration

Night imaging with modern smartphone cameras is troublesome due to low p...
research
07/24/2022

Robust Scene Inference under Noise-Blur Dual Corruptions

Scene inference under low-light is a challenging problem due to severe n...
research
11/29/2022

Learn to See Faster: Pushing the Limits of High-Speed Camera with Deep Underexposed Image Denoising

The ability to record high-fidelity videos at high acquisition rates is ...
research
05/12/2021

Deep Snapshot HDR Reconstruction Based on the Polarization Camera

The recent development of the on-chip micro-polarizer technology has mad...
research
03/06/2018

Personalized Attention-Aware Exposure Control Using Reinforcement Learning

We propose a reinforcement learning approach for real-time exposure cont...

Please sign up or login with your details

Forgot password? Click here to reset