Robust Scene Inference under Noise-Blur Dual Corruptions

07/24/2022
by   Bhavya Goyal, et al.
0

Scene inference under low-light is a challenging problem due to severe noise in the captured images. One way to reduce noise is to use longer exposure during the capture. However, in the presence of motion (scene or camera motion), longer exposures lead to motion blur, resulting in loss of image information. This creates a trade-off between these two kinds of image degradations: motion blur (due to long exposure) vs. noise (due to short exposure), also referred as a dual image corruption pair in this paper. With the rise of cameras capable of capturing multiple exposures of the same scene simultaneously, it is possible to overcome this trade-off. Our key observation is that although the amount and nature of degradation varies for these different image captures, the semantic content remains the same across all images. To this end, we propose a method to leverage these multi exposure captures for robust inference under low-light and motion. Our method builds on a feature consistency loss to encourage similar results from these individual captures, and uses the ensemble of their final predictions for robust visual recognition. We demonstrate the effectiveness of our approach on simulated images as well as real captures with multiple exposures, and across the tasks of object detection and image classification.

READ FULL TEXT

page 2

page 5

page 7

page 9

page 10

page 13

page 14

page 15

research
12/08/2020

Digital Gimbal: End-to-end Deep Image Stabilization with Learnable Exposure Times

Mechanical image stabilization using actuated gimbals enables capturing ...
research
09/16/2023

Dual-Camera Joint Deblurring-Denoising

Recent image enhancement methods have shown the advantages of using a pa...
research
09/22/2021

A Method For Adding Motion-Blur on Arbitrary Objects By using Auto-Segmentation and Color Compensation Techniques

When dynamic objects are captured by a camera, motion blur inevitably oc...
research
04/14/2022

Learning Spatially Varying Pixel Exposures for Motion Deblurring

Computationally removing the motion blur introduced by camera shake or o...
research
10/24/2019

Handheld Mobile Photography in Very Low Light

Taking photographs in low light using a mobile phone is challenging and ...
research
12/10/2021

Camera Condition Monitoring and Readjustment by means of Noise and Blur

Autonomous vehicles and robots require increasingly more robustness and ...
research
08/23/2015

Light Efficient Flutter Shutter

Flutter shutter is a technique in which the exposure is chopped into seg...

Please sign up or login with your details

Forgot password? Click here to reset