Burst Imaging for Light-Constrained Structure-From-Motion

08/23/2021
by   Ahalya Ravendran, et al.
5

Images captured under extremely low light conditions are noise-limited, which can cause existing robotic vision algorithms to fail. In this paper we develop an image processing technique for aiding 3D reconstruction from images acquired in low light conditions. Our technique, based on burst photography, uses direct methods for image registration within bursts of short exposure time images to improve the robustness and accuracy of feature-based structure-from-motion (SfM). We demonstrate improved SfM performance in challenging light-constrained scenes, including quantitative evaluations that show improved feature performance and camera pose estimates. Additionally, we show that our method converges more frequently to correct reconstructions than the state-of-the-art. Our method is a significant step towards allowing robots to operate in low light conditions, with potential applications to robots operating in environments such as underground mines and night time operation.

READ FULL TEXT

page 1

page 4

page 5

research
09/20/2022

BuFF: Burst Feature Finder for Light-Constrained 3D Reconstruction

Robots operating at night using conventional vision cameras face signifi...
research
03/29/2021

Refractive Light-Field Features for Curved Transparent Objects in Structure from Motion

Curved refractive objects are common in the human environment, and have ...
research
05/31/2018

Distinguishing Refracted Features using Light Field Cameras with Application to Structure from Motion

Robots must reliably interact with refractive objects in many applicatio...
research
04/11/2019

Learning Digital Camera Pipeline for Extreme Low-Light Imaging

In low-light conditions, a conventional camera imaging pipeline produces...
research
03/27/2023

Human Pose Estimation in Extremely Low-Light Conditions

We study human pose estimation in extremely low-light images. This task ...
research
06/14/2016

Richardson-Lucy Deblurring for Moving Light Field Cameras

We generalize Richardson-Lucy (RL) deblurring to 4-D light fields by rep...
research
03/27/2022

Deep Polarimetric HDR Reconstruction

This paper proposes a novel learning based high-dynamic-range (HDR) reco...

Please sign up or login with your details

Forgot password? Click here to reset