DeepAI AI Chat
Log In Sign Up

Event-based Shape from Polarization

01/17/2023
by   Manasi Muglikar, et al.
0

State-of-the-art solutions for Shape-from-Polarization (SfP) suffer from a speed-resolution tradeoff: they either sacrifice the number of polarization angles measured or necessitate lengthy acquisition times due to framerate constraints, thus compromising either accuracy or latency. We tackle this tradeoff using event cameras. Event cameras operate at microseconds resolution with negligible motion blur, and output a continuous stream of events that precisely measures how light changes over time asynchronously. We propose a setup that consists of a linear polarizer rotating at high-speeds in front of an event camera. Our method uses the continuous event stream caused by the rotation to reconstruct relative intensities at multiple polarizer angles. Experiments demonstrate that our method outperforms physics-based baselines using frames, reducing the MAE by 25 the real world, we observe, however, that the challenging conditions (i.e., when few events are generated) harm the performance of physics-based solutions. To overcome this, we propose a learning-based approach that learns to estimate surface normals even at low event-rates, improving the physics-based approach by 52 speed equivalent to 50 fps (>twice the framerate of the commercial polarization sensor) while retaining the spatial resolution of 1MP. Our evaluation is based on the first large-scale dataset for event-based SfP

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 10

11/30/2021

ESL: Event-based Structured Light

Event cameras are bio-inspired sensors providing significant advantages ...
03/12/2019

Bringing Blurry Alive at High Frame-Rate with an Event Camera

Event-based cameras can measure intensity changes (called ` events') wit...
09/18/2022

ASAP: Adaptive Scheme for Asynchronous Processing of Event-based Vision Algorithms

Event cameras can capture pixel-level illumination changes with very hig...
08/01/2021

Powerline Tracking with Event Cameras

Autonomous inspection of powerlines with quadrotors is challenging. Flig...
03/27/2019

Speed Invariant Time Surface for Learning to Detect Corner Points with Event-Based Cameras

We propose a learning approach to corner detection for event-based camer...
02/15/2023

CERiL: Continuous Event-based Reinforcement Learning

This paper explores the potential of event cameras to enable continuous ...
02/26/2022

Utility and Feasibility of a Center Surround Event Camera

Standard dynamic vision sensor (DVS) event cameras output a stream of sp...