A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation

04/04/2018
by   Guillermo Gallego, et al.
0

We present a unifying framework to solve several computer vision problems with event cameras: motion, depth and optical flow estimation. The main idea of our framework is to find the point trajectories on the image plane that are best aligned with the event data by maximizing an objective function: the contrast of an image of warped events. Our method implicitly handles data association between the events, and therefore, does not rely on additional appearance information about the scene. In addition to accurately recovering the motion parameters of the problem, our framework produces motion-corrected edge-like images with high dynamic range that can be used for further scene analysis. The proposed method is not only simple, but more importantly, it is, to the best of our knowledge, the first method that can be successfully applied to such a diverse set of important vision tasks with event cameras.

READ FULL TEXT

page 3

page 6

page 8

page 12

page 13

page 15

research
07/20/2022

Secrets of Event-Based Optical Flow

Event cameras respond to scene dynamics and offer advantages to estimate...
research
12/19/2018

Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotion

In this work, we propose a novel framework for unsupervised learning for...
research
07/08/2022

Event Collapse in Contrast Maximization Frameworks

Contrast maximization (CMax) is a framework that provides state-of-the-a...
research
12/14/2022

A Fast Geometric Regularizer to Mitigate Event Collapse in the Contrast Maximization Framework

Event cameras are emerging vision sensors and their advantages are suita...
research
04/27/2023

Density Invariant Contrast Maximization for Neuromorphic Earth Observations

Contrast maximization (CMax) techniques are widely used in event-based v...
research
04/15/2019

Focus Is All You Need: Loss Functions For Event-based Vision

Event cameras are novel vision sensors that output pixel-level brightnes...
research
09/09/2022

EDeNN: Event Decay Neural Networks for low latency vision

Despite the success of neural networks in computer vision tasks, digital...

Please sign up or login with your details

Forgot password? Click here to reset