Secrets of Event-Based Optical Flow

07/20/2022
by   Shintaro Shiba, et al.
2

Event cameras respond to scene dynamics and offer advantages to estimate motion. Following recent image-based deep-learning achievements, optical flow estimation methods for event cameras have rushed to combine those image-based methods with event data. However, it requires several adaptations (data conversion, loss function, etc.) as they have very different properties. We develop a principled method to extend the Contrast Maximization framework to estimate optical flow from events alone. We investigate key elements: how to design the objective function to prevent overfitting, how to warp events to deal better with occlusions, and how to improve convergence with multi-scale raw events. With these key elements, our method ranks first among unsupervised methods on the MVSEC benchmark, and is competitive on the DSEC benchmark. Moreover, our method allows us to expose the issues of the ground truth flow in those benchmarks, and produces remarkable results when it is transferred to unsupervised learning settings. Our code is available at https://github.com/tub-rip/event_based_optical_flow

READ FULL TEXT

page 2

page 10

page 12

page 17

page 19

research
07/11/2023

Towards Anytime Optical Flow Estimation with Event Cameras

Event cameras are capable of responding to log-brightness changes in mic...
research
04/04/2018

A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation

We present a unifying framework to solve several computer vision problem...
research
01/30/2023

Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labels

The insufficient number of annotated thermal infrared (TIR) image datase...
research
05/13/2023

EV-MGRFlowNet: Motion-Guided Recurrent Network for Unsupervised Event-based Optical Flow with Hybrid Motion-Compensation Loss

Event cameras offer promising properties, such as high temporal resoluti...
research
08/14/2023

FocusFlow: Boosting Key-Points Optical Flow Estimation for Autonomous Driving

Key-point-based scene understanding is fundamental for autonomous drivin...
research
04/27/2023

Density Invariant Contrast Maximization for Neuromorphic Earth Observations

Contrast maximization (CMax) techniques are widely used in event-based v...
research
02/16/2023

A cloud-based deep learning system for improving crowd safety at event entrances

Crowding at the entrances of large events may lead to critical and life-...

Please sign up or login with your details

Forgot password? Click here to reset