Block-Matching Optical Flow for Dynamic Vision Sensor- Algorithm and FPGA Implementation

06/16/2017
by   Min Liu, et al.
0

Rapid and low power computation of optical flow (OF) is potentially useful in robotics. The dynamic vision sensor (DVS) event camera produces quick and sparse output, and has high dynamic range, but conventional OF algorithms are frame-based and cannot be directly used with event-based cameras. Previous DVS OF methods do not work well with dense textured input and are designed for implementation in logic circuits. This paper proposes a new block-matching based DVS OF algorithm which is inspired by motion estimation methods used for MPEG video compression. The algorithm was implemented both in software and on FPGA. For each event, it computes the motion direction as one of 9 directions. The speed of the motion is set by the sample interval. Results show that the Average Angular Error can be improved by 30% compared with previous methods. The OF can be calculated on FPGA with 50 MHz clock in 0.2 us per event (11 clock cycles), 20 times faster than a Java software implementation running on a desktop PC. Sample data is shown that the method works on scenes dominated by edges, sparse features, and dense texture.

READ FULL TEXT

page 2

page 3

research
05/10/2018

ABMOF: A Novel Optical Flow Algorithm for Dynamic Vision Sensors

Dynamic Vision Sensors (DVS), which output asynchronous log intensity ch...
research
08/24/2021

Dense Optical Flow from Event Cameras

We propose to incorporate feature correlation and sequential processing ...
research
12/23/2022

Fast Event-based Optical Flow Estimation by Triplet Matching

Event cameras are novel bio-inspired sensors that offer advantages over ...
research
09/23/2018

Unsupervised Learning of Dense Optical Flow and Depth from Sparse Event Data

In this work we present unsupervised learning of depth and motion from s...
research
10/26/2017

Spiking Optical Flow for Event-based Sensors Using IBM's TrueNorth Neurosynaptic System

This paper describes a fully spike-based neural network for optical flow...
research
04/15/2023

Within-Camera Multilayer Perceptron DVS Denoising

In-camera event denoising reduces the data rate of event cameras by filt...
research
12/24/2021

Fast and Scalable Computation of the Forward and Inverse Discrete Periodic Radon Transform

The Discrete Periodic Radon Transform (DPRT) has been extensively used i...

Please sign up or login with your details

Forgot password? Click here to reset