Independent Motion Detection with Event-driven Cameras

06/27/2017
by   Valentina Vasco, et al.
0

Unlike standard cameras that send intensity images at a constant frame rate, event-driven cameras asynchronously report pixel-level brightness changes, offering low latency and high temporal resolution (both in the order of micro-seconds). As such, they have great potential for fast and low power vision algorithms for robots. Visual tracking, for example, is easily achieved even for very fast stimuli, as only moving objects cause brightness changes. However, cameras mounted on a moving robot are typically non-stationary and the same tracking problem becomes confounded by background clutter events due to the robot ego-motion. In this paper, we propose a method for segmenting the motion of an independently moving object for event-driven cameras. Our method detects and tracks corners in the event stream and learns the statistics of their motion as a function of the robot's joint velocities when no independently moving objects are present. During robot operation, independently moving objects are identified by discrepancies between the predicted corner velocities from ego-motion and the measured corner velocities. We validate the algorithm on data collected from the neuromorphic iCub robot. We achieve a precision of 90 both the head and the target.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2019

Event-Based Motion Segmentation by Motion Compensation

In contrast to traditional cameras, whose pixels have a common exposure ...
research
05/16/2022

PUCK: Parallel Surface and Convolution-kernel Tracking for Event-Based Cameras

Low latency and accuracy are fundamental requirements when vision is int...
research
03/10/2021

FAST-Dynamic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing

The development of aerial autonomy has enabled aerial robots to fly agil...
research
12/16/2022

Fast-moving object counting with an event camera

This paper proposes the use of an event camera as a component of a visio...
research
04/15/2020

Neuromorphic Eye-in-Hand Visual Servoing

Robotic vision plays a major role in factory automation to service robot...
research
11/05/2021

Event-based Motion Segmentation by Cascaded Two-Level Multi-Model Fitting

Among prerequisites for a synthetic agent to interact with dynamic scene...
research
02/27/2023

Fast Trajectory End-Point Prediction with Event Cameras for Reactive Robot Control

Prediction skills can be crucial for the success of tasks where robots h...

Please sign up or login with your details

Forgot password? Click here to reset