PUCK: Parallel Surface and Convolution-kernel Tracking for Event-Based Cameras

05/16/2022
by   Luna Gava, et al.
0

Low latency and accuracy are fundamental requirements when vision is integrated in robots for high-speed interaction with targets, since they affect system reliability and stability. In such a scenario, the choice of the sensor and algorithms is important for the entire control loop. The technology of event-cameras can guarantee fast visual sensing in dynamic environments, but requires a tracking algorithm that can keep up with the high data rate induced by the robot ego-motion while maintaining accuracy and robustness to distractors. In this paper, we introduce a novel tracking method that leverages the Exponential Reduced Ordinal Surface (EROS) data representation to decouple event-by-event processing and tracking computation. The latter is performed using convolution kernels to detect and follow a circular target moving on a plane. To benchmark state-of-the-art event-based tracking, we propose the task of tracking the air hockey puck sliding on a surface, with the future aim of controlling the iCub robot to reach the target precisely and on time. Experimental results demonstrate that our algorithm achieves the best compromise between low latency and tracking accuracy both when the robot is still and when moving.

READ FULL TEXT

page 1

page 2

page 5

research
06/27/2017

Independent Motion Detection with Event-driven Cameras

Unlike standard cameras that send intensity images at a constant frame r...
research
11/11/2019

Towards Low-Latency High-Bandwidth Control of Quadrotors using Event Cameras

Event cameras are a promising candidate to enable high speed vision-base...
research
04/14/2023

EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks

Event-based sensors have recently drawn increasing interest in robotic p...
research
12/04/2019

Research on dynamic target detection and tracking system of hexapod robot

Dynamic target detection and target tracking are hot issues in the field...
research
10/12/2021

Event-Based high-speed low-latency fiducial marker tracking

Motion and dynamic environments, especially under challenging lighting c...
research
04/15/2020

Neuromorphic Eye-in-Hand Visual Servoing

Robotic vision plays a major role in factory automation to service robot...
research
02/27/2023

Fast Trajectory End-Point Prediction with Event Cameras for Reactive Robot Control

Prediction skills can be crucial for the success of tasks where robots h...

Please sign up or login with your details

Forgot password? Click here to reset