Towards Low-Latency High-Bandwidth Control of Quadrotors using Event Cameras

11/11/2019
by   Rika Sugimoto Dimitrova, et al.
0

Event cameras are a promising candidate to enable high speed vision-based control due to their low sensor latency and high temporal resolution. However, purely event-based feedback has yet to be used in the control of drones. In this work, a first step towards implementing low-latency high-bandwidth control of quadrotors using event cameras is taken. In particular, this paper addresses the problem of one-dimensional attitude tracking using a dualcopter platform equipped with an event camera. The event-based state estimation consists of a modified Hough transform algorithm combined with a Kalman filter that outputs the roll angle and angular velocity of the dualcopter relative to a horizon marked by a black-and-white disk. The estimated state is processed by a proportional-derivative attitude control law that computes the rotor thrusts required to track the desired attitude. The proposed attitude tracking scheme shows promising results of event-camera-driven closed loop control: the state estimator performs with an update rate of 1 kHz and a latency determined to be 13.8 milliseconds, enabling attitude tracking at speeds of over 1600 degrees per second.

READ FULL TEXT
research
05/16/2022

PUCK: Parallel Surface and Convolution-kernel Tracking for Event-Based Cameras

Low latency and accuracy are fundamental requirements when vision is int...
research
05/24/2020

Vision-based control of a knuckle boom crane with online cable length estimation

A vision-based controller for a knuckle boom crane is presented. The con...
research
11/19/2018

Event-Based Features Selection and Tracking from Intertwined Estimation of Velocity and Generative Contours

This paper presents a new event-based method for detecting and tracking ...
research
05/02/2021

Feedback control of event cameras

Dynamic vision sensor event cameras produce a variable data rate stream ...
research
03/30/2023

Event-based Agile Object Catching with a Quadrupedal Robot

Quadrupedal robots are conquering various indoor and outdoor application...
research
01/25/2010

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

Automated tracking of animal movement allows analyses that would not oth...
research
09/09/2021

Continuous Event-Line Constraint for Closed-Form Velocity Initialization

Event cameras trigger events asynchronously and independently upon a suf...

Please sign up or login with your details

Forgot password? Click here to reset