Multi-camera Realtime 3D Tracking of Multiple Flying Animals

01/25/2010
by   Andrew D. Straw, et al.
0

Automated tracking of animal movement allows analyses that would not otherwise be possible by providing great quantities of data. The additional capability of tracking in realtime - with minimal latency - opens up the experimental possibility of manipulating sensory feedback, thus allowing detailed explorations of the neural basis for control of behavior. Here we describe a new system capable of tracking the position and body orientation of animals such as flies and birds. The system operates with less than 40 msec latency and can track multiple animals simultaneously. To achieve these results, a multi target tracking algorithm was developed based on the Extended Kalman Filter and the Nearest Neighbor Standard Filter data association algorithm. In one implementation, an eleven camera system is capable of tracking three flies simultaneously at 60 frames per second using a gigabit network of nine standard Intel Pentium 4 and Core 2 Duo computers. This manuscript presents the rationale and details of the algorithms employed and shows three implementations of the system. An experiment was performed using the tracking system to measure the effect of visual contrast on the flight speed of Drosophila melanogaster. At low contrasts, speed is more variable and faster on average than at high contrasts. Thus, the system is already a useful tool to study the neurobiology and behavior of freely flying animals. If combined with other techniques, such as `virtual reality'-type computer graphics or genetic manipulation, the tracking system would offer a powerful new way to investigate the biology of flying animals.

READ FULL TEXT

page 13

page 15

page 17

research
11/01/2020

Human Leg Motion Tracking by Fusing IMUs and RGB Camera Data Using Extended Kalman Filter

Human motion capture is frequently used to study rehabilitation and clin...
research
03/12/2022

VariabilityTrack:Multi-Object Tracking with Variable Speed Object Movement

Multi-object tracking (MOT) aims at estimating bounding boxes and identi...
research
11/11/2019

Towards Low-Latency High-Bandwidth Control of Quadrotors using Event Cameras

Event cameras are a promising candidate to enable high speed vision-base...
research
10/26/2020

Distributed Multi-Target Tracking in Camera Networks

Most recent works on multi-target tracking with multiple cameras focus o...
research
03/29/2018

Detection, localisation and tracking of pallets using machine learning techniques and 2D range data

The problem of autonomous transportation in industrial scenarios is rece...
research
05/12/2017

Towards a Principled Integration of Multi-Camera Re-Identification and Tracking through Optimal Bayes Filters

With the rise of end-to-end learning through deep learning, person detec...
research
06/08/2017

ToxTrac: a fast and robust software for tracking organisms

1. Behavioral analysis based on video recording is becoming increasingly...

Please sign up or login with your details

Forgot password? Click here to reset