Tracking Different Ant Species: An Unsupervised Domain Adaptation Framework and a Dataset for Multi-object Tracking

01/25/2023
by   Chamath Abeysinghe, et al.
0

Tracking individuals is a vital part of many experiments conducted to understand collective behaviour. Ants are the paradigmatic model system for such experiments but their lack of individually distinguishing visual features and their high colony densities make it extremely difficult to perform reliable tracking automatically. Additionally, the wide diversity of their species' appearances makes a generalized approach even harder. In this paper, we propose a data-driven multi-object tracker that, for the first time, employs domain adaptation to achieve the required generalisation. This approach is built upon a joint-detection-and-tracking framework that is extended by a set of domain discriminator modules integrating an adversarial training strategy in addition to the tracking loss. In addition to this novel domain-adaptive tracking framework, we present a new dataset and a benchmark for the ant tracking problem. The dataset contains 57 video sequences with full trajectory annotation, including 30k frames captured from two different ant species moving on different background patterns. It comprises 33 and 24 sequences for source and target domains, respectively. We compare our proposed framework against other domain-adaptive and non-domain-adaptive multi-object tracking baselines using this dataset and show that incorporating domain adaptation at multiple levels of the tracking pipeline yields significant improvements. The code and the dataset are available at https://github.com/chamathabeysinghe/da-tracker.

READ FULL TEXT

page 5

page 7

page 12

research
03/20/2022

Unsupervised Domain Adaptation for Nighttime Aerial Tracking

Previous advances in object tracking mostly reported on favorable illumi...
research
06/15/2021

Domain Adaptive SiamRPN++ for Object Tracking in the Wild

Benefit from large-scale training data, recent advances in Siamese-based...
research
08/28/2020

PV-RCNN: The Top-Performing LiDAR-only Solutions for 3D Detection / 3D Tracking / Domain Adaptation of Waymo Open Dataset Challenges

In this technical report, we present the top-performing LiDAR-only solut...
research
02/21/2023

BrackishMOT: The Brackish Multi-Object Tracking Dataset

There exist no publicly available annotated underwater multi-object trac...
research
08/04/2015

Online Domain Adaptation for Multi-Object Tracking

Automatically detecting, labeling, and tracking objects in videos depend...
research
07/20/2022

MOTCOM: The Multi-Object Tracking Dataset Complexity Metric

There exists no comprehensive metric for describing the complexity of Mu...

Please sign up or login with your details

Forgot password? Click here to reset