mvHOTA: A multi-view higher order tracking accuracy metric to measure spatial and temporal associations in multi-point detection

06/19/2022
by   Lalith Sharan, et al.
0

Multi-object tracking (MOT) is a challenging task that involves detecting objects in the scene and tracking them across a sequence of frames. Evaluating this task is difficult due to temporal occlusions, and varying trajectories across a sequence of images. The main evaluation metric to benchmark MOT methods on datasets such as KITTI has recently become the higher order tracking accuracy (HOTA) metric, which is capable of providing a better description of the performance over metrics such as MOTA, DetA, and IDF1. Point detection and tracking is a closely related task, which could be regarded as a special case of object detection. However, there are differences in evaluating the detection task itself (point distances vs. bounding box overlap). When including the temporal dimension and multi-view scenarios, the evaluation task becomes even more complex. In this work, we propose a multi-view higher order tracking metric (mvHOTA) to determine the accuracy of multi-point (multi-instance and multi-class) detection, while taking into account temporal and spatial associations. mvHOTA can be interpreted as the geometric mean of the detection, association, and correspondence accuracies, thereby providing equal weighting to each of the factors. We demonstrate a use-case through a publicly available endoscopic point detection dataset from a previously organised medical challenge. Furthermore, we compare with other adjusted MOT metrics for this use-case, discuss the properties of mvHOTA, and show how the proposed correspondence accuracy and the Occlusion index facilitate analysis of methods with respect to handling of occlusions. The code will be made publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2020

HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking

Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. ...
research
10/19/2022

Multi-view Tracking Using Weakly Supervised Human Motion Prediction

Multi-view approaches to people-tracking have the potential to better ha...
research
04/17/2023

Leveraging Multi-view Data for Improved Detection Performance: An Industrial Use Case

Printed circuit boards (PCBs) are essential components of electronic dev...
research
05/17/2021

Multi-object Tracking with Tracked Object Bounding Box Association

The CenterTrack tracking algorithm achieves state-of-the-art tracking pe...
research
09/29/2022

DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment

Direct methods have shown excellent performance in the applications of v...
research
02/24/2021

4D Panoptic LiDAR Segmentation

Temporal semantic scene understanding is critical for self-driving cars ...
research
06/05/2023

Human Spine Motion Capture using Perforated Kinesiology Tape

In this work, we present a marker-based multi-view spine tracking method...

Please sign up or login with your details

Forgot password? Click here to reset