BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Video

09/25/2022
by   Ali Athar, et al.
18

Multiple existing benchmarks involve tracking and segmenting objects in video e.g., Video Object Segmentation (VOS) and Multi-Object Tracking and Segmentation (MOTS), but there is little interaction between them due to the use of disparate benchmark datasets and metrics (e.g. J F, mAP, sMOTSA). As a result, published works usually target a particular benchmark, and are not easily comparable to each another. We believe that the development of generalized methods that can tackle multiple tasks requires greater cohesion among these research sub-communities. In this paper, we aim to facilitate this by proposing BURST, a dataset which contains thousands of diverse videos with high-quality object masks, and an associated benchmark with six tasks involving object tracking and segmentation in video. All tasks are evaluated using the same data and comparable metrics, which enables researchers to consider them in unison, and hence, more effectively pool knowledge from different methods across different tasks. Additionally, we demonstrate several baselines for all tasks and show that approaches for one task can be applied to another with a quantifiable and explainable performance difference. Dataset annotations and evaluation code is available at: https://github.com/Ali2500/BURST-benchmark.

READ FULL TEXT

page 1

page 5

page 15

research
02/10/2019

MOTS: Multi-Object Tracking and Segmentation

This paper extends the popular task of multi-object tracking to multi-ob...
research
02/11/2022

Tiny Object Tracking: A Large-scale Dataset and A Baseline

Tiny objects, frequently appearing in practical applications, have weak ...
research
05/11/2023

Segment and Track Anything

This report presents a framework called Segment And Track Anything (SAMT...
research
12/02/2021

PartImageNet: A Large, High-Quality Dataset of Parts

A part-based object understanding facilitates efficient compositional le...
research
03/10/2021

PatchNet – Short-range Template Matching for Efficient Video Processing

Object recognition is a fundamental problem in many video processing tas...
research
11/15/2021

D^2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos

Despite receiving significant attention from the research community, the...
research
03/12/2023

Universal Instance Perception as Object Discovery and Retrieval

All instance perception tasks aim at finding certain objects specified b...

Please sign up or login with your details

Forgot password? Click here to reset