Two is a crowd: tracking relations in videos

08/11/2021
by   Artem Moskalev, et al.
2

Tracking multiple objects individually differs from tracking groups of related objects. When an object is a part of the group, its trajectory depends on the trajectories of the other group members. Most of the current state-of-the-art trackers follow the approach of tracking each object independently, with the mechanism to handle the overlapping trajectories where necessary. Such an approach does not take inter-object relations into account, which may cause unreliable tracking for the members of the groups, especially in crowded scenarios, where individual cues become unreliable due to occlusions. To overcome these limitations and to extend such trackers to crowded scenes, we propose a plug-in Relation Encoding Module (REM). REM encodes relations between tracked objects by running a message passing over a corresponding spatio-temporal graph, computing relation embeddings for the tracked objects. Our experiments on MOT17 and MOT20 demonstrate that the baseline tracker improves its results after a simple extension with REM. The proposed module allows for tracking severely or even fully occluded objects by utilizing relational cues.

READ FULL TEXT

page 1

page 2

page 7

page 9

page 13

page 15

research
02/02/2016

Simple Online and Realtime Tracking

This paper explores a pragmatic approach to multiple object tracking whe...
research
03/06/2022

Reinstating Dlib Correlation Human Trackers Under Occlusions in Human Detection based Tracking

Human tracking in video feeds has been a popular research area, which co...
research
11/19/2016

Semantic tracking: Single-target tracking with inter-supervised convolutional networks

This article presents a semantic tracker which simultaneously tracks a s...
research
03/26/2021

Learning to Track with Object Permanence

Tracking by detection, the dominant approach for online multi-object tra...
research
07/01/2020

Enhancing the Association in Multi-Object Tracking via Neighbor Graph

Most modern multi-object tracking (MOT) systems follow the tracking-by-d...
research
05/09/2019

Intra-frame Object Tracking by Deblatting

Objects moving at high speed along complex trajectories often appear in ...
research
09/16/2017

A Causal And-Or Graph Model for Visibility Fluent Reasoning in Human-Object Interactions

Tracking humans that are interacting with the other subjects or environm...

Please sign up or login with your details

Forgot password? Click here to reset