End-to-end Recurrent Multi-Object Tracking and Trajectory Prediction with Relational Reasoning

07/12/2019
by   Fabian B. Fuchs, et al.
1

The majority of contemporary object-tracking approaches used in autonomous vehicles do not model interactions between objects. This contrasts with the fact that objects' paths are not independent: a cyclist might abruptly deviate from a previously planned trajectory in order to avoid colliding with a car. Building upon HART, a neural, class-agnostic single-object tracker, we introduce a multi-object tracking method MOHART capable of relational reasoning. Importantly, the entire system, including the understanding of interactions and relations between objects, is class-agnostic and learned simultaneously in an end-to-end fashion. We find that the addition of relational-reasoning capabilities to HART leads to consistent performance gains in tracking as well as future trajectory prediction on several real-world datasets (MOTChallenge, UA-DETRAC, and Stanford Drone dataset), particularly in the presence of ego-motion, occlusions, crowded scenes, and faulty sensor inputs. Finally, based on controlled simulations, we propose that a comparison of MOHART and HART may be used as a novel way to measure the degree to which the objects in a video depend upon each other as they move together through time.

READ FULL TEXT
research
03/15/2023

Real-time Multi-Object Tracking Based on Bi-directional Matching

In recent years, anchor-free object detection models combined with match...
research
10/26/2022

End-to-end Tracking with a Multi-query Transformer

Multiple-object tracking (MOT) is a challenging task that requires simul...
research
02/26/2019

Semantic Relational Object Tracking

This paper addresses the topic of semantic world modeling by conjoining ...
research
03/26/2021

Learning to Track with Object Permanence

Tracking by detection, the dominant approach for online multi-object tra...
research
06/30/2021

MissFormer: (In-)attention-based handling of missing observations for trajectory filtering and prediction

In applications such as object tracking, time-series data inevitably car...
research
10/03/2022

Interpretable Deep Tracking

Imagine experiencing a crash as the passenger of an autonomous vehicle. ...
research
09/09/2023

DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions

Multiple object tracking (MOT) tends to become more challenging when sev...

Please sign up or login with your details

Forgot password? Click here to reset