Instance-Aware Representation Learning and Association for Online Multi-Person Tracking

by   Hefeng Wu, et al.

Multi-Person Tracking (MPT) is often addressed within the detection-to-association paradigm. In such approaches, human detections are first extracted in every frame and person trajectories are then recovered by a procedure of data association (usually offline). However, their performances usually degenerate in presence of detection errors, mutual interactions and occlusions. In this paper, we present a deep learning based MPT approach that learns instance-aware representations of tracked persons and robustly online infers states of the tracked persons. Specifically, we design a multi-branch neural network (MBN), which predicts the classification confidences and locations of all targets by taking a batch of candidate regions as input. In our MBN architecture, each branch (instance-subnet) corresponds to an individual to be tracked and new branches can be dynamically created for handling newly appearing persons. Then based on the output of MBN, we construct a joint association matrix that represents meaningful states of tracked persons (e.g., being tracked or disappearing from the scene) and solve it by using the efficient Hungarian algorithm. Moreover, we allow the instance-subnets to be updated during tracking by online mining hard examples, accounting to person appearance variations over time. We comprehensively evaluate our framework on a popular MPT benchmark, demonstrating its excellent performance in comparison with recent online MPT methods.


page 2

page 3

page 9


POI: Multiple Object Tracking with High Performance Detection and Appearance Feature

Detection and learning based appearance feature play the central role in...

Deep Multi-Shot Network for modelling Appearance Similarity in Multi-Person Tracking applications

The automatization of Multi-Object Tracking becomes a demanding task in ...

Tracking by Prediction: A Deep Generative Model for Mutli-Person localisation and Tracking

Current multi-person localisation and tracking systems have an over reli...

Learning to Divide and Conquer for Online Multi-Target Tracking

Online Multiple Target Tracking (MTT) is often addressed within the trac...

Temporal Dynamic Appearance Modeling for Online Multi-Person Tracking

Robust online multi-person tracking requires the correct associations of...

Unifying Part Detection and Association for Recurrent Multi-Person Pose Estimation

We propose a joint model of human joint detection and association for 2D...

Automatic Adaptation of Person Association for Multiview Tracking in Group Activities

Reliable markerless motion tracking of multiple people participating in ...

Please sign up or login with your details

Forgot password? Click here to reset