Joint Flow: Temporal Flow Fields for Multi Person Tracking

05/11/2018
by   Andreas Doering, et al.
0

In this work we propose an online multi person pose tracker which works on two consecutive frames I_t-1 and I_t. The general formulation of our temporal network allows to rely on any multi person pose estimation network as spatial network. From the spatial network we extract image features and pose features for both frames. These features compose as input for our temporal model that predicts Temporal Flow Fields (TFF). These TFF are vector fields which indicate the direction in which body joint is going to move from frame I_t-1 to frame I_t. This novel representation allows to formulate a similarity measure of detected joints. These similarities are used as binary potentials in an bipartite graph optimization problem in order to perform tracking of multiple poses. We show that these TFF can be learned by a relative small CNN network whilst achieving state-of-the-art multi person pose tracking results.

READ FULL TEXT

page 3

page 4

page 12

research
02/03/2018

Pose Flow: Efficient Online Pose Tracking

Multi-person articulated pose tracking in complex unconstrained videos i...
research
12/13/2018

Nrityantar: Pose oblivious Indian classical dance sequence classification system

In this paper, we attempt to advance the research work done in human act...
research
06/09/2023

A Dual-Source Attention Transformer for Multi-Person Pose Tracking

Multi-person pose tracking is an important element for many applications...
research
08/29/2023

3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking

Markerless methods for animal posture tracking have been developing rece...
research
03/21/2019

Multi-person Articulated Tracking with Spatial and Temporal Embeddings

We propose a unified framework for multi-person pose estimation and trac...
research
05/23/2019

Pose estimator and tracker using temporal flow maps for limbs

For human pose estimation in videos, it is significant how to use tempor...
research
03/03/2021

OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association

Many image-based perception tasks can be formulated as detecting, associ...

Please sign up or login with your details

Forgot password? Click here to reset