ArtTrack: Articulated Multi-person Tracking in the Wild

12/05/2016
by   Eldar Insafutdinov, et al.
0

In this paper we propose an approach for articulated tracking of multiple people in unconstrained videos. Our starting point is a model that resembles existing architectures for single-frame pose estimation but is substantially faster. We achieve this in two ways: (1) by simplifying and sparsifying the body-part relationship graph and leveraging recent methods for faster inference, and (2) by offloading a substantial share of computation onto a feed-forward convolutional architecture that is able to detect and associate body joints of the same person even in clutter. We use this model to generate proposals for body joint locations and formulate articulated tracking as spatio-temporal grouping of such proposals. This allows to jointly solve the association problem for all people in the scene by propagating evidence from strong detections through time and enforcing constraints that each proposal can be assigned to one person only. We report results on a public MPII Human Pose benchmark and on a new MPII Video Pose dataset of image sequences with multiple people. We demonstrate that our model achieves state-of-the-art results while using only a fraction of time and is able to leverage temporal information to improve state-of-the-art for crowded scenes.

READ FULL TEXT

page 1

page 4

page 5

page 8

page 10

page 11

research
11/23/2016

PoseTrack: Joint Multi-Person Pose Estimation and Tracking

In this work, we introduce the challenging problem of joint multi-person...
research
03/01/2018

LCR-Net++: Multi-person 2D and 3D Pose Detection in Natural Images

We propose an end-to-end architecture for joint 2D and 3D human pose est...
research
11/21/2017

Efficient Multi-Person Pose Estimation with Provable Guarantees

Multi-person pose estimation (MPPE) in natural images is key to the mean...
research
12/08/2021

Tracking People by Predicting 3D Appearance, Location Pose

In this paper, we present an approach for tracking people in monocular v...
research
03/03/2021

OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association

Many image-based perception tasks can be formulated as detecting, associ...
research
10/27/2017

PoseTrack: A Benchmark for Human Pose Estimation and Tracking

Human poses and motions are important cues for analysis of videos with p...
research
11/29/2018

Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields

We present an online approach to efficiently and simultaneously detect a...

Please sign up or login with your details

Forgot password? Click here to reset