Multi-person Pose Tracking using Sequential Monte Carlo with Probabilistic Neural Pose Predictor

09/16/2019
by   Masashi Okada, et al.
8

It is an effective strategy for the multi-person pose tracking task in videos to employ prediction and pose matching in a frame-by-frame manner. For this type of approach, uncertainty-aware modeling is essential because precise prediction is impossible. However, previous studies have relied on only a single prediction without incorporating uncertainty, which can cause critical tracking errors if the prediction is unreliable. This paper proposes an extension to this approach with Sequential Monte Carlo (SMC). This naturally reformulates the tracking scheme to handle multiple predictions (or hypotheses) of poses, thereby mitigating the negative effect of prediction errors. An important component of SMC, i.e., a proposal distribution, is designed as a probabilistic neural pose predictor, which can propose diverse and plausible hypotheses by incorporating epistemic uncertainty and heteroscedastic aleatoric uncertainty. In addition, a recurrent architecture is introduced to our neural modeling to utilize time-sequence information of poses to manage difficult situations, such as the frequent disappearance and reappearances of poses. Compared to existing baselines, the proposed method achieves a state-of-the-art MOTA score on the PoseTrack2018 validation dataset by reducing approximately 50

READ FULL TEXT

page 1

page 2

page 6

research
11/30/2020

Forecasting Characteristic 3D Poses of Human Actions

We propose the task of forecasting characteristic 3D poses: from a singl...
research
10/06/2021

Distribution Preserving Multiple Hypotheses Prediction for Uncertainty Modeling

Many supervised machine learning tasks, such as future state prediction ...
research
06/07/2021

Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking

Multi-person pose estimation and tracking serve as crucial steps for vid...
research
02/03/2018

Pose Flow: Efficient Online Pose Tracking

Multi-person articulated pose tracking in complex unconstrained videos i...
research
02/08/2023

A Unified Multi-view Multi-person Tracking Framework

Although there is a significant development in 3D Multi-view Multi-perso...
research
05/31/2020

Fully probabilistic quasar continua predictions near Lyman-α with conditional neural spline flows

Measurement of the red damping wing of neutral hydrogen in quasar spectr...
research
10/15/2019

Trajectorylet-Net: a novel framework for pose prediction based on trajectorylet descriptors

Pose prediction is an increasingly interesting topic in computer vision ...

Please sign up or login with your details

Forgot password? Click here to reset