Video Pose Track with Graph-Guided Sparse Motion Estimation

02/28/2023
by   Yalong Jiang, et al.
0

In this paper, we propose a novel framework for multi-person pose estimation and tracking under occlusions and motion blurs. Specifically, the consistency in graph structures from consecutive frames is improved by concentrating on visible body joints and estimating the motion vectors of sparse key-points surrounding visible joints. The proposed framework involves three components: (i) A Sparse Key-point Flow Estimating Module (SKFEM) for sampling key-points from around body joints and estimating the motion vectors of key-points which contribute to the refinement of body joint locations and fine-tuning of pose estimators; (ii) A Hierarchical Graph Distance Minimizing Module (HGMM) for evaluating the visibility scores of nodes from hierarchical graphs with the visibility score of a node determining the number of samples around that node; and (iii) The combination of multiple historical frames for matching identities. Graph matching with HGMM facilitates more accurate tracking even under partial occlusions. The proposed approach not only achieves state-of-the-art performance on the PoseTrack dataset but also contributes to significant improvements in human-related anomaly detection. Besides a higher accuracy, the proposed SKFEM also shows a much higher efficiency than dense optical flow estimation.

READ FULL TEXT

page 4

page 5

page 9

research
02/06/2020

AnimePose: Multi-person 3D pose estimation and animation

3D animation of humans in action is quite challenging as it involves usi...
research
11/17/2018

Explicit Pose Deformation Learning for Tracking Human Poses

We present a method for human pose tracking that learns explicitly about...
research
07/16/2019

Human Pose Estimation for Real-World Crowded Scenarios

Human pose estimation has recently made significant progress with the ad...
research
12/26/2017

Detect-and-Track: Efficient Pose Estimation in Videos

This paper addresses the problem of estimating and tracking human body k...
research
01/24/2021

Iterative Greedy Matching for 3D Human Pose Tracking from Multiple Views

In this work we propose an approach for estimating 3D human poses of mul...
research
11/13/2022

VGFlow: Visibility guided Flow Network for Human Reposing

The task of human reposing involves generating a realistic image of a pe...
research
06/09/2023

A Dual-Source Attention Transformer for Multi-Person Pose Tracking

Multi-person pose tracking is an important element for many applications...

Please sign up or login with your details

Forgot password? Click here to reset