Pose estimator and tracker using temporal flow maps for limbs

05/23/2019
by   Jihye Hwang, et al.
3

For human pose estimation in videos, it is significant how to use temporal information between frames. In this paper, we propose temporal flow maps for limbs (TML) and a multi-stride method to estimate and track human poses. The proposed temporal flow maps are unit vectors describing the limbs' movements. We constructed a network to learn both spatial information and temporal information end-to-end. Spatial information such as joint heatmaps and part affinity fields is regressed in the spatial network part, and the TML is regressed in the temporal network part. We also propose a data augmentation method to learn various types of TML better. The proposed multi-stride method expands the data by randomly selecting two frames within a defined range. We demonstrate that the proposed method efficiently estimates and tracks human poses on the PoseTrack 2017 and 2018 datasets.

READ FULL TEXT

page 2

page 3

page 4

page 7

research
11/04/2020

Leveraging Temporal Joint Depths for Improving 3D Human Pose Estimation in Video

The effectiveness of the approaches to predict 3D poses from 2D poses es...
research
11/23/2017

Exploiting temporal information for 3D pose estimation

In this work, we address the problem of 3D human pose estimation from a ...
research
09/01/2020

LiftFormer: 3D Human Pose Estimation using attention models

Estimating the 3D position of human joints has become a widely researche...
research
05/11/2018

Joint Flow: Temporal Flow Fields for Multi Person Tracking

In this work we propose an online multi person pose tracker which works ...
research
06/09/2015

Flowing ConvNets for Human Pose Estimation in Videos

The objective of this work is human pose estimation in videos, where mul...
research
09/15/2021

Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos

Graph Convolution Network (GCN) has been successfully used for 3D human ...
research
03/01/2019

Integrating Temporal Information to Spatial Information in a Neural Circuit

In this paper, we consider a network of spiking neurons with a determini...

Please sign up or login with your details

Forgot password? Click here to reset