PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimation

08/16/2022
by   Wentao Jiang, et al.
0

Human pose estimation aims to accurately estimate a wide variety of human poses. However, existing datasets often follow a long-tailed distribution that unusual poses only occupy a small portion, which further leads to the lack of diversity of rare poses. These issues result in the inferior generalization ability of current pose estimators. In this paper, we present a simple yet effective data augmentation method, termed Pose Transformation (PoseTrans), to alleviate the aforementioned problems. Specifically, we propose Pose Transformation Module (PTM) to create new training samples that have diverse poses and adopt a pose discriminator to ensure the plausibility of the augmented poses. Besides, we propose Pose Clustering Module (PCM) to measure the pose rarity and select the "rarest" poses to help balance the long-tailed distribution. Extensive experiments on three benchmark datasets demonstrate the effectiveness of our method, especially on rare poses. Also, our method is efficient and simple to implement, which can be easily integrated into the training pipeline of existing pose estimation models.

READ FULL TEXT
research
07/07/2022

PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learning

3D pose estimation has recently gained substantial interests in computer...
research
07/18/2020

SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approach

Human poses that are rare or unseen in a training set are challenging fo...
research
03/29/2023

Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation

When applying a pre-trained 2D-to-3D human pose lifting model to a targe...
research
12/29/2020

Chasing the Tail in Monocular 3D Human Reconstruction with Prototype Memory

Deep neural networks have achieved great progress in single-image 3D hum...
research
06/14/2020

Cascaded deep monocular 3D human pose estimation with evolutionary training data

End-to-end deep representation learning has achieved remarkable accuracy...
research
07/19/2022

DH-AUG: DH Forward Kinematics Model Driven Augmentation for 3D Human Pose Estimation

Due to the lack of diversity of datasets, the generalization ability of ...
research
12/27/2021

SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videos

When analyzing human motion videos, the output jitters from existing pos...

Please sign up or login with your details

Forgot password? Click here to reset