Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression

04/06/2021
by   Zigang Geng, et al.
0

In this paper, we are interested in the bottom-up paradigm of estimating human poses from an image. We study the dense keypoint regression framework that is previously inferior to the keypoint detection and grouping framework. Our motivation is that regressing keypoint positions accurately needs to learn representations that focus on the keypoint regions. We present a simple yet effective approach, named disentangled keypoint regression (DEKR). We adopt adaptive convolutions through pixel-wise spatial transformer to activate the pixels in the keypoint regions and accordingly learn representations from them. We use a multi-branch structure for separate regression: each branch learns a representation with dedicated adaptive convolutions and regresses one keypoint. The resulting disentangled representations are able to attend to the keypoint regions, respectively, and thus the keypoint regression is spatially more accurate. We empirically show that the proposed direct regression method outperforms keypoint detection and grouping methods and achieves superior bottom-up pose estimation results on two benchmark datasets, COCO and CrowdPose. The code and models are available at https://github.com/HRNet/DEKR.

READ FULL TEXT

page 1

page 2

page 5

research
06/28/2020

Bottom-Up Human Pose Estimation by Ranking Heatmap-Guided Adaptive Keypoint Estimates

The typical bottom-up human pose estimation framework includes two stage...
research
06/08/2021

HPRNet: Hierarchical Point Regression for Whole-Body Human Pose Estimation

In this paper, we present a new bottom-up one-stage method for whole-bod...
research
10/23/2020

Efficient grouping for keypoint detection

The success of deep neural networks in the traditional keypoint detectio...
research
04/06/2021

Learning Spatial Context with Graph Neural Network for Multi-Person Pose Grouping

Bottom-up approaches for image-based multi-person pose estimation consis...
research
02/03/2020

Towards High Performance Human Keypoint Detection

Human keypoint detection from a single image is very challenging due to ...
research
11/05/2020

Can Human Sex Be Learned Using Only 2D Body Keypoint Estimations?

In this paper, we analyze human male and female sex recognition problem ...
research
04/06/2017

A Convolution Tree with Deconvolution Branches: Exploiting Geometric Relationships for Single Shot Keypoint Detection

Recently, Deep Convolution Networks (DCNNs) have been applied to the tas...

Please sign up or login with your details

Forgot password? Click here to reset