Joint COCO and Mapillary Workshop at ICCV 2019 Keypoint Detection Challenge Track Technical Report: Distribution-Aware Coordinate Representation for Human Pose Estimation

03/13/2020
by   Hanbin Dai, et al.
4

In this paper, we focus on the coordinate representation in human pose estimation. While being the standard choice, heatmap based representation has not been systematically investigated. We found that the process of coordinate decoding (i.e. transforming the predicted heatmaps to the coordinates) is surprisingly significant for human pose estimation performance, which nevertheless was not recognised before. In light of the discovered importance, we further probe the design limitations of the standard coordinate decoding method and propose a principled distribution-aware decoding method. Meanwhile, we improve the standard coordinate encoding process (i.e. transforming ground-truth coordinates to heatmaps) by generating accurate heatmap distributions for unbiased model training. Taking them together, we formulate a novel Distribution-Aware coordinate Representation for Keypoint (DARK) method. Serving as a model-agnostic plug-in, DARK significantly improves the performance of a variety of state-of-the-art human pose estimation models. Extensive experiments show that DARK yields the best results on COCO keypoint detection challenge, validating the usefulness and effectiveness of our novel coordinate representation idea. The project page containing more details is at https://ilovepose.github.io/coco

READ FULL TEXT
research
10/14/2019

Distribution-Aware Coordinate Representation for Human Pose Estimation

While being the de facto standard coordinate representation in human pos...
research
10/19/2021

On Coordinate Decoding for Keypoint Estimation Tasks

A series of 2D (and 3D) keypoint estimation tasks are built upon heatmap...
research
07/12/2020

Train Your Data Processor: Distribution-Aware and Error-Compensation Coordinate Decoding for Human Pose Estimation

Recently, the leading performance of human pose estimation is dominated ...
research
11/18/2019

The Devil is in the Details: Delving into Unbiased Data Processing for Human Pose Estimation

Recently, the leading performance of human pose estimation is dominated ...
research
12/30/2020

Rethinking the Heatmap Regression for Bottom-up Human Pose Estimation

Heatmap regression has become the most prevalent choice for nowadays hum...
research
09/11/2019

DNANet: De-Normalized Attention Based Multi-Resolution Network for Human Pose Estimation

Recently, multi-resolution networks (such as Hourglass, CPN, HRNet, etc....
research
07/06/2022

Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation

We observe that human poses exhibit strong group-wise structural correla...

Please sign up or login with your details

Forgot password? Click here to reset