Look into Person: Joint Body Parsing & Pose Estimation Network and A New Benchmark

04/05/2018
by   Xiaodan Liang, et al.
0

Human parsing and pose estimation have recently received considerable interest due to their substantial application potentials. However, the existing datasets have limited numbers of images and annotations and lack a variety of human appearances and coverage of challenging cases in unconstrained environments. In this paper, we introduce a new benchmark named "Look into Person (LIP)" that provides a significant advancement in terms of scalability, diversity, and difficulty, which are crucial for future developments in human-centric analysis. This comprehensive dataset contains over 50,000 elaborately annotated images with 19 semantic part labels and 16 body joints, which are captured from a broad range of viewpoints, occlusions, and background complexities. Using these rich annotations, we perform detailed analyses of the leading human parsing and pose estimation approaches, thereby obtaining insights into the successes and failures of these methods. To further explore and take advantage of the semantic correlation of these two tasks, we propose a novel joint human parsing and pose estimation network to explore efficient context modeling, which can simultaneously predict parsing and pose with extremely high quality. Furthermore, we simplify the network to solve human parsing by exploring a novel self-supervised structure-sensitive learning approach, which imposes human pose structures into the parsing results without resorting to extra supervision. The dataset, code and models are available at http://www.sysu-hcp.net/lip/.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 9

page 10

page 14

research
03/16/2017

Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing

Human parsing has recently attracted a lot of research interests due to ...
research
11/19/2019

FollowMeUp Sports: New Benchmark for 2D Human Keypoint Recognition

Human pose estimation has made significant advancement in recent years. ...
research
10/20/2022

JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking

Autonomous robotic systems operating in human environments must understa...
research
09/22/2018

Focus On What's Important: Self-Attention Model for Human Pose Estimation

Human pose estimation is an essential yet challenging task in computer v...
research
03/06/2023

UniHCP: A Unified Model for Human-Centric Perceptions

Human-centric perceptions (e.g., pose estimation, human parsing, pedestr...
research
05/04/2020

Correlating Edge, Pose with Parsing

According to existing studies, human body edge and pose are two benefici...
research
07/23/2019

xR-EgoPose: Egocentric 3D Human Pose from an HMD Camera

We present a new solution to egocentric 3D body pose estimation from mon...

Please sign up or login with your details

Forgot password? Click here to reset