Unified Structured Learning for Simultaneous Human Pose Estimation and Garment Attribute Classification

04/19/2014
by   Jie Shen, et al.
0

In this paper, we utilize structured learning to simultaneously address two intertwined problems: human pose estimation (HPE) and garment attribute classification (GAC), which are valuable for a variety of computer vision and multimedia applications. Unlike previous works that usually handle the two problems separately, our approach aims to produce a jointly optimal estimation for both HPE and GAC via a unified inference procedure. To this end, we adopt a preprocessing step to detect potential human parts from each image (i.e., a set of "candidates") that allows us to have a manageable input space. In this way, the simultaneous inference of HPE and GAC is converted to a structured learning problem, where the inputs are the collections of candidate ensembles, the outputs are the joint labels of human parts and garment attributes, and the joint feature representation involves various cues such as pose-specific features, garment-specific features, and cross-task features that encode correlations between human parts and garment attributes. Furthermore, we explore the "strong edge" evidence around the potential human parts so as to derive more powerful representations for oriented human parts. Such evidences can be seamlessly integrated into our structured learning model as a kind of energy function, and the learning process could be performed by standard structured Support Vector Machines (SVM) algorithm. However, the joint structure of the two problems is a cyclic graph, which hinders efficient inference. To resolve this issue, we compute instead approximate optima by using an iterative procedure, where in each iteration the variables of one problem are fixed. In this way, satisfactory solutions can be efficiently computed by dynamic programming. Experimental results on two benchmark datasets show the state-of-the-art performance of our approach.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 9

page 10

research
11/16/2014

A Latent Clothing Attribute Approach for Human Pose Estimation

As a fundamental technique that concerns several vision tasks such as im...
research
05/10/2013

Beyond Physical Connections: Tree Models in Human Pose Estimation

Simple tree models for articulated objects prevails in the last decade. ...
research
08/13/2016

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Human pose estimation (i.e., locating the body parts / joints of a perso...
research
08/22/2023

PoseGraphNet++: Enriching 3D Human Pose with Orientation Estimation

Existing kinematic skeleton-based 3D human pose estimation methods only ...
research
11/17/2016

Learning to Fuse 2D and 3D Image Cues for Monocular Body Pose Estimation

Most recent approaches to monocular 3D human pose estimation rely on Dee...
research
07/29/2023

Iterative Graph Filtering Network for 3D Human Pose Estimation

Graph convolutional networks (GCNs) have proven to be an effective appro...
research
03/30/2016

Structured Feature Learning for Pose Estimation

In this paper, we propose a structured feature learning framework to rea...

Please sign up or login with your details

Forgot password? Click here to reset