Macro-Micro Adversarial Network for Human Parsing

07/22/2018
by   Yawei Luo, et al.
0

In human parsing, the pixel-wise classification loss has drawbacks in its low-level local inconsistency and high-level semantic inconsistency. The introduction of the adversarial network tackles the two problems using a single discriminator. However, the two types of parsing inconsistency are generated by distinct mechanisms, so it is difficult for a single discriminator to solve them both. To address the two kinds of inconsistencies, this paper proposes the Macro-Micro Adversarial Net (MMAN). It has two discriminators. One discriminator, Macro D, acts on the low-resolution label map and penalizes semantic inconsistency, e.g., misplaced body parts. The other discriminator, Micro D, focuses on multiple patches of the high-resolution label map to address the local inconsistency, e.g., blur and hole. Compared with traditional adversarial networks, MMAN not only enforces local and semantic consistency explicitly, but also avoids the poor convergence problem of adversarial networks when handling high resolution images. In our experiment, we validate that the two discriminators are complementary to each other in improving the human parsing accuracy. The proposed framework is capable of producing competitive parsing performance compared with the state-of-the-art methods, i.e., mIoU=46.81 relatively small dataset PPSS, our pre-trained model demonstrates impressive generalization ability. The code is publicly available at https://github.com/RoyalVane/MMAN.

READ FULL TEXT

page 2

page 4

page 12

page 13

research
09/20/2020

Renovating Parsing R-CNN for Accurate Multiple Human Parsing

Multiple human parsing aims to segment various human parts and associate...
research
04/18/2022

Dress Code: High-Resolution Multi-Category Virtual Try-On

Image-based virtual try-on strives to transfer the appearance of a cloth...
research
01/31/2020

C-DLinkNet: considering multi-level semantic features for human parsing

Human parsing is an essential branch of semantic segmentation, which is ...
research
12/29/2018

Brain MRI super-resolution using 3D generative adversarial networks

In this work we propose an adversarial learning approach to generate hig...
research
04/06/2023

Super-Resolving Face Image by Facial Parsing Information

Face super-resolution is a technology that transforms a low-resolution f...
research
08/06/2020

GL-GAN: Adaptive Global and Local Bilevel Optimization model of Image Generation

Although Generative Adversarial Networks have shown remarkable performan...
research
10/09/2017

MSC: A Dataset for Macro-Management in StarCraft II

Macro-management is an important problem in StarCraft, which has been st...

Please sign up or login with your details

Forgot password? Click here to reset