DeepAI
Log In Sign Up

Symbiotic Adversarial Learning for Attribute-based Person Search

07/19/2020
by   Yu-Tong Cao, et al.
6

Attribute-based person search is in significant demand for applications where no detected query images are available, such as identifying a criminal from witness. However, the task itself is quite challenging because there is a huge modality gap between images and physical descriptions of attributes. Often, there may also be a large number of unseen categories (attribute combinations). The current state-of-the-art methods either focus on learning better cross-modal embeddings by mining only seen data, or they explicitly use generative adversarial networks (GANs) to synthesize unseen features. The former tends to produce poor embeddings due to insufficient data, while the latter does not preserve intra-class compactness during generation. In this paper, we present a symbiotic adversarial learning framework, called SAL.Two GANs sit at the base of the framework in a symbiotic learning scheme: one synthesizes features of unseen classes/categories, while the other optimizes the embedding and performs the cross-modal alignment on the common embedding space .Specifically, two different types of generative adversarial networks learn collaboratively throughout the training process and the interactions between the two mutually benefit each other. Extensive evaluations show SAL's superiority over nine state-of-the-art methods with two challenging pedestrian benchmarks, PETA and Market-1501. The code is publicly available at: https://github.com/ycao5602/SAL .

READ FULL TEXT
10/14/2017

CM-GANs: Cross-modal Generative Adversarial Networks for Common Representation Learning

It is known that the inconsistent distribution and representation of dif...
08/10/2021

ASMR: Learning Attribute-Based Person Search with Adaptive Semantic Margin Regularizer

Attribute-based person search is the task of finding person images that ...
10/29/2018

Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning

We address the problem of segmenting 3D multi-modal medical images in sc...
05/03/2019

Learning Cross-Modal Embeddings with Adversarial Networks for Cooking Recipes and Food Images

Food computing is playing an increasingly important role in human daily ...
04/02/2018

SyncGAN: Synchronize the Latent Space of Cross-modal Generative Adversarial Networks

Generative adversarial network (GAN) has achieved impressive success on ...
08/15/2019

Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation

Inspired by the success of adversarial learning, we propose a new end-to...
09/18/2021

Memory Regulation and Alignment toward Generalizer RGB-Infrared Person

The domain shift, coming from unneglectable modality gap and non-overlap...

Code Repositories

SAL

Code for the paper "Symbiotic Adversarial Learning for Attribute-based Person Search", ECCV2020


view repo