Bi-Semantic Reconstructing Generative Network for Zero-shot Learning

12/09/2019
by   Xu Shibing, et al.
0

Many recent methods of zero-shot learning (ZSL) attempt to utilize generative model to generate the unseen visual samples from semantic descriptions and random noise. Therefore, the ZSL problem becomes a traditional supervised classification problem. However, most of the existing methods based on the generative model only focus on the quality of synthesized samples at the training stage, and ignore the importance of the zero-shot recognition stage. In this paper, we consider both the above two points and propose a novel approach. Specially, we select the Generative Adversarial Network (GAN) as our generative model. In order to improve the quality of synthesized samples, considering the internal relation of the semantic description in the semantic space as well as the fact that the seen and unseen visual information belong to different domains, we propose a bi-semantic reconstructing (BSR) component which contain two different semantic reconstructing regressors to lead the training of GAN. Since the semantic descriptions are available during the training stage, to further improve the ability of classifier, we combine the visual samples and semantic descriptions to train a classifier. At the recognition stage, we naturally utilize the BSR component to transfer the visual features and semantic descriptions, and concatenate them for classification. Experimental results show that our method outperforms the state of the art on several ZSL benchmark datasets with significant improvements.

READ FULL TEXT
research
12/04/2017

Imagine it for me: Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts

Most existing zero-shot learning methods consider the problem as a visua...
research
03/19/2021

Paint by Word

We investigate the problem of zero-shot semantic image painting. Instead...
research
04/08/2019

Leveraging the Invariant Side of Generative Zero-Shot Learning

Conventional zero-shot learning (ZSL) methods generally learn an embeddi...
research
12/23/2021

Boosting Generative Zero-Shot Learning by Synthesizing Diverse Features with Attribute Augmentation

The recent advance in deep generative models outlines a promising perspe...
research
02/10/2022

Bias-Eliminated Semantic Refinement for Any-Shot Learning

When training samples are scarce, the semantic embedding technique, ie, ...
research
08/30/2018

Towards Effective Deep Embedding for Zero-Shot Learning

Zero-shot learning (ZSL) attempts to recognize visual samples of unseen ...
research
02/24/2022

Domain Disentangled Generative Adversarial Network for Zero-Shot Sketch-Based 3D Shape Retrieval

Sketch-based 3D shape retrieval is a challenging task due to the large d...

Please sign up or login with your details

Forgot password? Click here to reset