Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning

07/12/2019
by   Jian Ni, et al.
0

Generalized zero-shot learning (GZSL) is a challenging class of vision and knowledge transfer problems in which both seen and unseen classes appear during testing. Existing GZSL approaches either suffer from semantic loss and discard discriminative information at the embedding stage, or cannot guarantee the visual-semantic interactions. To address these limitations, we propose the Dual Adversarial Semantics-Consistent Network (DASCN), which learns primal and dual Generative Adversarial Networks (GANs) in a unified framework for GZSL. In particular, the primal GAN learns to synthesize inter-class discriminative and semantics-preserving visual features from both the semantic representations of seen/unseen classes and the ones reconstructed by the dual GAN. The dual GAN enforces the synthetic visual features to represent prior semantic knowledge well via semantics-consistent adversarial learning. To the best of our knowledge, this is the first work that employs a novel dual-GAN mechanism for GZSL. Extensive experiments show that our approach achieves significant improvements over the state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/01/2018

Multi-modal Cycle-consistent Generalized Zero-Shot Learning

In generalized zero shot learning (GZSL), the set of classes are split i...
research
04/07/2020

Generative Adversarial Zero-shot Learning via Knowledge Graphs

Zero-shot learning (ZSL) is to handle the prediction of those unseen cla...
research
11/12/2018

Generative Dual Adversarial Network for Generalized Zero-shot Learning

This paper studies the problem of generalized zero-shot learning which r...
research
09/21/2019

CANZSL: Cycle-Consistent Adversarial Networks for Zero-Shot Learning from Natural Language

Existing methods using generative adversarial approaches for Zero-Shot L...
research
12/05/2017

Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Network

We propose a novel framework called Semantics-Preserving Adversarial Emb...
research
06/16/2021

Disentangling Semantic-to-visual Confusion for Zero-shot Learning

Using generative models to synthesize visual features from semantic dist...
research
04/10/2017

Semantically Consistent Regularization for Zero-Shot Recognition

The role of semantics in zero-shot learning is considered. The effective...

Please sign up or login with your details

Forgot password? Click here to reset