Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective

09/13/2019
by   Kai Li, et al.
0

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from one feature space to the other. Despite being reasonable, previous approaches essentially discard the highly precious discriminative power of visual features in an implicit way, and thus produce undesirable results. We instead reformulate ZSL as a conditioned visual classification problem, i.e., classifying visual features based on the classifiers learned from the semantic descriptions. With this reformulation, we develop algorithms targeting various ZSL settings: For the conventional setting, we propose to train a deep neural network that directly generates visual feature classifiers from the semantic attributes with an episode-based training scheme; For the generalized setting, we concatenate the learned highly discriminative classifiers for seen classes and the generated classifiers for unseen classes to classify visual features of all classes; For the transductive setting, we exploit unlabeled data to effectively calibrate the classifier generator using a novel learning-without-forgetting self-training mechanism and guide the process by a robust generalized cross-entropy loss. Extensive experiments show that our proposed algorithms significantly outperform state-of-the-art methods by large margins on most benchmark datasets in all the ZSL settings.

READ FULL TEXT
research
03/17/2023

Exploiting Semantic Attributes for Transductive Zero-Shot Learning

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizin...
research
05/04/2017

From Zero-shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis

Robust object recognition systems usually rely on powerful feature extra...
research
07/27/2020

Rethinking Generative Zero-Shot Learning: An Ensemble Learning Perspective for Recognising Visual Patches

Zero-shot learning (ZSL) is commonly used to address the very pervasive ...
research
09/01/2020

Generalized Zero-Shot Learning via VAE-Conditioned Generative Flow

Generalized zero-shot learning (GZSL) aims to recognize both seen and un...
research
10/07/2020

Learning Clusterable Visual Features for Zero-Shot Recognition

In zero-shot learning (ZSL), conditional generators have been widely use...
research
03/17/2022

Semantic-diversity transfer network for generalized zero-shot learning via inner disagreement based OOD detector

Zero-shot learning (ZSL) aims to recognize objects from unseen classes, ...
research
08/23/2017

Generating Visual Representations for Zero-Shot Classification

This paper addresses the task of learning an image clas-sifier when some...

Please sign up or login with your details

Forgot password? Click here to reset