Towards Effective Deep Embedding for Zero-Shot Learning

08/30/2018
by   Lei Zhang, et al.
0

Zero-shot learning (ZSL) attempts to recognize visual samples of unseen classes by virtue of the semantic descriptions of those classes. We posit that the key to ZSL is to exploit an effective embedding space where 1) visual samples can be tightly centred around the semantic descriptions of classes that they belong to; 2) visual samples of different classes are separated from each other with a large enough margin. Towards this goal, we present a simple but surprisingly effective deep embedding model. In our model, we separately embed visual samples and semantic descriptions into a latent intermediate space such that visual samples not only coincide with associated semantic descriptions, but also can be correctly discriminated by a trainable linear classifier. By doing this, visual samples can be tightly centred around associated semantic descriptions and more importantly, they can be separated from other semantic descriptions with a large margin, thus leading to a new state-of-the-art for ZSL. Furthermore, due to lacking training samples, the generalization capacity of the learned embedding space to unseen classes can be further improved. To this end, we propose to upgrade our model with a refining strategy which progressively calibrates the embedding space based upon some test samples chosen from unseen classes with high-confidence pseudo labels, and ultimately improves the generalization capacity greatly. Experimental results on five benchmarks demonstrate the great advantage of our model over current state-of-the-art competitors. For example, on AwA1 dataset, our model improves the recognition accuracy on unseen classes by 16.9 and even by 38.6

READ FULL TEXT
research
11/15/2016

Learning a Deep Embedding Model for Zero-Shot Learning

Zero-shot learning (ZSL) models rely on learning a joint embedding space...
research
06/30/2019

Visual Space Optimization for Zero-shot Learning

Zero-shot learning, which aims to recognize new categories that are not ...
research
07/10/2023

Learning Large Margin Sparse Embeddings for Open Set Medical Diagnosis

Fueled by deep learning, computer-aided diagnosis achieves huge advances...
research
07/07/2016

Zero-Shot Visual Recognition via Bidirectional Latent Embedding

Zero-shot learning for visual recognition, e.g., object and action recog...
research
12/09/2019

Bi-Semantic Reconstructing Generative Network for Zero-shot Learning

Many recent methods of zero-shot learning (ZSL) attempt to utilize gener...
research
06/01/2015

Predicting Deep Zero-Shot Convolutional Neural Networks using Textual Descriptions

One of the main challenges in Zero-Shot Learning of visual categories is...
research
05/11/2023

Deep Visual-Genetic Biometrics for Taxonomic Classification of Rare Species

Visual as well as genetic biometrics are routinely employed to identify ...

Please sign up or login with your details

Forgot password? Click here to reset