Creativity Inspired Zero-Shot Learning

04/01/2019
by   Mohamed Elhoseiny, et al.
0

Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of zero-shot learning, we model the visual learning process of unseen categories with an inspiration from the psychology of human creativity for producing novel art. We relate ZSL to human creativity by observing that zero-shot learning is about recognizing the unseen and creativity is about creating a likable unseen. We introduce a learning signal inspired by creativity literature that explores the unseen space with hallucinated class-descriptions and encourages careful deviation of their visual feature generations from seen classes while allowing knowledge transfer from seen to unseen classes. Empirically, we show consistent improvement over the state of the art of several percents on the largest available benchmarks on the challenging task or generalized ZSL from a noisy text that we focus on, using the CUB and NABirds datasets. We also show the advantage of our approach on Attribute-based ZSL on three additional datasets (AwA2, aPY, and SUN).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/30/2021

Zero-shot Learning with Class Description Regularization

The purpose of generative Zero-shot learning (ZSL) is to learning from s...
research
12/04/2017

Imagine it for me: Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts

Most existing zero-shot learning methods consider the problem as a visua...
research
09/08/2019

Meta-Transfer Networks for Zero-Shot Learning

Zero-Shot Learning (ZSL) aims at recognizing unseen categories using som...
research
01/16/2013

Zero-Shot Learning Through Cross-Modal Transfer

This work introduces a model that can recognize objects in images even i...
research
08/23/2017

Generating Visual Representations for Zero-Shot Classification

This paper addresses the task of learning an image clas-sifier when some...
research
09/15/2014

Zero Shot Recognition with Unreliable Attributes

In principle, zero-shot learning makes it possible to train a recognitio...
research
03/19/2017

Zero-Shot Learning by Generating Pseudo Feature Representations

Zero-shot learning (ZSL) is a challenging task aiming at recognizing nov...

Please sign up or login with your details

Forgot password? Click here to reset