From Zero-shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis

05/04/2017
by   Yang Long, et al.
0

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable. In this paper, we propose a new Zero-shot learning (ZSL) framework that can synthesise visual features for unseen classes without acquiring real images. Using the proposed Unseen Visual Data Synthesis (UVDS) algorithm, semantic attributes are effectively utilised as an intermediate clue to synthesise unseen visual features at the training stage. Hereafter, ZSL recognition is converted into the conventional supervised problem, i.e. the synthesised visual features can be straightforwardly fed to typical classifiers such as SVM. On four benchmark datasets, we demonstrate the benefit of using synthesised unseen data. Extensive experimental results suggest that our proposed approach significantly improve the state-of-the-art results.

READ FULL TEXT

page 1

page 2

page 8

research
09/13/2019

Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective

Zero-shot learning (ZSL) aims to recognize instances of unseen classes s...
research
01/20/2021

Semantic Disentangling Generalized Zero-Shot Learning

Generalized Zero-Shot Learning (GZSL) aims to recognize images from both...
research
08/29/2020

Zero-Shot Learning from Adversarial Feature Residual to Compact Visual Feature

Recently, many zero-shot learning (ZSL) methods focused on learning disc...
research
04/26/2018

Visual Data Synthesis via GAN for Zero-Shot Video Classification

Zero-Shot Learning (ZSL) in video classification is a promising research...
research
10/09/2021

ZSpeedL – Evaluating the Performance of Zero-Shot Learning Methods using Low-Power Devices

The recognition of unseen objects from a semantic representation or text...
research
11/19/2018

Generalized Zero-Shot Recognition based on Visually Semantic Embedding

We propose a novel Generalized Zero-Shot learning (GZSL) method that is ...
research
05/28/2017

Vocabulary-informed Extreme Value Learning

The novel unseen classes can be formulated as the extreme values of know...

Please sign up or login with your details

Forgot password? Click here to reset