Addressing target shift in zero-shot learning using grouped adversarial learning

03/02/2020
by   Saneem Ahmed Chemmengath, et al.
0

In this paper, we present a new paradigm to zero-shot learning (ZSL) that is trained by utilizing additional information (such as attribute-class mapping) for specific set of unseen classes. We conjecture that such additional information about unseen classes is more readily available than unsupervised image sets. Further, on close examination of the underlying attribute predictors of popular ZSL algorithms, we find that they often leverage attribute correlations to make predictions. While attribute correlations that remain intact in the unseen classes (test) benefit the prediction of difficult attributes, change in correlations can have an adverse effect on ZSL performance. For example, detecting an attribute 'brown' may be the same as detecting 'fur' over an animals' image dataset captured in the tropics. However, such a model might fail on unseen images of Arctic animals. To address this effect, termed target-shift in ZSL, we utilize our proposed framework to design grouped adversarial learning. We introduce grouping of attributes to enable the model to continue to benefit from useful correlations, while restricting cross-group correlations that may be harmful for generalization. Our analysis shows that it is possible to not only constrain the model from leveraging unwanted correlations, but also adjust them to specific test setting using only the additional information (the already available attribute-class mapping). We show empirical results for zero-shot predictions on standard benchmark datasets, namely, aPY, AwA2, SUN and CUB datasets. We further introduce to the research community, a new experimental train-test split that maximizes target-shift to further study its effects.

READ FULL TEXT
research
06/07/2019

A Generative Framework for Zero-Shot Learning with Adversarial Domain Adaptation

In this paper, we present a domain adaptation based generative framework...
research
09/14/2020

Prior Knowledge about Attributes: Learning a More Effective Potential Space for Zero-Shot Recognition

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by ...
research
05/04/2017

Attributes2Classname: A discriminative model for attribute-based unsupervised zero-shot learning

We propose a novel approach for unsupervised zero-shot learning (ZSL) of...
research
11/19/2018

Beyond Attributes: Adversarial Erasing Embedding Network for Zero-shot Learning

In this paper, an adversarial erasing embedding network with the guidanc...
research
02/05/2018

Zero-Shot Kernel Learning

In this paper, we address an open problem of zero-shot learning. Its pri...
research
07/28/2020

Toward Zero-Shot Unsupervised Image-to-Image Translation

Recent studies have shown remarkable success in unsupervised image-to-im...
research
05/25/2022

Tight Lower Bounds on Worst-Case Guarantees for Zero-Shot Learning with Attributes

We develop a rigorous mathematical analysis of zero-shot learning with a...

Please sign up or login with your details

Forgot password? Click here to reset