DeepAI AI Chat
Log In Sign Up

On zero-shot recognition of generic objects

by   Tristan Hascoet, et al.
Kobe University

Many recent advances in computer vision are the result of a healthy competition among researchers on high quality, task-specific, benchmarks. After a decade of active research, zero-shot learning (ZSL) models accuracy on the Imagenet benchmark remains far too low to be considered for practical object recognition applications. In this paper, we argue that the main reason behind this apparent lack of progress is the poor quality of this benchmark. We highlight major structural flaws of the current benchmark and analyze different factors impacting the accuracy of ZSL models. We show that the actual classification accuracy of existing ZSL models is significantly higher than was previously thought as we account for these flaws. We then introduce the notion of structural bias specific to ZSL datasets. We discuss how the presence of this new form of bias allows for a trivial solution to the standard benchmark and conclude on the need for a new benchmark. We then detail the semi-automated construction of a new benchmark to address these flaws.


page 3

page 11

page 12

page 16

page 17

page 18

page 19

page 20


Mitigating the Hubness Problem for Zero-Shot Learning of 3D Objects

The development of advanced 3D sensors has enabled many objects to be ca...

Zero-Shot Learning - The Good, the Bad and the Ugly

Due to the importance of zero-shot learning, the number of proposed appr...

Recent Advances in Zero-shot Recognition

With the recent renaissance of deep convolution neural networks, encoura...

ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition

Object recognition has made great advances in the last decade, but predo...

ZSpeedL – Evaluating the Performance of Zero-Shot Learning Methods using Low-Power Devices

The recognition of unseen objects from a semantic representation or text...

A Deep Dive into Adversarial Robustness in Zero-Shot Learning

Machine learning (ML) systems have introduced significant advances in va...

Visual Ground Truth Construction as Faceted Classification

Recent work in Machine Learning and Computer Vision has provided evidenc...

Code Repositories


Generic Object ZSL Dataset (GOZ)

view repo