On zero-shot recognition of generic objects

04/10/2019
by   Tristan Hascoet, et al.
28

Many recent advances in computer vision are the result of a healthy competition among researchers on high quality, task-specific, benchmarks. After a decade of active research, zero-shot learning (ZSL) models accuracy on the Imagenet benchmark remains far too low to be considered for practical object recognition applications. In this paper, we argue that the main reason behind this apparent lack of progress is the poor quality of this benchmark. We highlight major structural flaws of the current benchmark and analyze different factors impacting the accuracy of ZSL models. We show that the actual classification accuracy of existing ZSL models is significantly higher than was previously thought as we account for these flaws. We then introduce the notion of structural bias specific to ZSL datasets. We discuss how the presence of this new form of bias allows for a trivial solution to the standard benchmark and conclude on the need for a new benchmark. We then detail the semi-automated construction of a new benchmark to address these flaws.

READ FULL TEXT

page 3

page 11

page 12

page 16

page 17

page 18

page 19

page 20

research
07/15/2019

Mitigating the Hubness Problem for Zero-Shot Learning of 3D Objects

The development of advanced 3D sensors has enabled many objects to be ca...
research
06/10/2023

EventCLIP: Adapting CLIP for Event-based Object Recognition

Recent advances in 2D zero-shot and few-shot recognition often leverage ...
research
10/13/2017

Recent Advances in Zero-shot Recognition

With the recent renaissance of deep convolution neural networks, encoura...
research
04/08/2021

ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition

Object recognition has made great advances in the last decade, but predo...
research
10/09/2021

ZSpeedL – Evaluating the Performance of Zero-Shot Learning Methods using Low-Power Devices

The recognition of unseen objects from a semantic representation or text...
research
08/17/2020

A Deep Dive into Adversarial Robustness in Zero-Shot Learning

Machine learning (ML) systems have introduced significant advances in va...
research
05/22/2023

Zero-shot Multi-level Feature Transmission Policy Powered by Semantic Knowledge Base

Remote zero-shot object recognition, i.e., offloading zero-shot object r...

Please sign up or login with your details

Forgot password? Click here to reset