ObjectNet Dataset: Reanalysis and Correction

04/04/2020
by   Ali Borji, et al.
9

Recently, Barbu et al introduced a dataset called ObjectNet which includes objects in daily life situations. They showed a dramatic performance drop of the state of the art object recognition models on this dataset. Due to the importance and implications of their results regarding generalization ability of deep models, we take a second look at their findings. We highlight a major problem with their work which is applying object recognizers to the scenes containing multiple objects rather than isolated objects. The latter results in around 20-30 reported in the ObjectNet paper, we observe that around 10-15 performance loss can be recovered, without any test time data augmentation. In accordance with Barbu et al.'s conclusions, however, we also conclude that deep models suffer drastically on this dataset. Thus, we believe that ObjectNet remains a challenging dataset for testing the generalization power of models beyond datasets on which they have been trained.

READ FULL TEXT

page 8

page 9

page 17

page 19

page 22

page 23

page 25

page 29

research
03/08/2021

Contemplating real-world object classification

Deep object recognition models have been very successful over benchmark ...
research
10/07/2021

FOCUS: Familiar Objects in Common and Uncommon Settings

Standard training datasets for deep learning often contain objects in co...
research
06/24/2019

Mixup of Feature Maps in a Hidden Layer for Training of Convolutional Neural Network

The deep Convolutional Neural Network (CNN) became very popular as a fun...
research
06/16/2022

A machine-generated catalogue of Charon's craters and implications for the Kuiper belt

In this paper we investigate Charon's craters size distribution using a ...
research
10/31/2021

PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation

While Out-of-distribution (OOD) detection has been well explored in comp...
research
03/19/2017

Multilevel Context Representation for Improving Object Recognition

In this work, we propose the combined usage of low- and high-level block...
research
04/26/2016

Are Face and Object Recognition Independent? A Neurocomputational Modeling Exploration

Are face and object recognition abilities independent? Although it is co...

Please sign up or login with your details

Forgot password? Click here to reset