Why Do Deep Neural Networks Still Not Recognize These Images?: A Qualitative Analysis on Failure Cases of ImageNet Classification

09/11/2017
by   Han S. Lee, et al.
0

In a recent decade, ImageNet has become the most notable and powerful benchmark database in computer vision and machine learning community. As ImageNet has emerged as a representative benchmark for evaluating the performance of novel deep learning models, its evaluation tends to include only quantitative measures such as error rate, rather than qualitative analysis. Thus, there are few studies that analyze the failure cases of deep learning models in ImageNet, though there are numerous works analyzing the networks themselves and visualizing them. In this abstract, we qualitatively analyze the failure cases of ImageNet classification results from recent deep learning model, and categorize these cases according to the certain image patterns. Through this failure analysis, we believe that it can be discovered what the final challenges are in ImageNet database, which the current deep learning model is still vulnerable to.

READ FULL TEXT
research
09/12/2017

Can Deep Neural Networks Match the Related Objects?: A Survey on ImageNet-trained Classification Models

Deep neural networks (DNNs) have shown the state-of-the-art level of per...
research
08/29/2021

Attempt to Predict Failure Case Classification in a Failure Database by using Neural Network Models

With the recent progress of information technology, the use of networked...
research
09/13/2021

Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers

Microsatellite instability (MSI) is a tumor phenotype whose diagnosis la...
research
12/22/2019

Analyzing ImageNet with Spectral Relevance Analysis: Towards ImageNet un-Hans'ed

Today's machine learning models for computer vision are typically traine...
research
09/17/2019

AdaCompress: Adaptive Compression for Online Computer Vision Services

With the growth of computer vision based applications and services, an e...
research
05/09/2022

When does dough become a bagel? Analyzing the remaining mistakes on ImageNet

Image classification accuracy on the ImageNet dataset has been a baromet...
research
06/12/2020

Are we done with ImageNet?

Yes, and no. We ask whether recent progress on the ImageNet classificati...

Please sign up or login with your details

Forgot password? Click here to reset