A Study and Comparison of Human and Deep Learning Recognition Performance Under Visual Distortions

05/06/2017
by   Samuel Dodge, et al.
0

Deep neural networks (DNNs) achieve excellent performance on standard classification tasks. However, under image quality distortions such as blur and noise, classification accuracy becomes poor. In this work, we compare the performance of DNNs with human subjects on distorted images. We show that, although DNNs perform better than or on par with humans on good quality images, DNN performance is still much lower than human performance on distorted images. We additionally find that there is little correlation in errors between DNNs and human subjects. This could be an indication that the internal representation of images are different between DNNs and the human visual system. These comparisons with human performance could be used to guide future development of more robust DNNs.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

research
08/27/2018

Generalisation in humans and deep neural networks

We compare the robustness of humans and current convolutional deep neura...
research
02/06/2022

Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignment

While Deep Neural Networks (DNNs) are deriving the major innovations in ...
research
03/14/2022

Do DNNs trained on Natural Images acquire Gestalt Properties?

Under some circumstances, humans tend to perceive individual elements as...
research
04/22/2020

CodNN – Robust Neural Networks From Coded Classification

Deep Neural Networks (DNNs) are a revolutionary force in the ongoing inf...
research
12/22/2018

Dissociable neural representations of adversarially perturbed images in deep neural networks and the human brain

Despite the remarkable similarities between deep neural networks (DNN) a...
research
10/12/2017

Can the early human visual system compete with Deep Neural Networks?

We study and compare the human visual system and state-of-the-art deep n...
research
08/29/2023

Classification robustness to common optical aberrations

Computer vision using deep neural networks (DNNs) has brought about semi...

Please sign up or login with your details

Forgot password? Click here to reset