Ultra-fast image categorization in vivo and in silico

05/07/2022
by   Jean-Nicolas Jérémie, et al.
11

Humans are able to robustly categorize images and can, for instance, detect the presence of an animal in a briefly flashed image in as little as 120 ms. Initially inspired by neuroscience, deep-learning algorithms literally bloomed up in the last decade such that the accuracy of machines is at present superior to humans for visual recognition tasks. However, these artificial networks are usually trained and evaluated on very specific tasks, for instance on the 1000 separate categories of ImageNet. In that regard, biological visual systems are more flexible and efficient compared to artificial systems on generic ecological tasks. In order to deepen this comparison, we re-trained the standard VGG Convolutional Neural Network (CNN) on two independent tasks which are ecologically relevant for humans: one task defined as detecting the presence of an animal and the other as detecting the presence of an artifact. We show that retraining the network achieves human-like performance level which is reported in psychophysical tasks. We also compare the accuracy of the detection on an image-by-image basis. This showed in particular that the two models perform better when combining their outputs. Indeed, animals (e.g. lions) tend to be less present in photographs containing artifacts (e.g. buildings). These re-trained models could reproduce some unexpected behavioral observations from humans psychophysics such as the robustness to rotations (e.g. upside-down or slanted image) or to a grayscale transformation.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
05/09/2022

Robustness of Humans and Machines on Object Recognition with Extreme Image Transformations

Recent neural network architectures have claimed to explain data from th...
research
01/01/2019

Training with the Invisibles: Obfuscating Images to Share Safely for Learning Visual Recognition Models

High-performance visual recognition systems generally require a large co...
research
05/15/2021

Are Convolutional Neural Networks or Transformers more like human vision?

Modern machine learning models for computer vision exceed humans in accu...
research
07/25/2023

Do humans and Convolutional Neural Networks attend to similar areas during scene classification: Effects of task and image type

Deep Learning models like Convolutional Neural Networks (CNN) are powerf...
research
06/14/2020

Emergent Properties of Foveated Perceptual Systems

We introduce foveated perceptual systems, inspired by human biological s...
research
09/11/2018

Taking a machine's perspective: Humans can decipher adversarial images

How similar is the human mind to the sophisticated machine-learning syst...

Please sign up or login with your details

Forgot password? Click here to reset