Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognition

01/12/2016
by   Radoslaw M. Cichy, et al.
0

The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain.

READ FULL TEXT

page 3

page 5

page 7

page 8

research
05/25/2019

Training neural networks to have brain-like representations improves object recognition performance

The current state-of-the-art object recognition algorithms, deep convolu...
research
09/07/2021

Capturing the objects of vision with neural networks

Human visual perception carves a scene at its physical joints, decomposi...
research
06/27/2019

A shallow residual neural network to predict the visual cortex response

Understanding how the visual cortex of the human brain really works is s...
research
10/09/2021

Predicting decision-making in the future: Human versus Machine

Deep neural networks (DNNs) have become remarkably successful in data pr...
research
06/07/2018

Correspondence of Deep Neural Networks and the Brain for Visual Textures

Deep convolutional neural networks (CNNs) trained on objects and scenes ...
research
07/02/2014

Cortical spatio-temporal dimensionality reduction for visual grouping

The visual systems of many mammals, including humans, is able to integra...
research
02/25/2018

Sparse Network Estimation for Dynamical Spatio-temporal Array Models

Neural field models represent neuronal communication on a population lev...

Please sign up or login with your details

Forgot password? Click here to reset