Using deep learning to reveal the neural code for images in primary visual cortex

06/19/2017
by   William F. Kindel, et al.
0

Primary visual cortex (V1) is the first stage of cortical image processing, and a major effort in systems neuroscience is devoted to understanding how it encodes information about visual stimuli. Within V1, many neurons respond selectively to edges of a given preferred orientation: these are known as simple or complex cells, and they are well-studied. Other neurons respond to localized center-surround image features. Still others respond selectively to certain image stimuli, but the specific features that excite them are unknown. Moreover, even for the simple and complex cells-- the best-understood V1 neurons-- it is challenging to predict how they will respond to natural image stimuli. Thus, there are important gaps in our understanding of how V1 encodes images. To fill this gap, we train deep convolutional neural networks to predict the firing rates of V1 neurons in response to natural image stimuli, and find that 15 predictability. For these well predicted neurons, we invert the predictor network to identify the image features (receptive fields) that cause the V1 neurons to spike. In addition to those with previously-characterized receptive fields (Gabor wavelet and center-surround), we identify neurons that respond predictably to higher-level textural image features that are not localized to any particular region of the image.

READ FULL TEXT
research
09/27/2018

A rotation-equivariant convolutional neural network model of primary visual cortex

Classical models describe primary visual cortex (V1) as a filter bank of...
research
01/03/2019

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

The visual system is hierarchically organized to process visual informat...
research
06/13/2021

On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classification

Robustness to variations in lighting conditions is a key objective for a...
research
05/26/2022

Emergent organization of receptive fields in networks of excitatory and inhibitory neurons

Local patterns of excitation and inhibition that can generate neural wav...
research
12/04/2015

Neuron's Eye View: Inferring Features of Complex Stimuli from Neural Responses

Experiments that study neural encoding of stimuli at the level of indivi...
research
06/11/2020

A new inference approach for training shallow and deep generalized linear models of noisy interacting neurons

Generalized linear models are one of the most efficient paradigms for pr...

Please sign up or login with your details

Forgot password? Click here to reset