A rotation-equivariant convolutional neural network model of primary visual cortex

09/27/2018
by   Alexander S. Ecker, et al.
6

Classical models describe primary visual cortex (V1) as a filter bank of orientation-selective linear-nonlinear (LN) or energy models, but these models fail to predict neural responses to natural stimuli accurately. Recent work shows that models based on convolutional neural networks (CNNs) lead to much more accurate predictions, but it remains unclear which features are extracted by V1 neurons beyond orientation selectivity and phase invariance. Here we work towards systematically studying V1 computations by categorizing neurons into groups that perform similar computations. We present a framework to identify common features independent of individual neurons' orientation selectivity by using a rotation-equivariant convolutional neural network, which automatically extracts every feature at multiple different orientations. We fit this model to responses of a population of 6000 neurons to natural images recorded in mouse primary visual cortex using two-photon imaging. We show that our rotation-equivariant network not only outperforms a regular CNN with the same number of feature maps, but also reveals a number of common features shared by many V1 neurons, which deviate from the typical textbook idea of V1 as a bank of Gabor filters. Our findings are a first step towards a powerful new tool to study the nonlinear computations in V1.

READ FULL TEXT
research
06/19/2017

Using deep learning to reveal the neural code for images in primary visual cortex

Primary visual cortex (V1) is the first stage of cortical image processi...
research
11/07/2017

Neural system identification for large populations separating "what" and "where"

Neuroscientists classify neurons into different types that perform simil...
research
12/16/2010

The Development of Dominance Stripes and Orientation Maps in a Self-Organising Visual Cortex Network (VICON)

A self-organising neural network is presented that is based on a rigorou...
research
06/12/2018

A Connectome Based Hexagonal Lattice Convolutional Network Model of the Drosophila Visual System

What can we learn from a connectome? We constructed a simplified model o...
research
01/03/2019

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

The visual system is hierarchically organized to process visual informat...
research
07/03/2019

Neuron ranking -- an informed way to condense convolutional neural networks architecture

Convolutional neural networks (CNNs) in recent years have made a dramati...
research
06/05/2018

Integrating Flexible Normalization into Mid-Level Representations of Deep Convolutional Neural Networks

Deep convolutional neural networks (CNNs) are becoming increasingly popu...

Please sign up or login with your details

Forgot password? Click here to reset