A Single Model Explains both Visual and Auditory Precortical Coding

02/26/2016
by   Honghao Shan, et al.
0

Precortical neural systems encode information collected by the senses, but the driving principles of the encoding used have remained a subject of debate. We present a model of retinal coding that is based on three constraints: information preservation, minimization of the neural wiring, and response equalization. The resulting novel version of sparse principal components analysis successfully captures a number of known characteristics of the retinal coding system, such as center-surround receptive fields, color opponency channels, and spatiotemporal responses that correspond to magnocellular and parvocellular pathways. Furthermore, when trained on auditory data, the same model learns receptive fields well fit by gammatone filters, commonly used to model precortical auditory coding. This suggests that efficient coding may be a unifying principle of precortical encoding across modalities.

READ FULL TEXT

page 7

page 8

page 10

page 12

research
12/20/2013

Efficient Visual Coding: From Retina To V2

The human visual system has a hierarchical structure consisting of layer...
research
11/08/2017

Revealing structure components of the retina by deep learning networks

Deep convolutional neural networks (CNNs) have demonstrated impressive p...
research
01/23/2021

Improved Training of Sparse Coding Variational Autoencoder via Weight Normalization

Learning a generative model of visual information with sparse and compos...
research
01/03/2019

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

The visual system is hierarchically organized to process visual informat...
research
05/29/2021

Foveal-pit inspired filtering of DVS spike response

In this paper, we present results of processing Dynamic Vision Sensor (D...
research
03/22/2021

Retinal-inspired Filtering for Dynamic Image Coding

This paper introduces a novel non-Separable sPAtioteMporal filter (non-S...
research
05/29/2019

A Method of Expressing the Magnitude of Merit of Being Able to Access a Side Information During Encoding

In general, if there is one device A with the same performance as many d...

Please sign up or login with your details

Forgot password? Click here to reset