Linear Classification of Neural Manifolds with Correlated Variability

11/27/2022
by   Albert J. Wakhloo, et al.
0

Understanding how the statistical and geometric properties of neural activations relate to network performance is a key problem in theoretical neuroscience and deep learning. In this letter, we calculate how correlations between object representations affect the capacity, a measure of linear separability. We show that for spherical object manifolds, introducing correlations between centroids effectively pushes the spheres closer together, while introducing correlations between the spheres' axes effectively shrinks their radii, revealing a duality between neural correlations and geometry. We then show that our results can be used to accurately estimate the capacity with real neural data.

READ FULL TEXT

page 1

page 16

research
10/17/2017

Classification and Geometry of General Perceptual Manifolds

Perceptual manifolds arise when a neural population responds to an ensem...
research
12/06/2015

Linear Readout of Object Manifolds

Objects are represented in sensory systems by continuous manifolds due t...
research
08/17/2018

An elementary introduction to information geometry

We describe the fundamental differential-geometric structures of informa...
research
03/13/2021

Conceptual capacity and effective complexity of neural networks

We propose a complexity measure of a neural network mapping function bas...
research
12/31/2018

Two "correlation games" for a nonlinear network with Hebbian excitatory neurons and anti-Hebbian inhibitory neurons

A companion paper introduces a nonlinear network with Hebbian excitatory...
research
11/19/2022

Neural frames: A Tool for Studying the Tangent Bundles Underlying Image Datasets and How Deep Learning Models Process Them

The assumption that many forms of high-dimensional data, such as images,...
research
06/20/2020

Weakly-correlated synapses promote dimension reduction in deep neural networks

By controlling synaptic and neural correlations, deep learning has achie...

Please sign up or login with your details

Forgot password? Click here to reset