The Topology and Geometry of Neural Representations

09/20/2023
by   Baihan Lin, et al.
1

A central question for neuroscience is how to characterize brain representations of perceptual and cognitive content. An ideal characterization should distinguish different functional regions with robustness to noise and idiosyncrasies of individual brains that do not correspond to computational differences. Previous studies have characterized brain representations by their representational geometry, which is defined by the representational dissimilarity matrix (RDM), a summary statistic that abstracts from the roles of individual neurons (or responses channels) and characterizes the discriminability of stimuli. Here we explore a further step of abstraction: from the geometry to the topology of brain representations. We propose topological representational similarity analysis (tRSA), an extension of representational similarity analysis (RSA) that uses a family of geo-topological summary statistics that generalizes the RDM to characterize the topology while de-emphasizing the geometry. We evaluate this new family of statistics in terms of the sensitivity and specificity for model selection using both simulations and functional MRI (fMRI) data. In the simulations, the ground truth is a data-generating layer representation in a neural network model and the models are the same and other layers in different model instances (trained from different random seeds). In fMRI, the ground truth is a visual area and the models are the same and other areas measured in different subjects. Results show that topology-sensitive characterizations of population codes are robust to noise and interindividual variability and maintain excellent sensitivity to the unique representational signatures of different neural network layers and brain regions.

READ FULL TEXT

page 5

page 13

page 14

page 15

page 20

research
03/10/2022

Geometric and Topological Inference for Deep Representations of Complex Networks

Understanding the deep representations of complex networks is an importa...
research
11/25/2020

Topological Learning for Brain Networks

This paper proposes a novel topological learning framework that can inte...
research
09/04/2023

3D View Prediction Models of the Dorsal Visual Stream

Deep neural network representations align well with brain activity in th...
research
05/15/2021

NeuroGen: activation optimized image synthesis for discovery neuroscience

Functional MRI (fMRI) is a powerful technique that has allowed us to cha...
research
09/09/2018

Topological Brain Network Distances

Existing brain network distances are often based on matrix norms. The el...
research
05/22/2018

Constructing Compact Brain Connectomes for Individual Fingerprinting

Recent neuroimaging studies have shown that functional connectomes are u...
research
06/06/2023

Identifying Shared Decodable Concepts in the Human Brain Using Image-Language Foundation Models

We introduce a method that takes advantage of high-quality pretrained mu...

Please sign up or login with your details

Forgot password? Click here to reset