DeepAI AI Chat
Log In Sign Up

Net2Brain: A Toolbox to compare artificial vision models with human brain responses

08/20/2022
by   Domenic Bersch, et al.
IG Farben Haus
Freie Universität Berlin
0

We introduce Net2Brain, a graphical and command-line user interface toolbox for comparing the representational spaces of artificial deep neural networks (DNNs) and human brain recordings. While different toolboxes facilitate only single functionalities or only focus on a small subset of supervised image classification models, Net2Brain allows the extraction of activations of more than 600 DNNs trained to perform a diverse range of vision-related tasks (e.g semantic segmentation, depth estimation, action recognition, etc.), over both image and video datasets. The toolbox computes the representational dissimilarity matrices (RDMs) over those activations and compares them to brain recordings using representational similarity analysis (RSA), weighted RSA, both in specific ROIs and with searchlight search. In addition, it is possible to add a new data set of stimuli and brain recordings to the toolbox for evaluation. We demonstrate the functionality and advantages of Net2Brain with an example showcasing how it can be used to test hypotheses of cognitive computational neuroscience.

READ FULL TEXT

page 1

page 2

10/26/2019

Decoding Neural Responses in Mouse Visual Cortex through a Deep Neural Network

Finding a code to unravel the population of neural responses that leads ...
01/29/2021

Does injecting linguistic structure into language models lead to better alignment with brain recordings?

Neuroscientists evaluate deep neural networks for natural language proce...
01/20/2023

Self-Organization Towards 1/f Noise in Deep Neural Networks

Despite 1/f noise being ubiquitous in both natural and artificial system...
06/22/2022

Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activations

Artificial neural networks (ANNs), originally inspired by biological neu...
05/27/2019

Deep Neural Networks Abstract Like Humans

Deep neural networks (DNNs) have revolutionized AI due to their remarkab...
03/14/2022

Do DNNs trained on Natural Images acquire Gestalt Properties?

Under some circumstances, humans tend to perceive individual elements as...
10/17/2020

Understanding Information Processing in Human Brain by Interpreting Machine Learning Models

The thesis explores the role machine learning methods play in creating i...

Code Repositories