Same Cause; Different Effects in the Brain

02/21/2022
by   Mariya Toneva, et al.
12

To study information processing in the brain, neuroscientists manipulate experimental stimuli while recording participant brain activity. They can then use encoding models to find out which brain "zone" (e.g. which region of interest, volume pixel or electrophysiology sensor) is predicted from the stimulus properties. Given the assumptions underlying this setup, when stimulus properties are predictive of the activity in a zone, these properties are understood to cause activity in that zone. In recent years, researchers have used neural networks to construct representations that capture the diverse properties of complex stimuli, such as natural language or natural images. Encoding models built using these high-dimensional representations are often able to significantly predict the activity in large swathes of cortex, suggesting that the activity in all these brain zones is caused by stimulus properties captured in the representation. It is then natural to ask: "Is the activity in these different brain zones caused by the stimulus properties in the same way?" In neuroscientific terms, this corresponds to asking if these different zones process the stimulus properties in the same way. Here, we propose a new framework that enables researchers to ask if the properties of a stimulus affect two brain zones in the same way. We use simulated data and two real fMRI datasets with complex naturalistic stimuli to show that our framework enables us to make such inferences. Our inferences are strikingly consistent between the two datasets, indicating that the proposed framework is a promising new tool for neuroscientists to understand how information is processed in the brain.

READ FULL TEXT

page 11

page 27

page 29

page 35

page 36

page 37

page 38

page 39

research
05/03/2022

Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?

Several popular Transformer based language models have been found to be ...
research
05/13/2022

Embodiment Enables Non-Predictive Ways of Coping with Self-Caused Sensory Stimuli

Living systems process sensory data to facilitate adaptive behaviour. A ...
research
10/29/2019

Inducing brain-relevant bias in natural language processing models

Progress in natural language processing (NLP) models that estimate repre...
research
09/10/2020

Brain2Word: Decoding Brain Activity for Language Generation

Brain decoding, understood as the process of mapping brain activities to...
research
04/04/2019

Robust Evaluation of Language-Brain Encoding Experiments

Language-brain encoding experiments evaluate the ability of language mod...
research
08/22/2019

An encoding framework with brain inner state for natural image identification

Neural encoding and decoding, which aim to characterize the relationship...
research
11/26/2018

Mixture of Regression Experts in fMRI Encoding

fMRI semantic category understanding using linguistic encoding models at...

Please sign up or login with your details

Forgot password? Click here to reset