Mixture of Regression Experts in fMRI Encoding

11/26/2018
by   Subba Reddy Oota, et al.
0

fMRI semantic category understanding using linguistic encoding models attempt to learn a forward mapping that relates stimuli to the corresponding brain activation. Classical encoding models use linear multi-variate methods to predict the brain activation (all voxels) given the stimulus. However, these methods essentially assume multiple regions as one large uniform region or several independent regions, ignoring connections among them. In this paper, we present a mixture of experts-based model where a group of experts captures brain activity patterns related to particular regions of interest (ROI) and also show the discrimination across different experts. The model is trained word stimuli encoded as 25-dimensional feature vectors as input and the corresponding brain responses as output. Given a new word (25-dimensional feature vector), it predicts the entire brain activation as the linear combination of multiple experts brain activations. We argue that each expert learns a certain region of brain activations corresponding to its category of words, which solves the problem of identifying the regions with a simple encoding model. We showcase that proposed mixture of experts-based model indeed learns region-based experts to predict the brain activations with high spatial accuracy.

READ FULL TEXT

page 2

page 4

research
09/26/2019

ExpertoCoder: Capturing Divergent Brain Regions Using Mixture of Regression Experts

fMRI semantic category understanding using linguistic encoding models at...
research
06/13/2018

fMRI Semantic Category Decoding using Linguistic Encoding of Word Embeddings

The dispute of how the human brain represents conceptual knowledge has b...
research
08/22/2019

An encoding framework with brain inner state for natural image identification

Neural encoding and decoding, which aim to characterize the relationship...
research
07/26/2023

Retinotopy Inspired Brain Encoding Model and the All-for-One Training Recipe

Brain encoding models aim to predict brain voxel-wise responses to stimu...
research
03/03/2021

Deep Recurrent Encoder: A scalable end-to-end network to model brain signals

Understanding how the brain responds to sensory inputs is challenging: b...
research
02/21/2022

Same Cause; Different Effects in the Brain

To study information processing in the brain, neuroscientists manipulate...
research
04/04/2019

Robust Evaluation of Language-Brain Encoding Experiments

Language-brain encoding experiments evaluate the ability of language mod...

Please sign up or login with your details

Forgot password? Click here to reset