Deep adversarial neural decoding

05/19/2017
by   Yağmur Güçlütürk, et al.
0

Here, we present a novel approach to solve the problem of reconstructing perceived stimuli from brain responses by combining probabilistic inference with deep learning. Our approach first inverts the linear transformation from latent features to brain responses with maximum a posteriori estimation and then inverts the nonlinear transformation from perceived stimuli to latent features with adversarial training of convolutional neural networks. We test our approach with a functional magnetic resonance imaging experiment and show that it can generate state-of-the-art reconstructions of perceived faces from brain activations.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
05/27/2022

Multiscale Voxel Based Decoding For Enhanced Natural Image Reconstruction From Brain Activity

Reconstructing perceived images from human brain activity monitored by f...
research
07/03/2022

Facial Image Reconstruction from Functional Magnetic Resonance Imaging via GAN Inversion with Improved Attribute Consistency

Neuroscience studies have revealed that the brain encodes visual content...
research
10/12/2021

Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects

A popular approach to decompose the neural bases of language consists in...
research
07/28/2022

EEG2Mel: Reconstructing Sound from Brain Responses to Music

Information retrieval from brain responses to auditory and visual stimul...
research
04/25/2017

Sharing deep generative representation for perceived image reconstruction from human brain activity

Decoding human brain activities via functional magnetic resonance imagin...
research
02/25/2021

Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech

Our ability to comprehend speech remains, to date, unrivaled by deep lea...
research
04/11/2023

Program Comprehension Does Not Primarily Rely On the Language Centers of the Human Brain

Our goal is to identify brain regions involved in comprehending computer...

Please sign up or login with your details

Forgot password? Click here to reset