DCNN-GAN: Reconstructing Realistic Image from fMRI

01/13/2019
by   Yunfeng Lin, et al.
0

Visualizing the perceptual content by analyzing human functional magnetic resonance imaging (fMRI) has been an active research area. However, due to its high dimensionality, complex dimensional structure, and small number of samples available, reconstructing realistic images from fMRI remains challenging. Recently with the development of convolutional neural network (CNN) and generative adversarial network (GAN), mapping multi-voxel fMRI data to complex, realistic images has been made possible. In this paper, we propose a model, DCNN-GAN, by combining a reconstruction network and GAN. We utilize the CNN for hierarchical feature extraction and the DCNN-GAN to reconstruct more realistic images. Extensive experiments have been conducted, showing that our method outperforms previous works, regarding reconstruction quality and computational cost.

READ FULL TEXT

page 2

page 4

research
03/13/2020

BigGAN-based Bayesian reconstruction of natural images from human brain activity

In the visual decoding domain, visually reconstructing presented images ...
research
02/16/2021

MITNet: GAN Enhanced Magnetic Induction Tomography Based on Complex CNN

Magnetic induction tomography (MIT) is an efficient solution for long-te...
research
06/27/2019

Reconstructing Perceived Images from Brain Activity by Visually-guided Cognitive Representation and Adversarial Learning

Reconstructing perceived images based on brain signals measured with fun...
research
07/03/2022

Facial Image Reconstruction from Functional Magnetic Resonance Imaging via GAN Inversion with Improved Attribute Consistency

Neuroscience studies have revealed that the brain encodes visual content...
research
10/09/2018

Reconstructing Faces from fMRI Patterns using Deep Generative Neural Networks

While objects from different categories can be reliably decoded from fMR...
research
04/19/2018

Reconstruction of Simulation-Based Physical Field with Limited Samples by ReConNN

A variety of modeling techniques have been developed in the past decade ...
research
04/08/2019

Image-based reconstruction for strong-nonlinear transient problems by using an enhanced ReConNN

With the improvement of pattern recognition and feature extraction of th...

Please sign up or login with your details

Forgot password? Click here to reset