Optimizing deep video representation to match brain activity

09/07/2018
by   Hugo Richard, et al.
2

The comparison of observed brain activity with the statistics generated by artificial intelligence systems is useful to probe brain functional organization under ecological conditions. Here we study fMRI activity in ten subjects watching color natural movies and compute deep representations of these movies with an architecture that relies on optical flow and image content. The association of activity in visual areas with the different layers of the deep architecture displays complexity-related contrasts across visual areas and reveals a striking foveal/peripheral dichotomy.

READ FULL TEXT

page 2

page 3

page 4

research
04/30/2023

Reconstructing seen images from human brain activity via guided stochastic search

Visual reconstruction algorithms are an interpretive tool that map brain...
research
10/16/2010

Wireless Sensor Network based Future of Telecom Applications

A system and method for enabling human beings to communicate by way of t...
research
09/04/2023

3D View Prediction Models of the Dorsal Visual Stream

Deep neural network representations align well with brain activity in th...
research
12/20/2013

Modeling correlations in spontaneous activity of visual cortex with centered Gaussian-binary deep Boltzmann machines

Spontaneous cortical activity -- the ongoing cortical activities in abse...
research
08/09/2021

Generating Music and Generative Art from Brain activity

Nowadays, technological advances have influenced all human activities, c...
research
01/11/2022

Where Is My Mind (looking at)? Predicting Visual Attention from Brain Activity

Visual attention estimation is an active field of research at the crossr...
research
06/01/2023

Second Sight: Using brain-optimized encoding models to align image distributions with human brain activity

Two recent developments have accelerated progress in image reconstructio...

Please sign up or login with your details

Forgot password? Click here to reset