Deep Reinforcement Learning Models Predict Visual Responses in the Brain: A Preliminary Result

06/18/2021
by   Maytus Piriyajitakonkij, et al.
10

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered in the existing visual processing models. From the ecological standpoint, humans learn to recognize objects by interacting with them, allowing better classification, specialization, and generalization. Here, we ask if computational models under the embodied learning framework can explain mechanisms underlying object recognition in the primate visual system better than the existing supervised models? To address this question, we use reinforcement learning to train neural network models to play a 3D computer game and we find that these reinforcement learning models achieve neural response prediction accuracy scores in the early visual areas (e.g., V1 and V2) in the levels that are comparable to those accomplished by the supervised neural network model. In contrast, the supervised neural network models yield better neural response predictions in the higher visual areas, compared to the reinforcement learning models. Our preliminary results suggest the future direction of visual neuroscience in which deep reinforcement learning should be included to fill the missing embodiment concept.

READ FULL TEXT
research
09/17/2018

Object-sensitive Deep Reinforcement Learning

Deep reinforcement learning has become popular over recent years, showin...
research
09/17/2018

Transparency and Explanation in Deep Reinforcement Learning Neural Networks

Autonomous AI systems will be entering human society in the near future ...
research
09/10/2018

Jointly Learning to See, Ask, and GuessWhat

We are interested in understanding how the ability to ground language in...
research
12/17/2015

Deep Active Object Recognition by Joint Label and Action Prediction

An active object recognition system has the advantage of being able to a...
research
10/20/2016

Utilization of Deep Reinforcement Learning for saccadic-based object visual search

The paper focuses on the problem of learning saccades enabling visual ob...
research
11/23/2018

Learning to attend in a brain-inspired deep neural network

Recent machine learning models have shown that including attention as a ...

Please sign up or login with your details

Forgot password? Click here to reset