Brain-mediated Transfer Learning of Convolutional Neural Networks

05/24/2019
by   Satoshi Nishida, et al.
0

Human flexible cognition and behavior indicate that the human brain can effectively use its internal feature representations acquired through limited experiences for new experiences in different domains. This function is analogous to transfer learning (TL) in the field of machine learning. TL uses a well-trained feature space in a specific task domain to improve performance in new tasks with insufficient training data. TL with rich feature representations, such as features of convolutional neural networks (CNNs), shows high generalization ability across different task domains. However, such TL is still insufficient in making machine learning attain generalization ability comparable to that of the human brain. To address this, we introduce a method for TL mediated by human brains to improve the performance of TL especially on pattern recognition in which human high-level cognition is considered. Our method transforms feature representations of audiovisual inputs in CNNs into those in activation patterns of individual brains via their association learned ahead using measured brain responses. Then, to estimate labels reflecting human cognition and behavior induced by the audiovisual inputs, the transformed representations are used for TL. We demonstrate that our brain-mediated TL (BTL) shows higher performance in the label estimation than the standard TL. In addition, we illustrate that the estimations mediated by different brains vary from brain to brain, and the variability reflects the individual variability in perception. Thus, our BTL provides a framework to improve the generalization ability of machine-learning feature representations and enable machine learning to estimate human-like cognition and behavior, including individual variability.

READ FULL TEXT
research
04/26/2016

Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification

Learning generic and robust feature representations with data from multi...
research
06/14/2017

Teaching Compositionality to CNNs

Convolutional neural networks (CNNs) have shown great success in compute...
research
02/02/2021

Transfer Learning in Magnetic Resonance Brain Imaging: a Systematic Review

Transfer learning refers to machine learning techniques that focus on ac...
research
09/03/2021

Towards Learning Spatially Discriminative Feature Representations

The backbone of traditional CNN classifier is generally considered as a ...
research
03/16/2017

Using Human Brain Activity to Guide Machine Learning

Machine learning is a field of computer science that builds algorithms t...
research
04/20/2018

CactusNets: Layer Applicability as a Metric for Transfer Learning

Deep neural networks trained over large datasets learn features that are...

Please sign up or login with your details

Forgot password? Click here to reset