BHN: A Brain-like Heterogeneous Network

05/26/2020
by   Tao Liu, et al.
0

The human brain works in an unsupervised way, and more than one brain region is essential for lighting up intelligence. Inspired by this, we propose a brain-like heterogeneous network(BHN) which can cooperatively learn distributed representations, like the cortex, and a global contextual representation, like the medial temporal lobe(MTL). By optimizing a distributed, self-supervised and gradient-isolated contrastive loss function in a discriminative adversarial fashion, our model successfully learns to extract useful representations from video data. Methods developed in this work may help to solve some key problems in pursuit of human-level intelligence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2022

A unified theory of learning

Recently machine learning using neural networks (NN) has been developed,...
research
12/02/2021

Probabilistic Contrastive Loss for Self-Supervised Learning

This paper proposes a probabilistic contrastive loss function for self-s...
research
05/06/2020

Brain-like approaches to unsupervised learning of hidden representations – a comparative study

Unsupervised learning of hidden representations has been one of the most...
research
02/28/2023

BrainBERT: Self-supervised representation learning for intracranial recordings

We create a reusable Transformer, BrainBERT, for intracranial recordings...
research
06/01/2010

Brain-Like Stochastic Search: A Research Challenge and Funding Opportunity

Brain-Like Stochastic Search (BLiSS) refers to this task: given a family...
research
04/30/2021

Using brain inspired principles to unsupervisedly learn good representations for visual pattern recognition

Although deep learning has solved difficult problems in visual pattern r...
research
09/16/2022

A Biologically-Inspired Dual Stream World Model

The medial temporal lobe (MTL), a brain region containing the hippocampu...

Please sign up or login with your details

Forgot password? Click here to reset