Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural Networks

11/15/2018
by   Jing Shi, et al.
8

Deep neural networks have shown superior performance in many regimes to remember familiar patterns with large amounts of data. However, the standard supervised deep learning paradigm is still limited when facing the need to learn new concepts efficiently from scarce data. In this paper, we present a memory-augmented neural network which is motivated by the process of human concept learning. The training procedure, imitating the concept formation course of human, learns how to distinguish samples from different classes and aggregate samples of the same kind. In order to better utilize the advantages originated from the human behavior, we propose a sequential process, during which the network should decide how to remember each sample at every step. In this sequential process, a stable and interactive memory serves as an important module. We validate our model in some typical one-shot learning tasks and also an exploratory outlier detection problem. In all the experiments, our model gets highly competitive to reach or outperform those strong baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2019

Metalearned Neural Memory

We augment recurrent neural networks with an external memory mechanism t...
research
09/04/2019

Augmented Memory Networks for Streaming-Based Active One-Shot Learning

One of the major challenges in training deep architectures for predictiv...
research
12/26/2018

A New Concept of Deep Reinforcement Learning based Augmented General Sequence Tagging System

In this paper, a new deep reinforcement learning based augmented general...
research
06/08/2021

Dynamic Sparse Training for Deep Reinforcement Learning

Deep reinforcement learning has achieved significant success in many dec...
research
07/03/2021

Memory and attention in deep learning

Intelligence necessitates memory. Without memory, humans fail to perform...
research
03/29/2018

MemGEN: Memory is All You Need

We propose a new learning paradigm called Deep Memory. It has the potent...
research
08/06/2022

Learning Human Cognitive Appraisal Through Reinforcement Memory Unit

We propose a novel memory-enhancing mechanism for recurrent neural netwo...

Please sign up or login with your details

Forgot password? Click here to reset