DeepAI AI Chat
Log In Sign Up

Generative Memory for Lifelong Reinforcement Learning

by   Aswin Raghavan, et al.

Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of biological memory transfer to arrive at AI algorithms for memory consolidation and replay. In this paper, we propose the use of generative memory that can be recalled in batch samples to train a multi-task agent in a pseudo-rehearsal manner. We show results motivating the need for task-agnostic separation of latent space for the generative memory to address issues of catastrophic forgetting in lifelong learning.


page 1

page 2

page 3


Learning offline: memory replay in biological and artificial reinforcement learning

Learning to act in an environment to maximise rewards is among the brain...

Latent Space based Memory Replay for Continual Learning in Artificial Neural Networks

Memory replay may be key to learning in biological brains, which manage ...

Complementary Learning for Overcoming Catastrophic Forgetting Using Experience Replay

Despite huge success, deep networks are unable to learn effectively in s...

Augmented Replay Memory in Reinforcement Learning With Continuous Control

Online reinforcement learning agents are currently able to process an in...

A general approach to progressive learning

In biological learning, data is used to improve performance on the task ...

A general approach to progressive intelligence

In biological learning, data is used to improve performance on the task ...