Been There, Done That: Meta-Learning with Episodic Recall

05/24/2018
by   Samuel Ritter, et al.
0

Meta-learning agents excel at rapidly learning new tasks from open-ended task distributions; yet, they forget what they learn about each task as soon as the next begins. When tasks reoccur - as they do in natural environments - metalearning agents must explore again instead of immediately exploiting previously discovered solutions. We propose a formalism for generating open-ended yet repetitious environments, then develop a meta-learning architecture for solving these environments. This architecture melds the standard LSTM working memory with a differentiable neural episodic memory. We explore the capabilities of agents with this episodic LSTM in five meta-learning environments with reoccurring tasks, ranging from bandits to navigation and stochastic sequential decision problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2022

Multi-Environment Meta-Learning in Stochastic Linear Bandits

In this work we investigate meta-learning (or learning-to-learn) approac...
research
05/28/2021

Towards mental time travel: a hierarchical memory for reinforcement learning agents

Reinforcement learning agents often forget details of the past, especial...
research
06/12/2020

Attentive Feature Reuse for Multi Task Meta learning

We develop new algorithms for simultaneous learning of multiple tasks (e...
research
12/16/2021

Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learning

In meta-learning, networks are trained with external algorithms to learn...
research
10/06/2020

Dif-MAML: Decentralized Multi-Agent Meta-Learning

The objective of meta-learning is to exploit the knowledge obtained from...
research
02/06/2023

Memory-Based Meta-Learning on Non-Stationary Distributions

Memory-based meta-learning is a technique for approximating Bayes-optima...
research
05/15/2019

Meta reinforcement learning as task inference

Humans achieve efficient learning by relying on prior knowledge about th...

Please sign up or login with your details

Forgot password? Click here to reset