A Scalable Approach to Multi-Context Continual Learning via Lifelong Skill Encoding

05/25/2018
by   Blake Camp, et al.
0

Continual or lifelong learning (CL) is one of the most challenging problems in machine learning. In this paradigm, a system must learn new tasks, contexts, or data without forgetting previously learned information. We present a scalable approach to multi-context continual learning (MCCL) in which we decouple how a system learns to solve new tasks (i.e., acquires skills) from how it stores them. Our approach leverages two types of artificial networks: (1) a set of reusable, task-specific networks (TN) that can be trained as needed to learn new skills, and (2) a lifelong, autoencoder network (EN) that stores all learned skills in a compact, latent space. To learn a new skill, we first train a TN using conventional backpropagation, thus placing no restrictions on the system's ability to encode the new task. We then incorporate the newly learned skill into the latent space by first recalling previously learned skills using our EN and then retraining it on both the new and recalled skills. Our approach can efficiently store an arbitrary number of skills without compromising previously learned information because each skill is stored as a separate latent vector. Whenever a particular skill is needed, we recall the necessary weights using our EN and then load them into the corresponding TN. Experiments on the MNIST and CIFAR datasets show that we can continually learn new skills without compromising the performance of existing skills. To the best of our knowledge, we are the first to demonstrate the feasibility of encoding entire networks in order to facilitate efficient continual learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/19/2021

A Simple Approach to Continual Learning by Transferring Skill Parameters

In order to be effective general purpose machines in real world environm...
research
02/14/2022

Continual Learning from Demonstration of Robotic Skills

Methods for teaching motion skills to robots focus on training for a sin...
research
02/10/2016

Adaptive Skills, Adaptive Partitions (ASAP)

We introduce the Adaptive Skills, Adaptive Partitions (ASAP) framework t...
research
02/24/2018

One Big Net For Everything

I apply recent work on "learning to think" (2015) and on PowerPlay (2011...
research
10/31/2012

First Experiments with PowerPlay

Like a scientist or a playing child, PowerPlay not only learns new skill...
research
06/11/2021

A Novel Approach to Lifelong Learning: The Plastic Support Structure

We propose a novel approach to lifelong learning, introducing a compact ...
research
12/08/2022

Learning Options via Compression

Identifying statistical regularities in solutions to some tasks in multi...

Please sign up or login with your details

Forgot password? Click here to reset