Provable Hierarchical Lifelong Learning with a Sketch-based Modular Architecture

12/21/2021
by   Zihao Deng, et al.
0

We propose a modular architecture for the lifelong learning of hierarchically structured tasks. Specifically, we prove that our architecture is theoretically able to learn tasks that can be solved by functions that are learnable given access to functions for other, previously learned tasks as subroutines. We empirically show that some tasks that we can learn in this way are not learned by standard training methods in practice; indeed, prior work suggests that some such tasks cannot be learned by any efficient method without the aid of the simpler tasks. We also consider methods for identifying the tasks automatically, without relying on explicitly given indicators.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2018

Lessons Learned in Migrating from Swing to JavaFX

Martin P. Robillard and Kaylee Kutschera...
research
12/20/2022

HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes

Bayesian optimization (BO), while proved highly effective for many black...
research
01/28/2023

Composing Task Knowledge with Modular Successor Feature Approximators

Recently, the Successor Features and Generalized Policy Improvement (SF ...
research
09/23/2020

Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves

Much as replacing hand-designed features with learned functions has revo...
research
11/20/2017

Modular Continual Learning in a Unified Visual Environment

A core aspect of human intelligence is the ability to learn new tasks qu...
research
04/30/2020

Modular Representation Underlies Systematic Generalization in Neural Natural Language Inference Models

In adversarial (challenge) testing, we pose hard generalization tasks in...
research
06/02/2023

OMNI: Open-endedness via Models of human Notions of Interestingness

Open-ended algorithms aim to learn new, interesting behaviors forever. T...

Please sign up or login with your details

Forgot password? Click here to reset