Lifelong Learning of Compositional Structures

07/15/2020
by   Jorge A. Mendez, et al.
0

A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and adequately reuse them in novel combinations for solving different yet structurally related problems. Learning such compositional structures has been a significant challenge for artificial systems, due to the combinatorial nature of the underlying search problem. To date, research into compositional learning has largely proceeded separately from work on lifelong or continual learning. We integrate these two lines of work to present a general-purpose framework for lifelong learning of compositional structures that can be used for solving a stream of related tasks. Our framework separates the learning process into two broad stages: learning how to best combine existing components in order to assimilate a novel problem, and learning how to adapt the set of existing components to accommodate the new problem. This separation explicitly handles the trade-off between the stability required to remember how to solve earlier tasks and the flexibility required to solve new tasks, as we show empirically in an extensive evaluation.

READ FULL TEXT

page 3

page 13

page 16

research
07/25/2022

Lifelong Machine Learning of Functionally Compositional Structures

A hallmark of human intelligence is the ability to construct self-contai...
research
07/15/2022

How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition

A major goal of artificial intelligence (AI) is to create an agent capab...
research
07/01/2022

Modular Lifelong Reinforcement Learning via Neural Composition

Humans commonly solve complex problems by decomposing them into easier s...
research
03/20/2022

Continual Sequence Generation with Adaptive Compositional Modules

Continual learning is essential for real-world deployment when there is ...
research
02/12/2023

Rapid Development of Compositional AI

Compositional AI systems, which combine multiple artificial intelligence...
research
07/16/2022

Meta-Referential Games to Learn Compositional Learning Behaviours

Human beings use compositionality to generalise from past experiences to...

Please sign up or login with your details

Forgot password? Click here to reset