Unicorn: Continual Learning with a Universal, Off-policy Agent

by   Daniel J. Mankowitz, et al.

Some real-world domains are best characterized as a single task, but for others this perspective is limiting. Instead, some tasks continually grow in complexity, in tandem with the agent's competence. In continual learning, also referred to as lifelong learning, there are no explicit task boundaries or curricula. As learning agents have become more powerful, continual learning remains one of the frontiers that has resisted quick progress. To test continual learning capabilities we consider a challenging 3D domain with an implicit sequence of tasks and sparse rewards. We propose a novel agent architecture called Unicorn, which demonstrates strong continual learning and outperforms several baseline agents on the proposed domain. The agent achieves this by jointly representing and learning multiple policies efficiently, using a parallel off-policy learning setup.


page 6

page 14


CLVOS23: A Long Video Object Segmentation Dataset for Continual Learning

Continual learning in real-world scenarios is a major challenge. A gener...

Continual Match Based Training in Pommerman: Technical Report

Continual learning is the ability of agents to improve their capacities ...

Toward Continual Learning for Conversational Agents

While end-to-end neural conversation models have led to promising advanc...

Continual Learning and Private Unlearning

As intelligent agents become autonomous over longer periods of time, the...

Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions

We present our view of what is necessary to build an engaging open-domai...

CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One

Continual learning requires incremental compatibility with a sequence of...

Building a Subspace of Policies for Scalable Continual Learning

The ability to continuously acquire new knowledge and skills is crucial ...

Please sign up or login with your details

Forgot password? Click here to reset