DeepAI AI Chat
Log In Sign Up

Online Continual Learning with Maximally Interfered Retrieval

by   Rahaf Aljundi, et al.

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting has gained attention recently as a natural setting that is difficult to tackle. Methods based on replay, either generative or from a stored memory, have been shown to be effective approaches for continual learning, matching or exceeding the state of the art in a number of standard benchmarks. These approaches typically rely on randomly selecting samples from the replay memory or from a generative model, which is suboptimal. In this work we consider a controlled sampling of memories for replay. We retrieve the samples which are most interfered, i.e. whose prediction will be most negatively impacted by the foreseen parameters update. We show a formulation for this sampling criterion in both the generative replay and the experience replay setting, producing consistent gains in performance and greatly reduced forgetting.


page 4

page 8


Self-recovery of memory via generative replay

A remarkable capacity of the brain is its ability to autonomously reorga...

Optimizing Class Distribution in Memory for Multi-Label Online Continual Learning

Online continual learning, especially when task identities and task boun...

ACAE-REMIND for Online Continual Learning with Compressed Feature Replay

Online continual learning aims to learn from a non-IID stream of data fr...

It's all About Consistency: A Study on Memory Composition for Replay-Based Methods in Continual Learning

Continual Learning methods strive to mitigate Catastrophic Forgetting (C...

Reducing Representation Drift in Online Continual Learning

We study the online continual learning paradigm, where agents must learn...

Marginal Replay vs Conditional Replay for Continual Learning

We present a new replay-based method of continual classification learnin...

An Investigation of Replay-based Approaches for Continual Learning

Continual learning (CL) is a major challenge of machine learning (ML) an...