DeepAI AI Chat
Log In Sign Up

Dynamic memory to alleviate catastrophic forgetting in continuous learning settings

by   Johannes Hofmanninger, et al.
MedUni Wien

In medical imaging, technical progress or changes in diagnostic procedures lead to a continuous change in image appearance. Scanner manufacturer, reconstruction kernel, dose, other protocol specific settings or administering of contrast agents are examples that influence image content independent of the scanned biology. Such domain and task shifts limit the applicability of machine learning algorithms in the clinical routine by rendering models obsolete over time. Here, we address the problem of data shifts in a continuous learning scenario by adapting a model to unseen variations in the source domain while counteracting catastrophic forgetting effects. Our method uses a dynamic memory to facilitate rehearsal of a diverse training data subset to mitigate forgetting. We evaluated our approach on routine clinical CT data obtained with two different scanner protocols and synthetic classification tasks. Experiments show that dynamic memory counters catastrophic forgetting in a setting with multiple data shifts without the necessity for explicit knowledge about when these shifts occur.


CoSDA: Continual Source-Free Domain Adaptation

Without access to the source data, source-free domain adaptation (SFDA) ...

Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions

Deep neural networks for scene perception in automated vehicles achieve ...

Reducing catastrophic forgetting with learning on synthetic data

Catastrophic forgetting is a problem caused by neural networks' inabilit...

On Generalizing Detection Models for Unconstrained Environments

Object detection has seen tremendous progress in recent years. However, ...

Lifelong Learning from Event-based Data

Lifelong learning is a long-standing aim for artificial agents that act ...

Uncertainty-based Modulation for Lifelong Learning

The creation of machine learning algorithms for intelligent agents capab...

Combating catastrophic forgetting with developmental compression

Generally intelligent agents exhibit successful behavior across problems...