Renate: A Library for Real-World Continual Learning

04/24/2023
by   Martin Wistuba, et al.
4

Continual learning enables the incremental training of machine learning models on non-stationary data streams.While academic interest in the topic is high, there is little indication of the use of state-of-the-art continual learning algorithms in practical machine learning deployment. This paper presents Renate, a continual learning library designed to build real-world updating pipelines for PyTorch models. We discuss requirements for the use of continual learning algorithms in practice, from which we derive design principles for Renate. We give a high-level description of the library components and interfaces. Finally, we showcase the strengths of the library by presenting experimental results. Renate may be found at https://github.com/awslabs/renate.

READ FULL TEXT
research
04/21/2023

SequeL: A Continual Learning Library in PyTorch and JAX

Continual Learning is an important and challenging problem in machine le...
research
02/02/2023

Avalanche: A PyTorch Library for Deep Continual Learning

Continual learning is the problem of learning from a nonstationary strea...
research
05/02/2020

Visually Grounded Continual Learning of Compositional Semantics

Children's language acquisition from the visual world is a real-world ex...
research
05/26/2021

Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and Frameworks

Continual learning is essential for all real-world applications, as froz...
research
06/14/2022

Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Models

Predictive machine learning models nowadays are often updated in a state...
research
11/09/2022

Continual learning autoencoder training for a particle-in-cell simulation via streaming

The upcoming exascale era will provide a new generation of physics simul...
research
08/14/2023

CTP: Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation

Vision-Language Pretraining (VLP) has shown impressive results on divers...

Please sign up or login with your details

Forgot password? Click here to reset