Fast On-Device Adaptation for Spiking Neural Networks via Online-Within-Online Meta-Learning

by   Bleema Rosenfeld, et al.

Spiking Neural Networks (SNNs) have recently gained popularity as machine learning models for on-device edge intelligence for applications such as mobile healthcare management and natural language processing due to their low power profile. In such highly personalized use cases, it is important for the model to be able to adapt to the unique features of an individual with only a minimal amount of training data. Meta-learning has been proposed as a way to train models that are geared towards quick adaptation to new tasks. The few existing meta-learning solutions for SNNs operate offline and require some form of backpropagation that is incompatible with the current neuromorphic edge-devices. In this paper, we propose an online-within-online meta-learning rule for SNNs termed OWOML-SNN, that enables lifelong learning on a stream of tasks, and relies on local, backprop-free, nested updates.


Meta-learning Spiking Neural Networks with Surrogate Gradient Descent

Adaptive "life-long" learning at the edge and during online task perform...

Federated Neuromorphic Learning of Spiking Neural Networks for Low-Power Edge Intelligence

Spiking Neural Networks (SNNs) offer a promising alternative to conventi...

Meta-Learning for Natural Language Understanding under Continual Learning Framework

Neural network has been recognized with its accomplishments on tackling ...

Decoupling Adaptation from Modeling with Meta-Optimizers for Meta Learning

Meta-learning methods, most notably Model-Agnostic Meta-Learning or MAML...

Faster Optimization-Based Meta-Learning Adaptation Phase

Neural networks require a large amount of annotated data to learn. Meta-...

Finding online neural update rules by learning to remember

We investigate learning of the online local update rules for neural acti...

FALCON: Fast and Accurate Multipath Scheduling using Offline and Online Learning

Multipath transport protocols enable the concurrent use of different net...