A Sequential Concept Drift Detection Method for On-Device Learning on Low-End Edge Devices

12/19/2022
by   Takeya Yamada, et al.
0

A practical issue of edge AI systems is that data distributions of trained dataset and deployed environment may differ due to noise and environmental changes over time. Such a phenomenon is known as a concept drift, and this gap degrades the performance of edge AI systems and may introduce system failures. To address this gap, a retraining of neural network models triggered by concept drift detection is a practical approach. However, since available compute resources are strictly limited in edge devices, in this paper we propose a lightweight concept drift detection method in cooperation with a recently proposed on-device learning technique of neural networks. In this case, both the neural network retraining and the proposed concept drift detection are done by sequential computation only to reduce computation cost and memory utilization. Evaluation results of the proposed approach shows that while the accuracy is decreased by 3.8 methods, it decreases the memory size by 88.9 1.3 the proposed concept drift detection method is demonstrated on Raspberry Pi Pico that has 264kB memory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2020

An On-Device Federated Learning Approach for Cooperative Anomaly Detection

Most edge AI focuses on prediction tasks on resource-limited edge device...
research
12/09/2018

Towards Neural Network Patching: Evaluating Engagement-Layers and Patch-Architectures

In this report we investigate fundamental requirements for the applicati...
research
03/02/2022

On-Device Learning: A Neural Network Based Field-Trainable Edge AI

In real-world edge AI applications, their accuracy is often affected by ...
research
04/02/2020

Device-aware inference operations in SONOS nonvolatile memory arrays

Non-volatile memory arrays can deploy pre-trained neural network models ...
research
06/18/2021

Labelling Drifts in a Fault Detection System for Wind Turbine Maintenance

A failure detection system is the first step towards predictive maintena...
research
07/30/2021

Tiny Machine Learning for Concept Drift

Tiny Machine Learning (TML) is a new research area whose goal is to desi...
research
09/08/2020

Low-Rank Training of Deep Neural Networks for Emerging Memory Technology

The recent success of neural networks for solving difficult decision tal...

Please sign up or login with your details

Forgot password? Click here to reset