DeepAI AI Chat
Log In Sign Up

TinyOL: TinyML with Online-Learning on Microcontrollers

by   Haoyu Ren, et al.
Siemens AG

Tiny machine learning (TinyML) is a fast-growing research area committed to democratizing deep learning for all-pervasive microcontrollers (MCUs). Challenged by the constraints on power, memory, and computation, TinyML has achieved significant advancement in the last few years. However, the current TinyML solutions are based on batch/offline settings and support only the neural network's inference on MCUs. The neural network is first trained using a large amount of pre-collected data on a powerful machine and then flashed to MCUs. This results in a static model, hard to adapt to new data, and impossible to adjust for different scenarios, which impedes the flexibility of the Internet of Things (IoT). To address these problems, we propose a novel system called TinyOL (TinyML with Online-Learning), which enables incremental on-device training on streaming data. TinyOL is based on the concept of online learning and is suitable for constrained IoT devices. We experiment TinyOL under supervised and unsupervised setups using an autoencoder neural network. Finally, we report the performance of the proposed solution and show its effectiveness and feasibility.


Distributed Online Learning with Multiple Kernels

In the Internet-of-Things (IoT) systems, there are plenty of informative...

Implicit Context-aware Learning and Discovery for Streaming Data Analytics

The performance of machine learning model can be further improved if con...

Research on the Concept of Liquid State Machine

Liquid State Machine (LSM) is a neural model with real time computations...

Deep Online Learning with Stochastic Constraints

Deep learning models are considered to be state-of-the-art in many offli...

Incremental Online Learning Algorithms Comparison for Gesture and Visual Smart Sensors

Tiny machine learning (TinyML) in IoT systems exploits MCUs as edge devi...

Quantile Online Learning for Semiconductor Failure Analysis

With high device integration density and evolving sophisticated device s...

Fast CRDNN: Towards on Site Training of Mobile Construction Machines

The CRDNN is a combined neural network that can increase the holistic ef...