A VM/Containerized Approach for Scaling TinyML Applications

02/10/2022
by   Meelis Lootus, et al.
0

Although deep neural networks are typically computationally expensive to use, technological advances in both the design of hardware platforms and of neural network architectures, have made it possible to use powerful models on edge devices. To enable widespread adoption of edge based machine learning, we introduce a set of open-source tools that make it easy to deploy, update and monitor machine learning models on a wide variety of edge devices. Our tools bring the concept of containerization to the TinyML world. We propose to package ML and application logic as containers called Runes to deploy onto edge devices. The containerization allows us to target a fragmented Internet-of-Things (IoT) ecosystem by providing a common platform for Runes to run across devices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2019

Challenges in designing edge-based middlewares for the Internet of Things: A survey

The Internet of Things paradigm connects edge devices via the Internet e...
research
03/21/2022

TinyMLOps: Operational Challenges for Widespread Edge AI Adoption

Deploying machine learning applications on edge devices can bring clear ...
research
09/07/2019

WoTify: A platform to bring Web of Things to your devices

The Internet of Things (IoT) has already taken off, together with many W...
research
11/05/2022

A review of TinyML

In this current technological world, the application of machine learning...
research
06/12/2019

Visual Wake Words Dataset

The emergence of Internet of Things (IoT) applications requires intellig...
research
03/22/2021

Tiny Transformers for Environmental Sound Classification at the Edge

With the growth of the Internet of Things and the rise of Big Data, data...
research
01/16/2021

NNStreamer: Efficient and Agile Development of On-Device AI Systems

We propose NNStreamer, a software system that handles neural networks as...

Please sign up or login with your details

Forgot password? Click here to reset