Towards Machine Learning and Inference for Resource-constrained MCUs

05/30/2023
by   Yushan Huang, et al.
0

Machine learning (ML) is moving towards edge devices. However, ML models with high computational demands and energy consumption pose challenges for ML inference in resource-constrained environments, such as the deep sea. To address these challenges, we propose a battery-free ML inference and model personalization pipeline for microcontroller units (MCUs). As an example, we performed fish image recognition in the ocean. We evaluated and compared the accuracy, runtime, power, and energy consumption of the model before and after optimization. The results demonstrate that, our pipeline can achieve 97.78 accuracy with 483.82 KB Flash, 70.32 KB RAM, 118 ms runtime, 4.83 mW power, and 0.57 mJ energy consumption on MCUs, reducing by 64.17 and 82.67 battery-free ML inference on MCUs.

READ FULL TEXT

page 1

page 2

research
03/30/2021

EnergyVis: Interactively Tracking and Exploring Energy Consumption for ML Models

The advent of larger machine learning (ML) models have improved state-of...
research
07/14/2022

T-RECX: Tiny-Resource Efficient Convolutional Neural Networks with Early-Exit

Deploying Machine learning (ML) on the milliwatt-scale edge devices (tin...
research
06/02/2021

IrEne: Interpretable Energy Prediction for Transformers

Existing software-based energy measurements of NLP models are not accura...
research
02/16/2022

Towards Battery-Free Machine Learning and Inference in Underwater Environments

This paper is motivated by a simple question: Can we design and build ba...
research
08/16/2022

Tiny-HR: Towards an interpretable machine learning pipeline for heart rate estimation on edge devices

The focus of this paper is a proof of concept, machine learning (ML) pip...
research
07/04/2020

A Novel Multi-Step Finite-State Automaton for Arbitrarily Deterministic Tsetlin Machine Learning

Due to the high energy consumption and scalability challenges of deep le...
research
10/16/2020

Cloud Energy Micro-Moment Data Classification: A Platform Study

Energy efficiency is a crucial factor in the well-being of our planet. I...

Please sign up or login with your details

Forgot password? Click here to reset