Embedded Neural Networks for Robot Autonomy

11/10/2019
by   Sarah Aguasvivas Manzano, et al.
0

We present a library to automatically embed signal processing and neural network predictions into the material robots are made of. Deep and shallow neural network models are first trained offline using state-of-the-art machine learning tools and then transferred onto general purpose microcontrollers that are co-located with a robot's sensors and actuators. We validate this approach using multiple examples: a smart robotic tire for terrain classification, a robotic finger sensor for load classification and a smart composite capable of regressing impact source localization. In each example, sensing and computation are embedded inside the material, creating artifacts that serve as stand-in replacement for otherwise inert conventional parts. The open source software library takes as inputs trained model files from higher level learning software, such as Tensorflow/Keras, and outputs code that is readable in a microcontroller that supports C. We compare the performance of this approach for various embedded platforms. In particular, we show that low-cost off-the-shelf microcontrollers can match the accuracy of a desktop computer, while being fast enough for real-time applications at different neural network configurations. We provide means to estimate the maximum number of parameters that the hardware will support based on the microcontroller's specifications.

READ FULL TEXT
research
05/22/2022

Toward smart composites: small-scale, untethered prediction and control for soft sensor/actuator systems

We present a suite of algorithms and tools for model-predictive control ...
research
05/12/2021

An Open-Source Tool for Classification Models in Resource-Constrained Hardware

Applications that need to sense, measure, and gather real-time informati...
research
03/28/2022

Leveraging Tactile Sensors for Low Latency Embedded Smart Hands for Prosthetic and Robotic Applications

Tactile sensing is a crucial perception mode for robots and human ampute...
research
10/04/2022

O2S: Open-source open shuttle

Currently, commercially available intelligent transport robots that are ...
research
03/05/2021

ODAS: Open embeddeD Audition System

Artificial audition aims at providing hearing capabilities to machines, ...
research
07/13/2022

Estimation of Soft Robotic Bladder Compression for Smart Helmets using IR Range Finding and Hall Effect Magnetic Sensing

This research focuses on soft robotic bladders that are used to monitor ...
research
10/10/2022

SLURP! Spectroscopy of Liquids Using Robot Pre-Touch Sensing

Liquids and granular media are pervasive throughout human environments. ...

Please sign up or login with your details

Forgot password? Click here to reset