A sub-mW IoT-endnode for always-on visual monitoring and smart triggering

04/29/2017
by   Manuele Rusci, et al.
0

This work presents a fully-programmable Internet of Things (IoT) visual sensing node that targets sub-mW power consumption in always-on monitoring scenarios. The system features a spatial-contrast 128x64 binary pixel imager with focal-plane processing. The sensor, when working at its lowest power mode (10μ W at 10 fps), provides as output the number of changed pixels. Based on this information, a dedicated camera interface, implemented on a low-power FPGA, wakes up an ultra-low-power parallel processing unit to extract context-aware visual information. We evaluate the smart sensor on three always-on visual triggering application scenarios. Triggering accuracy comparable to RGB image sensors is achieved at nominal lighting conditions, while consuming an average power between 193μ W and 277μ W, depending on context activity. The digital sub-system is extremely flexible, thanks to a fully-programmable digital signal processing engine, but still achieves 19x lower power consumption compared to MCU-based cameras with significantly lower on-board computing capabilities.

READ FULL TEXT

page 4

page 6

page 8

research
06/23/2019

Design of a Simplified Wireless Sensor Network Node based on MQTT Protocol

MQTT protocol is a publish/subscribe message protocol based on TCP/IP pr...
research
03/15/2020

New Approximate Multiplier for Low Power Digital Signal Processing

In this paper a low power multiplier is proposed. The proposed multiplie...
research
11/08/2019

AI Aided Noise Processing of Spintronic Based IoT Sensor for Magnetocardiography Application

As we are about to embark upon the highly hyped "Society 5.0", powered b...
research
11/10/2022

Electroadhesive Auxetics as Programmable Layer Jamming Skins for Formable Crust Shape Displays

Shape displays are a class of haptic devices that enable whole-hand hapt...
research
04/30/2019

Interfacing PDM sensors with PFM spiking systems: application for Neuromorphic Auditory Sensors

In this paper we present a sub-system to convert audio information from ...
research
07/17/2020

Always-On 674uW @ 4GOP/s Error Resilient Binary Neural Networks with Aggressive SRAM Voltage Scaling on a 22nm IoT End-Node

Binary Neural Networks (BNNs) have been shown to be robust to random bit...
research
09/04/2023

An FPGA smart camera implementation of segmentation models for drone wildfire imagery

Wildfires represent one of the most relevant natural disasters worldwide...

Please sign up or login with your details

Forgot password? Click here to reset