Privacy-preserving Social Distance Monitoring on Microcontrollers with Low-Resolution Infrared Sensors and CNNs

04/22/2022
by   Chen Xie, et al.
0

Low-resolution infrared (IR) array sensors offer a low-cost, low-power, and privacy-preserving alternative to optical cameras and smartphones/wearables for social distance monitoring in indoor spaces, permitting the recognition of basic shapes, without revealing the personal details of individuals. In this work, we demonstrate that an accurate detection of social distance violations can be achieved processing the raw output of a 8x8 IR array sensor with a small-sized Convolutional Neural Network (CNN). Furthermore, the CNN can be executed directly on a Microcontroller (MCU)-based sensor node. With results on a newly collected open dataset, we show that our best CNN achieves 86.3 by a state-of-the-art deterministic algorithm. Changing the architectural parameters of the CNN, we obtain a rich Pareto set of models, spanning 70.5-86.3 these models have a latency of 0.73-5.33ms, with an energy consumption per inference of 9.38-68.57μJ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2022

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Low-resolution infrared (IR) Sensors combined with machine learning (ML)...
research
04/12/2023

Efficient Deep Learning Models for Privacy-preserving People Counting on Low-resolution Infrared Arrays

Ultra-low-resolution Infrared (IR) array sensors offer a low-cost, energ...
research
07/09/2020

How low can you go? Privacy-preserving people detection with an omni-directional camera

In this work, we use a ceiling-mounted omni-directional camera to detect...
research
10/08/2021

MilliTRACE-IR: Contact Tracing and Temperature Screening via mm-Wave and Infrared Sensing

In this work, we present milliTRACE-IR, a joint mm-wave radar and infrar...
research
09/02/2022

Human Activity Recognition on Microcontrollers with Quantized and Adaptive Deep Neural Networks

Human Activity Recognition (HAR) based on inertial data is an increasing...
research
08/03/2017

Extreme Low Resolution Activity Recognition with Multi-Siamese Embedding Learning

This paper presents an approach for recognition of human activities from...
research
08/13/2020

Few shot clustering for indoor occupancy detection with extremely low-quality images from battery free cameras

Reliable detection of human occupancy in indoor environments is critical...

Please sign up or login with your details

Forgot password? Click here to reset