DeepAI AI Chat
Log In Sign Up

DANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data

08/05/2020
by   Mohammad Malekzadeh, et al.
0

Current deep neural architectures for processing sensor data are mainly designed for data coming from a fixed set of sensors, with a fixed sampling rate. Changing the dimensions of the input data causes considerable accuracy loss, unnecessary computations, or application failures. To address this problem, we introduce a dimension-adaptive pooling (DAP) layer that makes deep architectures robust to temporal changes in sampling rate and in sensor availability. DAP operates on convolutional filter maps of variable dimensions and produces an input of fixed dimensions suitable for feedforward and recurrent layers. Building on this architectural improvement, we propose a dimension-adaptive training (DAT) procedure to generalize over the entire space of feasible data dimensions at the inference time. DAT comprises the random selection of dimensions during the forward passes and optimization with accumulated gradients of several backward passes. We then combine DAP and DAT to transform existing non-adaptive deep architectures into a Dimension-Adaptive Neural Architecture (DANA) without altering other architectural aspects. Our solution does not need up-sampling or imputation, thus reduces unnecessary computations at inference time. Experimental results on public datasets show that DANA prevents losses in classification accuracy of the state-of-the-art deep architectures, under dynamic sensor availability and varying sampling rates.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/25/2020

Sequence-to-Sequence Imputation of Missing Sensor Data

Although the sequence-to-sequence (encoder-decoder) model is considered ...
07/01/2020

Handling Variable-Dimensional Time Series with Graph Neural Networks

Several applications of Internet of Things(IoT) technology involve captu...
09/27/2021

Consistency Training of Multi-exit Architectures for Sensor Data

Deep neural networks have become larger over the years with increasing d...
04/14/2019

A Spatial-Temporal Correlation Approach for Data Reduction in Cluster-Based Sensor Networks

In a resource-constrained Wireless Sensor Networks (WSNs), the optimizat...
03/01/2022

Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring

Photoplethysmography (PPG) sensors allow for non-invasive and comfortabl...
09/07/2020

Are Deep Neural Architectures Losing Information? Invertibility Is Indispensable

Ever since the advent of AlexNet, designing novel deep neural architectu...