DANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data

by   Mohammad Malekzadeh, et al.

Current deep neural architectures for processing sensor data are mainly designed for data coming from a fixed set of sensors, with a fixed sampling rate. Changing the dimensions of the input data causes considerable accuracy loss, unnecessary computations, or application failures. To address this problem, we introduce a dimension-adaptive pooling (DAP) layer that makes deep architectures robust to temporal changes in sampling rate and in sensor availability. DAP operates on convolutional filter maps of variable dimensions and produces an input of fixed dimensions suitable for feedforward and recurrent layers. Building on this architectural improvement, we propose a dimension-adaptive training (DAT) procedure to generalize over the entire space of feasible data dimensions at the inference time. DAT comprises the random selection of dimensions during the forward passes and optimization with accumulated gradients of several backward passes. We then combine DAP and DAT to transform existing non-adaptive deep architectures into a Dimension-Adaptive Neural Architecture (DANA) without altering other architectural aspects. Our solution does not need up-sampling or imputation, thus reduces unnecessary computations at inference time. Experimental results on public datasets show that DANA prevents losses in classification accuracy of the state-of-the-art deep architectures, under dynamic sensor availability and varying sampling rates.


page 1

page 2

page 3

page 4


Flexible Channel Dimensions for Differentiable Architecture Search

Finding optimal channel dimensions (i.e., the number of filters in DNN l...

Sequence-to-Sequence Imputation of Missing Sensor Data

Although the sequence-to-sequence (encoder-decoder) model is considered ...

Handling Variable-Dimensional Time Series with Graph Neural Networks

Several applications of Internet of Things(IoT) technology involve captu...

SFFDD: Deep Neural Network with Enriched Features for Failure Prediction with Its Application to Computer Disk Driver

A classification technique incorporating a novel feature derivation meth...

Consistency Training of Multi-exit Architectures for Sensor Data

Deep neural networks have become larger over the years with increasing d...

A distributed neural network architecture for dynamic sensor selection with application to bandwidth-constrained body-sensor networks

We propose a dynamic sensor selection approach for deep neural networks ...

Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring

Photoplethysmography (PPG) sensors allow for non-invasive and comfortabl...

Please sign up or login with your details

Forgot password? Click here to reset