Optimized Gated Deep Learning Architectures for Sensor Fusion

10/08/2018
by   Myung Seok Shim, et al.
0

Sensor fusion is a key technology that integrates various sensory inputs to allow for robust decision making in many applications such as autonomous driving and robot control. Deep neural networks have been adopted for sensor fusion in a body of recent studies. Among these, the so-called netgated architecture was proposed, which has demonstrated improved performances over the conventional convolutional neural networks (CNN). In this paper, we address several limitations of the baseline negated architecture by proposing two further optimized architectures: a coarser-grained gated architecture employing (feature) group-level fusion weights and a two-stage gated architectures leveraging both the group-level and feature level fusion weights. Using driving mode prediction and human activity recognition datasets, we demonstrate the significant performance improvements brought by the proposed gated architectures and also their robustness in the presence of sensor noise and failures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/29/2019

Deep Neural Networks with Auxiliary-Model Regulated Gating for Resilient Multi-Modal Sensor Fusion

Deep neural networks allow for fusion of high-level features from multip...
research
03/16/2019

GFD-SSD: Gated Fusion Double SSD for Multispectral Pedestrian Detection

Pedestrian detection is an essential task in autonomous driving research...
research
07/17/2018

Robust Deep Multi-modal Learning Based on Gated Information Fusion Network

The goal of multi-modal learning is to use complimentary information on ...
research
08/14/2023

Deep convolutional neural networks for cyclic sensor data

Predictive maintenance plays a critical role in ensuring the uninterrupt...
research
07/31/2018

DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition

Deep Convolutional Neural Networks (DCNNs) are currently popular in huma...
research
09/13/2022

Towards Efficient Architecture and Algorithms for Sensor Fusion

The safety of an automated vehicle hinges crucially upon the accuracy of...
research
08/09/2017

Sequential Dual Deep Learning with Shape and Texture Features for Sketch Recognition

Recognizing freehand sketches with high arbitrariness is greatly challen...

Please sign up or login with your details

Forgot password? Click here to reset