Attention-based Information Fusion using Multi-Encoder-Decoder Recurrent Neural Networks

11/13/2017
by   Stephan Baier, et al.
0

With the rising number of interconnected devices and sensors, modeling distributed sensor networks is of increasing interest. Recurrent neural networks (RNN) are considered particularly well suited for modeling sensory and streaming data. When predicting future behavior, incorporating information from neighboring sensor stations is often beneficial. We propose a new RNN based architecture for context specific information fusion across multiple spatially distributed sensor stations. Hereby, latent representations of multiple local models, each modeling one sensor station, are jointed and weighted, according to their importance for the prediction. The particular importance is assessed depending on the current context using a separate attention function. We demonstrate the effectiveness of our model on three different real-world sensor network datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2021

Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Prediction

Forecasting the future behavior of all traffic agents in the vicinity is...
research
01/12/2018

Predicting Future Lane Changes of Other Highway Vehicles using RNN-based Deep Models

In the event of sensor failure, it is necessary for autonomous vehicles ...
research
01/29/2019

Deep Neural Networks with Auxiliary-Model Regulated Gating for Resilient Multi-Modal Sensor Fusion

Deep neural networks allow for fusion of high-level features from multip...
research
09/16/2015

Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecture

Anticipating the future actions of a human is a widely studied problem i...
research
12/18/2022

Hidden State Approximation in Recurrent Neural Networks Using Continuous Particle Filtering

Using historical data to predict future events has many applications in ...
research
10/01/2017

Translating Videos to Commands for Robotic Manipulation with Deep Recurrent Neural Networks

We present a new method to translate videos to commands for robotic mani...
research
03/03/2017

Machine Learning on Sequential Data Using a Recurrent Weighted Average

Recurrent Neural Networks (RNN) are a type of statistical model designed...

Please sign up or login with your details

Forgot password? Click here to reset