Heteroscedastic Temporal Variational Autoencoder For Irregularly Sampled Time Series

07/23/2021
by   Satya Narayan Shukla, et al.
0

Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE). HeTVAE includes a novel input layer to encode information about input observation sparsity, a temporal VAE architecture to propagate uncertainty due to input sparsity, and a heteroscedastic output layer to enable variable uncertainty in output interpolations. Our results show that the proposed architecture is better able to reflect variable uncertainty through time due to sparse and irregular sampling than a range of baseline and traditional models, as well as recently proposed deep latent variable models that use homoscedastic output layers.

READ FULL TEXT

page 15

page 17

research
01/25/2021

Multi-Time Attention Networks for Irregularly Sampled Time Series

Irregular sampling occurs in many time series modeling applications wher...
research
01/25/2021

VConstruct: Filling Gaps in Chl-a Data Using a Variational Autoencoder

Remote sensing of Chlorophyll-a is vital in monitoring climate change. C...
research
09/13/2019

Interpolation-Prediction Networks for Irregularly Sampled Time Series

In this paper, we present a new deep learning architecture for addressin...
research
11/15/2021

An adaptive dimension reduction algorithm for latent variables of variational autoencoder

Constructed by the neural network, variational autoencoder has the overf...
research
09/19/2019

Learning to Conceal: A Deep Learning Based Method for Preserving Privacy and Avoiding Prejudice

In this paper, we introduce a learning model able to conceals personal i...
research
03/28/2019

Correlating Paleoclimate Time Series: Sources of Uncertainty and Potential Pitfalls

Comparing paleoclimate time series is complicated by a variety of typica...
research
12/27/2022

Semi-supervised multiscale dual-encoding method for faulty traffic data detection

Inspired by the recent success of deep learning in multiscale informatio...

Please sign up or login with your details

Forgot password? Click here to reset