Dual reparametrized Variational Generative Model for Time-Series Forecasting

03/11/2022
by   Ziang Chen, et al.
0

This paper propose DualVDT, a generative model for Time-series forecasting. Introduced dual reparametrized variational mechanisms on variational autoencoder (VAE) to tighter the evidence lower bound (ELBO) of the model, prove the advance performance analytically. This mechanism leverage the latent score based generative model (SGM), explicitly denoising the perturbation accumulated on latent vector through reverse time stochastic differential equation and variational ancestral sampling. The posterior of denoised latent distribution fused with dual reparametrized variational density. The KL divergence in ELBO will reduce to reach the better results of the model. This paper also proposed a latent attention mechanisms to extract multivariate dependency explicitly. Build the local temporal dependency simultaneously in factor wised through constructed local topology and temporal wised. The proven and experiment on multiple datasets illustrate, DualVDT, with a novel dual reparametrized structure, which denoise the latent perturbation through the reverse dynamics combining local-temporal inference, has the advanced performance both analytically and experimentally.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 8

research
03/13/2023

Hybrid Variational Autoencoder for Time Series Forecasting

Variational autoencoders (VAE) are powerful generative models that learn...
research
01/06/2019

MAE: Mutual Posterior-Divergence Regularization for Variational AutoEncoders

Variational Autoencoder (VAE), a simple and effective deep generative mo...
research
05/11/2020

Deep Latent Variable Model for Longitudinal Group Factor Analysis

In many scientific problems such as video surveillance, modern genomic a...
research
06/18/2021

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models

Multivariate time series prediction has attracted a lot of attention bec...
research
04/27/2020

A Batch Normalized Inference Network Keeps the KL Vanishing Away

Variational Autoencoder (VAE) is widely used as a generative model to ap...
research
10/31/2018

Dirichlet Variational Autoencoder for Text Modeling

We introduce an improved variational autoencoder (VAE) for text modeling...
research
10/20/2020

Variational Dynamic Mixtures

Deep probabilistic time series forecasting models have become an integra...

Please sign up or login with your details

Forgot password? Click here to reset