Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

01/28/2021
by   Kashif Rasul, et al.
15

In this work, we propose TimeGrad, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion probabilistic models, a class of latent variable models closely connected to score matching and energy-based methods. Our model learns gradients by optimizing a variational bound on the data likelihood and at inference time converts white noise into a sample of the distribution of interest through a Markov chain using Langevin sampling. We demonstrate experimentally that the proposed autoregressive denoising diffusion model is the new state-of-the-art multivariate probabilistic forecasting method on real-world data sets with thousands of correlated dimensions. We hope that this method is a useful tool for practitioners and lays the foundation for future research in this area.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/19/2020

Denoising Diffusion Probabilistic Models

We present high quality image synthesis results using diffusion probabil...
01/21/2022

Random Noise vs State-of-the-Art Probabilistic Forecasting Methods : A Case Study on CRPS-Sum Discrimination Ability

The recent developments in the machine learning domain have enabled the ...
02/14/2020

Multi-variate Probabilistic Time Series Forecasting via Conditioned Normalizing Flows

Time series forecasting is often fundamental to scientific and engineeri...
06/18/2021

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models

Multivariate time series prediction has attracted a lot of attention bec...
05/16/2022

Multi-scale Attention Flow for Probabilistic Time Series Forecasting

The probability prediction of multivariate time series is a notoriously ...
01/04/2020

Bayesian Median Autoregression for Robust Time Series Forecasting

We develop a Bayesian median autoregressive (BayesMAR) model for time se...
06/07/2022

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models

Deep generative models have emerged as promising tools for detecting arb...