Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

by   Kashif Rasul, et al.

In this work, we propose TimeGrad, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion probabilistic models, a class of latent variable models closely connected to score matching and energy-based methods. Our model learns gradients by optimizing a variational bound on the data likelihood and at inference time converts white noise into a sample of the distribution of interest through a Markov chain using Langevin sampling. We demonstrate experimentally that the proposed autoregressive denoising diffusion model is the new state-of-the-art multivariate probabilistic forecasting method on real-world data sets with thousands of correlated dimensions. We hope that this method is a useful tool for practitioners and lays the foundation for future research in this area.


page 1

page 2

page 3

page 4


Denoising Diffusion Probabilistic Models

We present high quality image synthesis results using diffusion probabil...

Random Noise vs State-of-the-Art Probabilistic Forecasting Methods : A Case Study on CRPS-Sum Discrimination Ability

The recent developments in the machine learning domain have enabled the ...

Multi-variate Probabilistic Time Series Forecasting via Conditioned Normalizing Flows

Time series forecasting is often fundamental to scientific and engineeri...

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models

Multivariate time series prediction has attracted a lot of attention bec...

Multi-scale Attention Flow for Probabilistic Time Series Forecasting

The probability prediction of multivariate time series is a notoriously ...

Bayesian Median Autoregression for Robust Time Series Forecasting

We develop a Bayesian median autoregressive (BayesMAR) model for time se...

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models

Deep generative models have emerged as promising tools for detecting arb...