Fitting latent non-Gaussian models using variational Bayes and Laplace approximations

11/20/2022
by   Rafael Cabral, et al.
0

Latent Gaussian models (LGMs) are perhaps the most commonly used class of models in statistical applications. Nevertheless, in areas ranging from longitudinal studies in biostatistics to geostatistics, it is easy to find datasets that contain inherently non-Gaussian features, such as sudden jumps or spikes, that adversely affect the inferences and predictions made from an LGM. These datasets require more general latent non-Gaussian models (LnGMs) that can handle these non-Gaussian features automatically. However, fast implementation and easy-to-use software are lacking, which prevent LnGMs from becoming widely applicable. In this paper, we derive variational Bayes algorithms for fast and scalable inference of LnGMs. The approximation leads to an LGM that downweights extreme events in the latent process, reducing their impact and leading to more robust inferences. It can be applied to a wide range of models, such as autoregressive processes for time series, simultaneous autoregressive models for areal data, and spatial Matérn models. To facilitate Bayesian inference, we introduce the ngvb package, where LGMs implemented in R-INLA can be easily extended to LnGMs by adding a single line of code.

READ FULL TEXT

page 12

page 15

page 17

research
03/12/2021

Fast, Scalable Approximations to Posterior Distributions in Extended Latent Gaussian Models

We define a novel class of additive models called Extended Latent Gaussi...
research
03/01/2021

A practical tutorial on Variational Bayes

This tutorial gives a quick introduction to Variational Bayes (VB), also...
research
01/21/2021

bssm: Bayesian Inference of Non-linear and Non-Gaussian State Space Models in R

We present an R package bssm for Bayesian non-linear/non-Gaussian state ...
research
06/05/2013

Fast Dual Variational Inference for Non-Conjugate LGMs

Latent Gaussian models (LGMs) are widely used in statistics and machine ...
research
12/25/2017

On Statistical Optimality of Variational Bayes

The article addresses a long-standing open problem on the justification ...
research
03/10/2022

Controlling the flexibility of non-Gaussian processes through shrinkage priors

The normal inverse Gaussian (NIG) and generalized asymmetric Laplace (GA...
research
03/16/2023

Variational Bayes Inference of Survival Data using Log-logistic Accelerated Failure Time Model

The log-logistic regression model is one of the most commonly used accel...

Please sign up or login with your details

Forgot password? Click here to reset