Scaling Bayesian inference of mixed multinomial logit models to very large datasets

04/11/2020
by   Filipe Rodrigues, et al.
0

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC) methods without compromising accuracy. However, despite their demonstrated efficiency gains, existing methods still suffer from important limitations that prevent them to scale to very large datasets, while providing the flexibility to allow for rich prior distributions and to capture complex posterior distributions. In this paper, we propose an Amortized Variational Inference approach that leverages stochastic backpropagation, automatic differentiation and GPU-accelerated computation, for effectively scaling Bayesian inference in Mixed Multinomial Logit models to very large datasets. Moreover, we show how normalizing flows can be used to increase the flexibility of the variational posterior approximations. Through an extensive simulation study, we empirically show that the proposed approach is able to achieve computational speedups of multiple orders of magnitude over traditional MSLE and MCMC approaches for large datasets without compromising estimation accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/10/2018

Bayesian variational inference for exponential random graph models

Bayesian inference for exponential random graphs (ERGMs) is a doubly int...
research
02/24/2023

A Targeted Accuracy Diagnostic for Variational Approximations

Variational Inference (VI) is an attractive alternative to Markov Chain ...
research
02/18/2021

The Variational Bayesian Inference for Network Autoregression Models

We develop a variational Bayesian (VB) approach for estimating large-sca...
research
05/19/2022

Variational Inference for Bayesian Bridge Regression

We study the implementation of Automatic Differentiation Variational inf...
research
07/05/2022

Variational Inference of Dynamic Factor Models with Arbitrary Missing Data

Dynamic factor models are often estimated by point-estimation methods, d...
research
02/16/2016

Patterns of Scalable Bayesian Inference

Datasets are growing not just in size but in complexity, creating a dema...
research
05/31/2022

Variational inference via Wasserstein gradient flows

Along with Markov chain Monte Carlo (MCMC) methods, variational inferenc...

Please sign up or login with your details

Forgot password? Click here to reset