DeepAI AI Chat
Log In Sign Up

Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data

by   Szymon Sacher, et al.

Latent variable models are becoming increasingly popular in economics for high-dimensional categorical data such as text and surveys. Often the resulting low-dimensional representations are plugged into downstream econometric models that ignore the statistical structure of the upstream model, which presents serious challenges for valid inference. We show how Hamiltonian Monte Carlo (HMC) implemented with parallelized automatic differentiation provides a computationally efficient, easy-to-code, and statistically robust solution for this problem. Via a series of applications, we show that modeling integrated structure can non-trivially affect inference and that HMC appears to markedly outperform current approaches to inference in integrated models.


page 8

page 40


Inference with Hamiltonian Sequential Monte Carlo Simulators

The paper proposes a new Monte-Carlo simulator combining the advantages ...

Hamiltonian Monte Carlo using an embedded Laplace approximation

Latent Gaussian models are a popular class of hierarchical models with a...

Dynamically rescaled Hamiltonian Monte Carlo for Bayesian Hierarchical Models

Dynamically rescaled Hamiltonian Monte Carlo (DRHMC) is introduced as a ...

Semi-Separable Hamiltonian Monte Carlo for Inference in Bayesian Hierarchical Models

Sampling from hierarchical Bayesian models is often difficult for MCMC m...

Reduced-dimensional Monte Carlo Maximum Likelihood for Latent Gaussian Random Field Models

Monte Carlo maximum likelihood (MCML) provides an elegant approach to fi...

CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators

We present CosmoPower-JAX, a JAX-based implementation of the CosmoPower ...

Hamiltonian zigzag accelerates large-scale inference for conditional dependencies between complex biological traits

Inferring dependencies between complex biological traits while accountin...