Computation for Latent Variable Model Estimation: A Unified Stochastic Proximal Framework

08/17/2020
by   Siliang Zhang, et al.
0

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of many latent variables, (2) the observed and latent variables being continuous, discrete, or a combination of both, (3) constraints on parameters, and (4) penalties on parameters to impose model parsimony. The estimation often involves maximizing an objective function based on a marginal likelihood/pseudo-likelihood, possibly with constraints and/or penalties on parameters. Solving this optimization problem is highly non-trivial, due to the complexities brought by the features mentioned above. Although several efficient algorithms have been proposed, there lacks a unified computational framework that takes all these features into account. In this paper, we fill the gap. Specifically, we provide a unified formulation for the optimization problem and then propose a quasi-Newton stochastic proximal algorithm. Theoretical properties of the proposed algorithms are established. The computational efficiency and robustness are shown by simulation studies under various settings for latent variable model estimation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2020

Truncated Inference for Latent Variable Optimization Problems: Application to Robust Estimation and Learning

Optimization problems with an auxiliary latent variable structure in add...
research
03/28/2023

Two-step estimation of latent trait models

We consider two-step estimation of latent variable models, in which just...
research
06/22/2023

Efficient preconditioned stochastic gradient descent for estimation in latent variable models

Latent variable models are powerful tools for modeling complex phenomena...
research
03/28/2018

Pseudo-marginal Bayesian inference for supervised Gaussian process latent variable models

We introduce a Bayesian framework for inference with a supervised versio...
research
07/06/2021

Fast, universal estimation of latent variable models using extended variational approximations

Generalized linear latent variable models (GLLVMs) are a class of method...
research
02/26/2020

Hierarchical clustering with discrete latent variable models and the integrated classification likelihood

In this paper, we introduce a two step methodology to extract a hierarch...
research
06/14/2016

Recursive nonlinear-system identification using latent variables

In this paper we develop a method for learning nonlinear systems with mu...

Please sign up or login with your details

Forgot password? Click here to reset