High Dimensional Expectation-Maximization Algorithm: Statistical Optimization and Asymptotic Normality

12/30/2014
by   Zhaoran Wang, et al.
0

We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM algorithm which naturally incorporates sparsity structure into parameter estimation. With an appropriate initialization, this algorithm converges at a geometric rate and attains an estimator with the (near-)optimal statistical rate of convergence. (ii) Based on the obtained estimator, we propose new inferential procedures for testing hypotheses and constructing confidence intervals for low dimensional components of high dimensional parameters. For a broad family of statistical models, our framework establishes the first computationally feasible approach for optimal estimation and asymptotic inference in high dimensions. Our theory is supported by thorough numerical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/19/2020

Robust High Dimensional Expectation Maximization Algorithm via Trimmed Hard Thresholding

In this paper, we study the problem of estimating latent variable models...
research
11/14/2015

Sparse Nonlinear Regression: Parameter Estimation and Asymptotic Inference

We study parameter estimation and asymptotic inference for sparse nonlin...
research
10/14/2022

Estimation of High-Dimensional Markov-Switching VAR Models with an Approximate EM Algorithm

Regime shifts in high-dimensional time series arise naturally in many ap...
research
02/05/2015

Provable Sparse Tensor Decomposition

We propose a novel sparse tensor decomposition method, namely Tensor Tru...
research
12/16/2014

Testing and Confidence Intervals for High Dimensional Proportional Hazards Model

This paper proposes a decorrelation-based approach to test hypotheses an...
research
08/10/2013

High-Dimensional Regression with Gaussian Mixtures and Partially-Latent Response Variables

In this work we address the problem of approximating high-dimensional da...
research
02/24/2023

Asymptotic convergence of iterative optimization algorithms

This paper introduces a general framework for iterative optimization alg...

Please sign up or login with your details

Forgot password? Click here to reset