Global Convergence of Least Squares EM for Demixing Two Log-Concave Densities

06/16/2019
by   Wei Qian, et al.
0

This work studies the location estimation problem for a mixture of two rotation invariant log-concave densities. We demonstrate that Least Squares EM, a variant of the EM algorithm, converges to the true location parameter from a randomly initialized point. We establish the explicit convergence rates and sample complexity bounds, revealing their dependence on the signal-to-noise ratio and the tail property of the log-concave distribution. Moreover, we show that this global convergence property is robust under model mis-specification. Our analysis generalizes previous techniques for proving the convergence results of Gaussian mixtures, and highlights that an angle-decreasing property is sufficient for establishing global convergence for Least Squares EM.

READ FULL TEXT
research
05/28/2019

EM Converges for a Mixture of Many Linear Regressions

We study the convergence of the Expectation-Maximization (EM) algorithm ...
research
02/28/2018

Near-Optimal Sample Complexity Bounds for Maximum Likelihood Estimation of Multivariate Log-concave Densities

We study the problem of learning multivariate log-concave densities with...
research
02/21/2023

Contraction and Convergence Rates for Discretized Kinetic Langevin Dynamics

We provide a framework to prove convergence rates for discretizations of...
research
03/18/2019

Bi-log-concavity: some properties and some remarks towards a multi-dimensional extension

Bi-log-concavity of probability measures is a univariate extension of th...
research
06/04/2020

On the Minimax Optimality of the EM Algorithm for Learning Two-Component Mixed Linear Regression

We study the convergence rates of the EM algorithm for learning two-comp...
research
10/01/2018

Singularity, Misspecification, and the Convergence Rate of EM

A line of recent work has characterized the behavior of the EM algorithm...
research
07/25/2020

Fair Marriage Principle and Initialization Map for the EM Algorithm

The popular convergence theory of the EM algorithm explains that the obs...

Please sign up or login with your details

Forgot password? Click here to reset