Noisy Expectation-Maximization: Applications and Generalizations

01/12/2018
by   Osonde Osoba, et al.
0

We present a noise-injected version of the Expectation-Maximization (EM) algorithm: the Noisy Expectation Maximization (NEM) algorithm. The NEM algorithm uses noise to speed up the convergence of the EM algorithm. The NEM theorem shows that injected noise speeds up the average convergence of the EM algorithm to a local maximum of the likelihood surface if a positivity condition holds. The generalized form of the noisy expectation-maximization (NEM) algorithm allow for arbitrary modes of noise injection including adding and multiplying noise to the data. We demonstrate these noise benefits on EM algorithms for the Gaussian mixture model (GMM) with both additive and multiplicative NEM noise injection. A separate theorem (not presented here) shows that the noise benefit for independent identically distributed additive noise decreases with sample size in mixture models. This theorem implies that the noise benefit is most pronounced if the data is sparse. Injecting blind noise only slowed convergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2013

An Improved EM algorithm

In this paper, we firstly give a brief introduction of expectation maxim...
research
11/24/2014

Noise Benefits in Expectation-Maximization Algorithms

This dissertation shows that careful injection of noise into sample data...
research
10/24/2017

Distributed estimation from relative measurements of heterogeneous and uncertain quality

This paper studies the problem of estimation from relative measurements ...
research
11/05/2017

Robust Expectation-Maximization Algorithm for DOA Estimation of Acoustic Sources in the Spherical Harmonic Domain

The direction of arrival (DOA) estimation of sound sources has been a po...
research
03/08/2019

General Convolutional Sparse Coding with Unknown Noise

Convolutional sparse coding (CSC) can learn representative shift-invaria...
research
10/26/2018

From the EM Algorithm to the CM-EM Algorithm for Global Convergence of Mixture Models

The Expectation-Maximization (EM) algorithm for mixture models often res...
research
01/03/2022

Multiview point cloud registration with anisotropic and space-varying localization noise

In this paper, we address the problem of registering multiple point clou...

Please sign up or login with your details

Forgot password? Click here to reset