On the EM-Tau algorithm: a new EM-style algorithm with partial E-steps

11/21/2017
by   Val Andrei Fajardo, et al.
0

The EM algorithm is one of many important tools in the field of statistics. While often used for imputing missing data, its widespread applications include other common statistical tasks, such as clustering. In clustering, the EM algorithm assumes a parametric distribution for the clusters, whose parameters are estimated through a novel iterative procedure that is based on the theory of maximum likelihood. However, one major drawback of the EM algorithm, that renders it impractical especially when working with large datasets, is that it often requires several passes of the data before convergence. In this paper, we introduce a new EM-style algorithm that implements a novel policy for performing partial E-steps. We call the new algorithm the EM-Tau algorithm, which can approximate the traditional EM algorithm with high accuracy but with only a fraction of the running time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2021

Efficient Algorithms for Estimating the Parameters of Mixed Linear Regression Models

Mixed linear regression (MLR) model is among the most exemplary statisti...
research
11/21/2018

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems

The Stochastic Approximation EM (SAEM) algorithm, a variant stochastic a...
research
12/24/2017

Efficient data augmentation techniques for Gaussian state space models

We propose a data augmentation scheme for improving the rate of converge...
research
11/13/2021

A Hybrid EM Algorithm for Linear Two-Way Interactions with Missing Data

We study an EM algorithm for estimating product-term regression models w...
research
07/05/2018

The em-convex rewrite system

We introduce and study em (or "emergent"), a lambda calculus style rewri...
research
02/14/2023

Minimization on mixture family

Iterative minimization algorithms appear in various areas including mach...
research
02/14/2019

Geometry of Arimoto Algorithm

This paper aims to reveal information geometric structure of Arimoto alg...

Please sign up or login with your details

Forgot password? Click here to reset