DeepAI
Log In Sign Up

Distributed Learning of Finite Gaussian Mixtures

10/20/2020
by   Qiong Zhang, et al.
0

Advances in information technology have led to extremely large datasets that are often kept in different storage centers. Existing statistical methods must be adapted to overcome the resulting computational obstacles while retaining statistical validity and efficiency. Split-and-conquer approaches have been applied in many areas, including quantile processes, regression analysis, principal eigenspaces, and exponential families. We study split-and-conquer approaches for the distributed learning of finite Gaussian mixtures. We recommend a reduction strategy and develop an effective MM algorithm. The new estimator is shown to be consistent and retains root-n consistency under some general conditions. Experiments based on simulated and real-world data show that the proposed split-and-conquer approach has comparable statistical performance with the global estimator based on the full dataset, if the latter is feasible. It can even slightly outperform the global estimator if the model assumption does not match the real-world data. It also has better statistical and computational performance than some existing methods.

READ FULL TEXT
01/06/2023

Optimal subsampling algorithm for composite quantile regression with distributed data

For massive data stored at multiple machines, we propose a distributed s...
12/02/2013

Families of Parsimonious Finite Mixtures of Regression Models

Finite mixtures of regression models offer a flexible framework for inve...
02/09/2021

Nonparametric C- and D-vine based quantile regression

Quantile regression is a field with steadily growing importance in stati...
07/03/2021

Minimum Wasserstein Distance Estimator under Finite Location-scale Mixtures

When a population exhibits heterogeneity, we often model it via a finite...
03/26/2018

Robust principal components for irregularly spaced longitudinal data

Consider longitudinal data x_ij, with i=1,...,n and j=1,...,p_i, where x...
06/22/2018

Removing the Curse of Superefficiency: an Effective Strategy For Distributed Computing in Isotonic Regression

We propose a strategy for computing the isotonic least-squares estimate ...