A review of distributed statistical inference

04/13/2023
by   Yuan Gao, et al.
0

The rapid emergence of massive datasets in various fields poses a serious challenge to traditional statistical methods. Meanwhile, it provides opportunities for researchers to develop novel algorithms. Inspired by the idea of divide-and-conquer, various distributed frameworks for statistical estimation and inference have been proposed. They were developed to deal with large-scale statistical optimization problems. This paper aims to provide a comprehensive review for related literature. It includes parametric models, nonparametric models, and other frequently used models. Their key ideas and theoretical properties are summarized. The trade-off between communication cost and estimate precision together with other concerns are discussed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/07/2017

InferSpark: Statistical Inference at Scale

The Apache Spark stack has enabled fast large-scale data processing. Des...
research
12/19/2020

Fiducial inference then and now

We conduct a review of the fiducial approach to statistical inference, f...
research
05/29/2018

Distributed Statistical Inference for Massive Data

This paper considers distributed statistical inference for general symme...
research
10/06/2021

Hypothesis Testing of One-Sample Mean Vector in Distributed Frameworks

Distributed frameworks are widely used to handle massive data, where sam...
research
10/15/2022

Distributed Estimation and Inference for Semi-parametric Binary Response Models

The development of modern technology has enabled data collection of unpr...
research
08/16/2021

Harris hawks optimization: a comprehensive review of recent variants and applications

Harris hawks optimizer (HHO) has received widespread attention among res...
research
06/27/2020

Bridging Parametric and Nonparametric Methods in Cognitive Diagnosis

A number of parametric and nonparametric methods for estimating cognitiv...

Please sign up or login with your details

Forgot password? Click here to reset