Distributed Parameter Estimation via Pseudo-likelihood

06/27/2012
by   Qiang Liu, et al.
0

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on combining local estimators defined by pseudo-likelihood components, encompassing a number of combination methods, and provide both theoretical and experimental analysis. We show that simple linear combination or max-voting methods, when combined with second-order information, are statistically competitive with more advanced and costly joint optimization. Our algorithms have many attractive properties including low communication and computational cost and "any-time" behavior.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2018

A Distributed Second-Order Algorithm You Can Trust

Due to the rapid growth of data and computational resources, distributed...
research
08/01/2019

Optimized Transmission for Parameter Estimation in Wireless Sensor Networks

A central problem in analog wireless sensor networks is to design the ga...
research
07/03/2015

D-MFVI: Distributed Mean Field Variational Inference using Bregman ADMM

Bayesian models provide a framework for probabilistic modelling of compl...
research
07/22/2019

Practical Newton-Type Distributed Learning using Gradient Based Approximations

We study distributed algorithms for expected loss minimization where the...
research
03/23/2021

A Survey of Distributed Optimization Methods for Multi-Robot Systems

Distributed optimization consists of multiple computation nodes working ...
research
07/27/2010

Simple Max-Min Ant Systems and the Optimization of Linear Pseudo-Boolean Functions

With this paper, we contribute to the understanding of ant colony optimi...
research
04/05/2023

Batch mode active learning for efficient parameter estimation

For many tasks of data analysis, we may only have the information of the...

Please sign up or login with your details

Forgot password? Click here to reset