Exponentially Fast Parameter Estimation in Networks Using Distributed Dual Averaging

09/10/2013
by   Shahin Shahrampour, et al.
0

In this paper we present an optimization-based view of distributed parameter estimation and observational social learning in networks. Agents receive a sequence of random, independent and identically distributed (i.i.d.) signals, each of which individually may not be informative about the underlying true state, but the signals together are globally informative enough to make the true state identifiable. Using an optimization-based characterization of Bayesian learning as proximal stochastic gradient descent (with Kullback-Leibler divergence from a prior as a proximal function), we show how to efficiently use a distributed, online variant of Nesterov's dual averaging method to solve the estimation with purely local information. When the true state is globally identifiable, and the network is connected, we prove that agents eventually learn the true parameter using a randomized gossip scheme. We demonstrate that with high probability the convergence is exponentially fast with a rate dependent on the KL divergence of observations under the true state from observations under the second likeliest state. Furthermore, our work also highlights the possibility of learning under continuous adaptation of network which is a consequence of employing constant, unit stepsize for the algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2016

Fast and Reliable Parameter Estimation from Nonlinear Observations

In this paper we study the problem of recovering a structured but unknow...
research
09/20/2019

Distributed Parameter Estimation in Randomized One-hidden-layer Neural Networks

This paper addresses distributed parameter estimation in randomized one-...
research
05/10/2015

Towards stability and optimality in stochastic gradient descent

Iterative procedures for parameter estimation based on stochastic gradie...
research
11/10/2016

Distributed Estimation and Learning over Heterogeneous Networks

We consider several estimation and learning problems that networked agen...
research
04/10/2017

Distributed Learning for Cooperative Inference

We study the problem of cooperative inference where a group of agents in...
research
09/30/2014

Distributed Detection : Finite-time Analysis and Impact of Network Topology

This paper addresses the problem of distributed detection in multi-agent...
research
03/11/2015

Switching to Learn

A network of agents attempt to learn some unknown state of the world dra...

Please sign up or login with your details

Forgot password? Click here to reset