A New Approach for Distributed Hypothesis Testing with Extensions to Byzantine-Resilience

03/14/2019
by   Aritra Mitra, et al.
0

We study a setting where a group of agents, each receiving partially informative private observations, seek to collaboratively learn the true state (among a set of hypotheses) that explains their joint observation profiles over time. To solve this problem, we propose a distributed learning rule that differs fundamentally from existing approaches, in the sense, that it does not employ any form of "belief-averaging". Specifically, every agent maintains a local belief (on each hypothesis) that is updated in a Bayesian manner without any network influence, and an actual belief that is updated (up to normalization) as the minimum of its own local belief and the actual beliefs of its neighbors. Under minimal requirements on the signal structures of the agents and the underlying communication graph, we establish consistency of the proposed belief update rule, i.e., we show that the actual beliefs of the agents asymptotically concentrate on the true state almost surely. As one of the key benefits of our approach, we show that our learning rule can be extended to scenarios that capture misbehavior on the part of certain agents in the network, modeled via the Byzantine adversary model. In particular, we prove that each non-adversarial agent can asymptotically learn the true state of the world almost surely, under appropriate conditions on the observation model and the network topology.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/05/2019

A New Approach to Distributed Hypothesis Testing and Non-Bayesian Learning: Improved Learning Rate and Byzantine-Resilience

We study a setting where a group of agents, each receiving partially inf...
research
02/14/2021

Communication-Efficient Distributed Cooperative Learning with Compressed Beliefs

We study the problem of distributed cooperative learning, where a group ...
research
09/04/2019

A Communication-Efficient Algorithm for Exponentially Fast Non-Bayesian Learning in Networks

We introduce a simple time-triggered protocol to achieve communication-e...
research
05/12/2017

Bayesian Group Decisions: Algorithms and Complexity

We address the computations that Bayesian agents undertake to realize th...
research
09/14/2015

Learning without Recall by Random Walks on Directed Graphs

We consider a network of agents that aim to learn some unknown state of ...
research
11/20/2020

A General Framework for Distributed Inference with Uncertain Models

This paper studies the problem of distributed classification with a netw...
research
09/09/2019

Non-Bayesian Social Learning with Uncertain Models

Non-Bayesian social learning theory provides a framework that models dis...

Please sign up or login with your details

Forgot password? Click here to reset