Decentralized Statistical Inference with Unrolled Graph Neural Networks

04/04/2021
by   Yifei Shen, et al.
2

In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatch and poor convergence speed, and thus their performance would be degraded, provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2023

IMA-GNN: In-Memory Acceleration of Centralized and Decentralized Graph Neural Networks at the Edge

In this paper, we propose IMA-GNN as an In-Memory Accelerator for centra...
research
01/23/2023

Graph Neural Networks for Decentralized Multi-Agent Perimeter Defense

In this work, we study the problem of decentralized multi-agent perimete...
research
09/24/2022

Learning Decentralized Strategies for a Perimeter Defense Game with Graph Neural Networks

We consider the problem of finding decentralized strategies for multi-ag...
research
06/11/2020

Wide and Deep Graph Neural Networks with Distributed Online Learning

Graph neural networks (GNNs) learn representations from network data wit...
research
03/13/2020

Automating Botnet Detection with Graph Neural Networks

Botnets are now a major source for many network attacks, such as DDoS at...
research
06/17/2019

On linear convergence of two decentralized algorithms

Decentralized algorithms solve multi-agent problems over a connected net...
research
04/27/2020

Eliminating NB-IoT Interference to LTE System: a Sparse Machine Learning Based Approach

Narrowband internet-of-things (NB-IoT) is a competitive 5G technology fo...

Please sign up or login with your details

Forgot password? Click here to reset