Estimate Exchange over Network is Good for Distributed Hard Thresholding Pursuit

09/22/2017
by   Ahmed Zaki, et al.
0

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of intermediate estimates over the network requires a limited communication overhead for information transmission. Our objective in this article is to show that the strategy is good for learning in spite of limited communication. In pursuit of this objective, we first provide a restricted isometry property (RIP)-based theoretical analysis on convergence of the iterative algorithm. Then, using simulations, we show that the algorithm provides competitive performance in learning sparse signals vis-a-vis an existing alternate distributed algorithm. The alternate distributed algorithm exchanges more information including observations and system parameters.

READ FULL TEXT
research
03/31/2018

Locally Convex Sparse Learning over Networks

We consider a distributed learning setup where a sparse signal is estima...
research
04/23/2018

Deterministic and Randomized Diffusion based Iterative Generalized Hard Thresholding (DiFIGHT) for Distributed Sparse Signal Recovery

In this paper, we propose a distributed iterated hard thresholding algor...
research
12/31/2020

Federated Nonconvex Sparse Learning

Nonconvex sparse learning plays an essential role in many areas, such as...
research
12/06/2022

Deep Neural Networks Based on Iterative Thresholding and Projection Algorithms for Sparse LQR Control Design

In this paper, we consider an LQR design problem for distributed control...
research
06/14/2011

Orthogonal Matching Pursuit with Replacement

In this paper, we consider the problem of compressed sensing where the g...
research
09/15/2022

Distributed Sparse Linear Regression with Sublinear Communication

We study the problem of high-dimensional sparse linear regression in a d...
research
02/21/2019

Performance study of distributed Apriori-like frequent itemsets mining

In this article, we focus on distributed Apriori-based frequent itemsets...

Please sign up or login with your details

Forgot password? Click here to reset