Quantized Decentralized Consensus Optimization

06/29/2018
by   Amirhossein Reisizadeh, et al.
0

We consider the problem of decentralized consensus optimization, where the sum of n convex functions are minimized over n distributed agents that form a connected network. In particular, we consider the case that the communicated local decision variables among nodes are quantized in order to alleviate the communication bottleneck in distributed optimization. We propose the Quantized Decentralized Gradient Descent (QDGD) algorithm, in which nodes update their local decision variables by combining the quantized information received from their neighbors with their local information. We prove that under standard strong convexity and smoothness assumptions for the objective function, QDGD achieves a vanishing mean solution error. To the best of our knowledge, this is the first algorithm that achieves vanishing consensus error in the presence of quantization noise. Moreover, we provide simulation results that show tight agreement between our derived theoretical convergence rate and the experimental results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2020

Quantized Push-sum for Gossip and Decentralized Optimization over Directed Graphs

We consider a decentralized stochastic learning problem where data point...
research
09/06/2023

Adaptive Consensus: A network pruning approach for decentralized optimization

We consider network-based decentralized optimization problems, where eac...
research
10/25/2022

An Optimal Stochastic Algorithm for Decentralized Nonconvex Finite-sum Optimization

This paper studies the synchronized decentralized nonconvex optimization...
research
09/14/2020

Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM

In this paper, we propose a communication-efficiently decentralized mach...
research
06/01/2023

Dynamic quantized consensus under DoS attacks: Towards a tight zooming-out factor

This paper deals with dynamic quantized consensus of dynamical agents in...
research
02/01/2021

Distributed Zero-Order Optimization under Adversarial Noise

We study the problem of distributed zero-order optimization for a class ...
research
09/16/2022

Quantization for decentralized learning under subspace constraints

In this paper, we consider decentralized optimization problems where age...

Please sign up or login with your details

Forgot password? Click here to reset