Communication efficient privacy-preserving distributed optimization using adaptive differential quantization

05/30/2021
by   Richard Heusdens, et al.
0

Privacy issues and communication cost are both major concerns in distributed optimization. There is often a trade-off between them because the encryption methods required for privacy-preservation often incur expensive communication bandwidth. To address this issue, we, in this paper, propose a quantization-based approach to achieve both communication efficient and privacy-preserving solutions in the context of distributed optimization. By deploying an adaptive differential quantization scheme, we allow each node in the network to achieve its optimum solution with a low communication cost while keeping its private data unrevealed. Additionally, the proposed approach is general and can be applied in various distributed optimization methods, such as the primal-dual method of multipliers (PDMM) and the alternating direction method of multipliers (ADMM). Moveover, we consider two widely used adversary models: passive and eavesdropping. Finally, we investigate the properties of the proposed approach using different applications and demonstrate its superior performance in terms of several parameters including accuracy, privacy, and communication cost.

READ FULL TEXT
research
04/29/2020

Privacy-Preserving Distributed Optimization via Subspace Perturbation: A General Framework

As the modern world becomes increasingly digitized and interconnected, d...
research
02/16/2019

On Privacy-preserving Decentralized Optimization through Alternating Direction Method of Multipliers

Privacy concerns with sensitive data in machine learning are receiving i...
research
03/24/2020

Privacy-preserving Incremental ADMM for Decentralized Consensus Optimization

The alternating direction method of multipliers (ADMM) has been recently...
research
04/26/2023

Killing Two Birds with One Stone: Quantization Achieves Privacy in Distributed Learning

Communication efficiency and privacy protection are two critical issues ...
research
02/28/2023

Differentially Private Distributed Convex Optimization

This paper considers distributed optimization (DO) where multiple agents...
research
08/01/2018

Privacy-Preserving Gossip Algorithms

We propose gossip algorithms that can preserve the sum of network values...
research
11/13/2019

Asynchronous Distributed Learning from Constraints

In this paper, the extension of the framework of Learning from Constrain...

Please sign up or login with your details

Forgot password? Click here to reset