Mini-batch stochastic three-operator splitting for distributed optimization

03/08/2022
by   Barbara Franci, et al.
0

We consider a network of agents, each with its own private cost consisting of a sum of two possibly nonsmooth convex functions, one of which is composed with a linear operator. At every iteration each agent performs local calculations and can only communicate with its neighbors. The challenging aspect of our study is that the smooth part of the private cost function is given as an expected value and agents only have access to this part of the problem formulation via a heavy-tailed stochastic oracle. To tackle such sampling-based optimization problems, we propose a stochastic extension of the triangular pre-conditioned primal-dual algorithm. We demonstrate almost sure convergence of the scheme and validate the performance of the method via numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2022

Stochastic Primal-Dual Three Operator Splitting with Arbitrary Sampling and Preconditioning

In this work we propose a stochastic primal-dual preconditioned three-op...
research
06/15/2020

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

This work studies multi-agent sharing optimization problems with the obj...
research
04/09/2019

Gradient-Free Multi-Agent Nonconvex Nonsmooth Optimization

In this paper, we consider the problem of minimizing the sum of nonconve...
research
05/27/2018

Distributed Big-Data Optimization via Block Communications

We study distributed multi-agent large-scale optimization problems, wher...
research
04/03/2020

Dualize, Split, Randomize: Fast Nonsmooth Optimization Algorithms

We introduce a new primal-dual algorithm for minimizing the sum of three...
research
05/31/2019

Distributed Submodular Minimization via Block-Wise Updates and Communications

In this paper we deal with a network of computing agents with local proc...
research
05/28/2019

AsymDPOP: Complete Inference for Asymmetric Distributed Constraint Optimization Problems

Asymmetric distributed constraint optimization problems (ADCOPs) are an ...

Please sign up or login with your details

Forgot password? Click here to reset