Frugal Splitting Operators: Representation, Minimal Lifting and Convergence

by   Martin Morin, et al.

We consider frugal splitting operators for finite sum monotone inclusion problems, i.e., splitting operators that use exactly one direct or resolvent evaluation of each operator of the sum. A novel representation of these operators in terms of what we call a generalized primal-dual resolvent is presented. This representation reveals a number of new results regarding lifting numbers, existence of solution maps, and parallelizability of the forward/backward evaluations. We show that the minimal lifting is n-1-f where n is the number of monotone operators and f is the number of direct evaluations in the splitting. Furthermore, we show that this lifting number is only achievable as long as the first and last evaluation are resolvent evaluations. In the case of frugal resolvent splitting operators, these results recovers the results of Ryu and Malitsky–Tam. The representation also enables a unified convergence analysis and we present a generally applicable theorem for the convergence and Fejér monotonicity of fixed point iterations of frugal splitting operators with cocoercive direct evaluations. We conclude by constructing a new convergent and parallelizable frugal splitting operator with minimal lifting.


page 1

page 2

page 3

page 4


Single-Forward-Step Projective Splitting: Exploiting Cocoercivity

This work describes a new variant of projective splitting in which cocoe...

A Tseng type stochastic forward-backward algorithm for monotone inclusions

In this paper, we propose a stochastic version of the classical Tseng's ...

Distributed Forward-Backward Methods without Central Coordination

In this work, we propose and analyse forward-backward-type algorithms fo...

Distributed GNE seeking under partial-decision information over networks via a doubly-augmented operator splitting approach

We consider distributed computation of generalized Nash equilibrium (GNE...

Variance-Reduced Proximal and Splitting Schemes for Monotone Stochastic Generalized Equations

We consider monotone inclusion problems where the operators may be expec...

On the Convergence of Tsetlin Machines for the IDENTITY- and NOT Operators

The Tsetlin Machine (TM) is a recent machine learning algorithm with sev...