Single-Forward-Step Projective Splitting: Exploiting Cocoercivity

02/24/2019
by   Patrick R. Johnstone, et al.
0

This work describes a new variant of projective splitting in which cocoercive operators can be processed with a single forward step per iteration. This result establishes a symmetry between projective splitting algorithms, the classical forward-backward method, and Tseng's forward-backward-forward method. In a situation in which Lipschitz monotone operators require two forward steps within the projective splitting framework, cocoercive operators may now be processed with just one forward step. Symmetrically, Tseng's method requires two forward steps for a Lipschitz monotone operator and the forward-backward method requires only one for a cocoercive operator. Another symmetry is that the new procedure allows for larger stepsizes for cocoercive operators: bounded by 2β for a β-cocoercive operator, which is the same as the forward-backward method. We also develop a backtracking procedure for when the cocoercivity constant is unknown. The single forward step may be interpreted as a single step of the classical gradient method applied to solving the standard resolvent-type update in projective splitting, starting at the previous known point in the operator graph. Proving convergence of the algorithm requires some departures from the usual proof framework for projective splitting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/19/2018

Projective Splitting with Forward Steps: Asynchronous and Block-Iterative Operator Splitting

This work is concerned with the classical problem of finding a zero of a...
research
09/17/2018

Projective Splitting with Forward Steps only Requires Continuity

A recent innovation in projective splitting algorithms for monotone oper...
research
12/01/2021

Distributed Forward-Backward Methods without Central Coordination

In this work, we propose and analyse forward-backward-type algorithms fo...
research
06/22/2022

Frugal Splitting Operators: Representation, Minimal Lifting and Convergence

We consider frugal splitting operators for finite sum monotone inclusion...
research
02/08/2023

Extragradient-Type Methods with 𝒪(1/k) Convergence Rates for Co-Hypomonotone Inclusions

In this paper, we develop two “Nesterov's accelerated” variants of the w...
research
07/15/2021

Negative time splitting is stable

For high order (than two) in time operator-splitting methods applied to ...
research
11/17/2019

A preconditioned Forward-Backward method for partially separable SemiDefinite Programs

We present semi-decentralized and distributed algorithms, designed via a...

Please sign up or login with your details

Forgot password? Click here to reset