Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry

03/28/2017
by   Guillaume Garrigos, et al.
0

We provide a comprehensive study of the convergence of forward-backward algorithm under suitable geometric conditions leading to fast rates. We present several new results and collect in a unified view a variety of results scattered in the literature, often providing simplified proofs. Novel contributions include the analysis of infinite dimensional convex minimization problems, allowing the case where minimizers might not exist. Further, we analyze the relation between different geometric conditions, and discuss novel connections with a priori conditions in linear inverse problems, including source conditions, restricted isometry properties and partial smoothness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2016

Further properties of the forward-backward envelope with applications to difference-of-convex programming

In this paper, we further study the forward-backward envelope first intr...
research
03/19/2021

Forward and Backward Bellman equations improve the efficiency of EM algorithm for DEC-POMDP

Decentralized partially observable Markov decision process (DEC-POMDP) m...
research
11/09/2022

Limit theorems for forward and backward processes of numbers of non-empty urns in infinite urn schemes

We study the joint asymptotics of forward and backward processes of numb...
research
07/21/2022

Convergence analysis of multi-step one-shot methods for linear inverse problems

In this work we are interested in general linear inverse problems where ...
research
11/25/2022

Mixture Manifold Networks: A Computationally Efficient Baseline for Inverse Modeling

We propose and show the efficacy of a new method to address generic inve...
research
05/28/2020

Variational regularisation for inverse problems with imperfect forward operators and general noise models

We study variational regularisation methods for inverse problems with im...
research
02/14/2019

Geometry of Arimoto Algorithm

This paper aims to reveal information geometric structure of Arimoto alg...

Please sign up or login with your details

Forgot password? Click here to reset