Randomized Progressive Hedging methods for Multi-stage Stochastic Programming

09/25/2020
by   Gilles Bareilles, et al.
0

Progressive Hedging is a popular decomposition algorithm for solving multi-stage stochastic optimization problems. A computational bottleneck of this algorithm is that all scenario subproblems have to be solved at each iteration. In this paper, we introduce randomized versions of the Progressive Hedging algorithm able to produce new iterates as soon as a single scenario subproblem is solved. Building on the relation between Progressive Hedging and monotone operators, we leverage recent results on randomized fixed point methods to derive and analyze the proposed methods. Finally, we release the corresponding code as an easy-to-use Julia toolbox and report computational experiments showing the practical interest of randomized algorithms, notably in a parallel context. Throughout the paper, we pay a special attention to presentation, stressing main ideas, avoiding extra-technicalities, in order to make the randomized methods accessible to a broad audience in the Operations Research community.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2018

Accelerated Gossip via Stochastic Heavy Ball Method

In this paper we show how the stochastic heavy ball method (SHB) -- a po...
research
03/19/2019

Convergence Analysis of Inexact Randomized Iterative Methods

In this paper we present a convergence rate analysis of inexact variants...
research
04/17/2020

Application of Progressive Hedging to Var Expansion Planning Under Uncertainty

This paper describes the application of a Progressive Hedging (PH) algor...
research
06/06/2023

Understanding Progressive Training Through the Framework of Randomized Coordinate Descent

We propose a Randomized Progressive Training algorithm (RPT) – a stochas...
research
12/16/2019

Complexity of Stochastic Dual Dynamic Programming

Stochastic dual dynamic programming is a cutting plane type algorithm fo...
research
04/03/2019

Progressive Stochastic Binarization of Deep Networks

A plethora of recent research has focused on improving the memory footpr...
research
05/14/2020

A new WENO-2r algorithm with progressive order of accuracy close to discontinuities

In this article we present a modification of the algorithm for data disc...

Please sign up or login with your details

Forgot password? Click here to reset