Neural Stochastic Dual Dynamic Programming

12/01/2021
by   Hanjun Dai, et al.
0

Stochastic dual dynamic programming (SDDP) is a state-of-the-art method for solving multi-stage stochastic optimization, widely used for modeling real-world process optimization tasks. Unfortunately, SDDP has a worst-case complexity that scales exponentially in the number of decision variables, which severely limits applicability to only low dimensional problems. To overcome this limitation, we extend SDDP by introducing a trainable neural model that learns to map problem instances to a piece-wise linear value function within intrinsic low-dimension space, which is architected specifically to interact with a base SDDP solver, so that can accelerate optimization performance on new instances. The proposed Neural Stochastic Dual Dynamic Programming (ν-SDDP) continually self-improves by solving successive problems. An empirical investigation demonstrates that ν-SDDP can significantly reduce problem solving cost without sacrificing solution quality over competitors such as SDDP and reinforcement learning algorithms, across a range of synthetic and real-world process optimization problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/16/2019

Complexity of Stochastic Dual Dynamic Programming

Stochastic dual dynamic programming is a cutting plane type algorithm fo...
research
03/28/2023

Numerical Methods for Convex Multistage Stochastic Optimization

Optimization problems involving sequential decisions in a stochastic env...
research
02/26/2019

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

Real-world problems of operations research are typically high-dimensiona...
research
12/07/2015

How to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies

Using deep neural nets as function approximator for reinforcement learni...
research
05/19/2022

DPER: Dynamic Programming for Exist-Random Stochastic SAT

In Bayesian inference, the maximum a posteriori (MAP) problem combines t...
research
08/29/2019

Adaptive Partition-based SDDP Algorithms for Multistage Stochastic Linear Programming

In this paper, we extend the adaptive partition-based approach for solvi...
research
01/01/2022

The Parametric Cost Function Approximation: A new approach for multistage stochastic programming

The most common approaches for solving multistage stochastic programming...

Please sign up or login with your details

Forgot password? Click here to reset