Solving Multistage Stochastic Linear Programming via Regularized Linear Decision Rules: An Application to Hydrothermal Dispatch Planning

10/07/2021
by   Felipe Nazare, et al.
0

The solution of multistage stochastic linear problems (MSLP) represents a challenge for many applications. Long-term hydrothermal dispatch planning (LHDP) materializes this challenge in a real-world problem that affects electricity markets, economies, and natural resources worldwide. No closed-form solutions are available for MSLP and the definition of non-anticipative policies with high-quality out-of-sample performance is crucial. Linear decision rules (LDR) provide an interesting simulation-based framework for finding high-quality policies to MSLP through two-stage stochastic models. In practical applications, however, the number of parameters to be estimated when using an LDR may be close or higher than the number of scenarios, thereby generating an in-sample overfit and poor performances in out-of-sample simulations. In this paper, we propose a novel regularization scheme for LDR based on the AdaLASSO (adaptive least absolute shrinkage and selection operator). The goal is to use the parsimony principle as largely studied in high-dimensional linear regression models to obtain better out-of-sample performance for an LDR applied to MSLP. Computational experiments show that the overfit threat is non-negligible when using the classical non-regularized LDR to solve MSLP. For the LHDP problem, our analysis highlights the following benefits of the proposed framework in comparison to the non-regularized benchmark: 1) significant reductions in the number of non-zero coefficients (model parsimony), 2) substantial cost reductions in out-of-sample evaluations, and 3) improved spot-price profiles.

READ FULL TEXT
research
01/19/2019

Tuning parameter selection rules for nuclear norm regularized multivariate linear regression

We consider the tuning parameter selection rules for nuclear norm regula...
research
05/20/2022

Neur2SP: Neural Two-Stage Stochastic Programming

Stochastic programming is a powerful modeling framework for decision-mak...
research
07/28/2014

Efficient Regularized Regression for Variable Selection with L0 Penalty

Variable (feature, gene, model, which we use interchangeably) selections...
research
03/16/2023

Error analysis of regularized trigonometric linear regression with unbounded sampling: a statistical learning viewpoint

The effectiveness of non-parametric, kernel-based methods for function e...
research
09/19/2022

Finite- and Large- Sample Inference for Model and Coefficients in High-dimensional Linear Regression with Repro Samples

In this paper, we present a new and effective simulation-based approach ...
research
12/30/2018

Allocation strategies for high fidelity models in the multifidelity regime

We propose a novel approach to allocating resources for expensive simula...

Please sign up or login with your details

Forgot password? Click here to reset