Importance Sampling for Minimization of Tail Risks: A Tutorial

07/10/2023
by   Anand Deo, et al.
0

This paper provides an introductory overview of how one may employ importance sampling effectively as a tool for solving stochastic optimization formulations incorporating tail risk measures such as Conditional Value-at-Risk. Approximating the tail risk measure by its sample average approximation, while appealing due to its simplicity and universality in use, requires a large number of samples to be able to arrive at risk-minimizing decisions with high confidence. This is primarily due to the rarity with which the relevant tail events get observed in the samples. In simulation, Importance Sampling is among the most prominent methods for substantially reducing the sample requirement while estimating probabilities of rare events. Can importance sampling be used for optimization as well? If so, what are the ingredients required for making importance sampling an effective tool for optimization formulations involving rare events? This tutorial aims to provide an introductory overview of the two key ingredients in this regard, namely, (i) how one may arrive at an importance sampling change of measure prescription at every decision, and (ii) the prominent techniques available for integrating such a prescription within a solution paradigm for stochastic optimization formulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2022

Combining Retrospective Approximation with Importance Sampling for Optimising Conditional Value at Risk

This paper investigates the use of retrospective approximation solution ...
research
08/22/2020

Optimizing tail risks using an importance sampling based extrapolation for heavy-tailed objectives

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a mea...
research
06/16/2021

Efficient Black-Box Importance Sampling for VaR and CVaR Estimation

This paper considers Importance Sampling (IS) for the estimation of tail...
research
05/25/2018

Importance sampling for slow-fast diffusions based on moderate deviations

We consider systems of slow-fast diffusions with small noise in the slow...
research
10/27/2021

How Important is Importance Sampling for Deep Budgeted Training?

Long iterative training processes for Deep Neural Networks (DNNs) are co...
research
05/03/2022

Quantifying rare events in spotting: How far do wildfires spread?

Spotting refers to the transport of burning pieces of firebrand by wind ...
research
08/27/2023

Uncertainty-aware Risk Assessment of Robotic Systems via Importance Sampling

In this paper, we introduce a probabilistic approach to risk assessment ...

Please sign up or login with your details

Forgot password? Click here to reset