Optimizing tail risks using an importance sampling based extrapolation for heavy-tailed objectives

08/22/2020
by   Anand Deo, et al.
0

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a measure for tail risk in settings affected by uncertainty, we develop a new formula for approximating CVaR based optimization objectives and their gradients from limited samples. A key difficulty that limits the widespread practical use of these optimization formulations is the large amount of data required by the state-of-the-art sample average approximation schemes to approximate the CVaR objective with high fidelity. Unlike the state-of-the-art sample average approximations which require impractically large amounts of data in tail probability regions, the proposed approximation scheme exploits the self-similarity of heavy-tailed distributions to extrapolate data from suitable lower quantiles. The resulting approximations are shown to be statistically consistent and are amenable for optimization by means of conventional gradient descent. The approximation is guided by means of a systematic importance-sampling scheme whose asymptotic variance reduction properties are rigorously examined. Numerical experiments demonstrate the superiority of the proposed approximations and the ease of implementation points to the versatility of settings to which the approximation scheme can be applied.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2023

Importance Sampling for Minimization of Tail Risks: A Tutorial

This paper provides an introductory overview of how one may employ impor...
research
06/26/2022

Combining Retrospective Approximation with Importance Sampling for Optimising Conditional Value at Risk

This paper investigates the use of retrospective approximation solution ...
research
06/16/2021

Efficient Black-Box Importance Sampling for VaR and CVaR Estimation

This paper considers Importance Sampling (IS) for the estimation of tail...
research
10/09/2019

Policy Optimization Through Approximated Importance Sampling

Recent policy optimization approaches (Schulman et al., 2015a, 2017) hav...
research
01/07/2021

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling

The recent growth in multi-fidelity uncertainty quantification has given...
research
02/14/2021

Achieving Efficiency in Black Box Simulation of Distribution Tails with Self-structuring Importance Samplers

Motivated by the increasing adoption of models which facilitate greater ...
research
07/06/2021

Approximations to ultimate ruin probabilities with a Wienner process perturbation

In this paper, we adapt the classic Cramér-Lundberg collective risk theo...

Please sign up or login with your details

Forgot password? Click here to reset