Optimizing tail risks using an importance sampling based extrapolation for heavy-tailed objectives

by   Anand Deo, et al.

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a measure for tail risk in settings affected by uncertainty, we develop a new formula for approximating CVaR based optimization objectives and their gradients from limited samples. A key difficulty that limits the widespread practical use of these optimization formulations is the large amount of data required by the state-of-the-art sample average approximation schemes to approximate the CVaR objective with high fidelity. Unlike the state-of-the-art sample average approximations which require impractically large amounts of data in tail probability regions, the proposed approximation scheme exploits the self-similarity of heavy-tailed distributions to extrapolate data from suitable lower quantiles. The resulting approximations are shown to be statistically consistent and are amenable for optimization by means of conventional gradient descent. The approximation is guided by means of a systematic importance-sampling scheme whose asymptotic variance reduction properties are rigorously examined. Numerical experiments demonstrate the superiority of the proposed approximations and the ease of implementation points to the versatility of settings to which the approximation scheme can be applied.



page 1

page 2

page 3

page 4


Combining Retrospective Approximation with Importance Sampling for Optimising Conditional Value at Risk

This paper investigates the use of retrospective approximation solution ...

Efficient Black-Box Importance Sampling for VaR and CVaR Estimation

This paper considers Importance Sampling (IS) for the estimation of tail...

Policy Optimization Through Approximated Importance Sampling

Recent policy optimization approaches (Schulman et al., 2015a, 2017) hav...

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling

The recent growth in multi-fidelity uncertainty quantification has given...

Achieving Efficiency in Black Box Simulation of Distribution Tails with Self-structuring Importance Samplers

Motivated by the increasing adoption of models which facilitate greater ...

Optimizing the CVaR via Sampling

Conditional Value at Risk (CVaR) is a prominent risk measure that is bei...

Approximations to ultimate ruin probabilities with a Wienner process perturbation

In this paper, we adapt the classic Cramér-Lundberg collective risk theo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.