Heavy-Tailed Density Estimation

11/16/2022
by   Surya T. Tokdar, et al.
0

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the tail of the distribution getting washed away by unrelated features of a hefty bulk. The proposed Bayesian method avoids this problem by incorporating smoothness and tail regularization through a carefully specified semiparametric prior distribution, and is able to consistently estimate both the density function and its tail index at near minimax optimal rates of contraction. A joint, likelihood driven estimation of the bulk and the tail is shown to help improve uncertainty assessment in estimating the tail index parameter and offer more accurate and reliable estimates of the high tail quantiles compared to thresholding methods.

READ FULL TEXT
research
10/06/2020

Testing Tail Weight of a Distribution Via Hazard Rate

Understanding the shape of a distribution of data is of interest to peop...
research
04/26/2022

An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate

A particular direction of recent advance about stochastic deep-learning ...
research
05/12/2019

The compound product distribution; a solution to the distributional equation X=AX+1

The solution of X=AX+1 is analyzed for a discrete variable A with P...
research
05/07/2023

Affine equivariant Tyler's M-estimator applied to tail parameter learning of elliptical distributions

We propose estimating the scale parameter (mean of the eigenvalues) of t...
research
06/14/2018

On the heavy-tail behavior of the distributionally robust newsvendor

Since the seminal work of Scarf (1958) [A min-max solution of an invento...
research
08/09/2023

Heavy-tailed Bayesian nonparametric adaptation

We propose a new Bayesian strategy for adaptation to smoothness in nonpa...
research
06/15/2023

A Heavy-Tailed Algebra for Probabilistic Programming

Despite the successes of probabilistic models based on passing noise thr...

Please sign up or login with your details

Forgot password? Click here to reset