Density Estimation using Entropy Maximization for Semi-continuous Data

11/17/2020
by   Sai K. Popuri, et al.
0

Semi-continuous data comes from a distribution that is a mixture of the point mass at zero and a continuous distribution with support on the positive real line. A clear example is the daily rainfall data. In this paper, we present a novel algorithm to estimate the density function for semi-continuous data using the principle of maximum entropy. Unlike existing methods in the literature, our algorithm needs only the sample values of the constraint functions in the entropy maximization problem and does not need the entire sample. Using simulations, we show that the estimate of the entropy produced by our algorithm has significantly less bias compared to existing methods. An application to the daily rainfall data is provided.

READ FULL TEXT
research
10/08/2020

Mixture-based estimation of entropy

The entropy is a measure of uncertainty that plays a central role in inf...
research
06/09/2020

AR-DAE: Towards Unbiased Neural Entropy Gradient Estimation

Entropy is ubiquitous in machine learning, but it is in general intracta...
research
01/27/2019

A computational method for estimating Burr XII parameters with complete and multiple censored data

Flexibility in shape and scale of Burr XII distribution can make close a...
research
03/12/2022

Maximization of Mathai's Entropy under the Constraints of Generalized Gini and Gini mean difference indices and its Applications in Insurance

Statistical Physics, Diffusion Entropy Analysis and Information Theory c...
research
04/07/2010

On Tsallis Entropy Bias and Generalized Maximum Entropy Models

In density estimation task, maximum entropy model (Maxent) can effective...
research
12/22/2021

Entropic Herding

Herding is a deterministic algorithm used to generate data points that c...
research
12/03/2020

Competition analysis on the over-the-counter credit default swap market

We study two questions related to competition on the OTC CDS market usin...

Please sign up or login with your details

Forgot password? Click here to reset