The Shortest Confidence Interval for the Ratio of Quantiles of the Dagum Distribution

03/11/2019 ∙ by Alina Jȩdrzejczak, et al. ∙ University of Lodz WULS SGGW Warsaw 0

Jędrzejczak et al. (2018) constructed a confidence interval for a ratio of quantiles coming from the Dagum distribution, which is frequently applied as a theoretical model in numerous income distribution analyses. The proposed interval is symmetric with respect to the ratio of sample quantiles, which result may be unsatisfactory in many practical applications. The search for a confidence interval with a smaller length led to the derivation of the shortest interval with the ends being asymmetric relative to the ratio of sample quantiles. In the paper, the existence of the shortest confidence interval is shown and the method of obtaining such an interval is presented. The results of the calculation show a reduction in the length of the confidence intervals by several percent in relation to the symmetric confidence interval.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

One of the measures of income distribution inequality is income quintile share ratio, also called S80/S20 ratio (Eurostat Regional Yearbook, 2016). It is calculated as the ratio of the fourth quantile of an income distribution to the first one, i.e. income quintile share ratio can be defined as

where

denotes the cumulative distribution function of income.


Natural point estimators of the ratio

can easily be obtained as ratios of the corresponding sample quintiles. Statistical properties of such estimators are dependent on the form of quantile estimators which are implemented (see: Jędrzejczak and Pekasiewicz, 2018). In addition to point estimation, in the analysis of income distribution, the interval estimation of different inequality measures is also considered. In Greselin and Pasquazzi (2009, 2010), parametric and non-parametric Dagum confidence intervals for Gini and new Zenga inequality measures were derived and compared. Jędrzejczak et al. (2018) constructed a confidence interval for the ratios of quantiles, assuming that the Dagum distribution as an income distribution model. Also in this paper we confine ourselves to the Dagum (1977) distribution as a probabilistic model for a population income. This distribution has widely been applied in income inequality analysis in many countries all over the world as it is very flexible and usually well fitted to empirical distributions in different divisions. Here, we consider a more general set-up, namely a confidence interval for a ratio of and quantiles is taken into regard. Jedrzejczak et al. (2018) constructed a symmetric confidence interval, i.e. the confidence interval for which the risks of underestimation and overestimation are the same. The current study is dedicated to the problem of construction of the shortest confidence interval.
In the second section the Dagum distribution is presented while in the third section the shortest confidence interval is derived. Unfortunately closed formulae turned out to be not available. Some numerical results are given in the fourth section. In the last section conclusions and final remarks are presented, as well as the suggestions of future research topics

2 The Dagum Distribution

The Dagum distribution is often used in the analysis of personal (or household) income and wages, as it is usually well fitted to empirical distributions in different countries. It can also be successfully applied for different subpopulations obtained by means of splitting up the overall sample by socio-economic group, region, gender or family type (Jędrzejczak and Pekasiewicz 2018, Pekasiewicz and Jędrzejczak 2017). The estimates of its parameters are utilized to assess many important income distribution characteristics, including numerous variability, inequality, poverty and wealth measures, as well as concentration curves.
Consider a Dagum distribution with parameters , and

. Its cumulative distribution distribution (CDF) and probability density function (PDF) are as follows

and

Its quantile function equals

3 The Shortest Confidence Interval

Among income distribution characteristics the important role play the measures based on quantiles. Simple dispersion ratios, defined as the ratios of the income of the richest quantile over that of the poorest quantile, usually utilize deciles and quintiles, but in principle, any quantile of income distribution can be used. A version of the decile dispersion ratio using the ratio of the 90ty over the 40th percentile (the ratio of the richest 10% divided by the poorest 40%’s) which has recently become popular is the so called Palma Ratio (Palma, 2011) Another popular inequality measure based on quantiles (deciles) is the coefficient of maximum equalisation, also known as the Schutz index or the Pietra ratio.


Let be given numbers. We are interested in estimation of ratio of quantiles

Since we are interested in the estimation of the ratio of quantiles, we reparametrize the considered model. It can be seen that

The CDF of the Dagum distribution may be written in the following form

for and , and .

Let be a sample and let be order statistics. Let (here denotes the greatest integer not greater than ) be an observed quantile ratio. It is assumed that the sample size is large, i.e. it is assumed that .

From David and Nagaraja (2003) and Serfling (1999) it follows that is strongly consistent estimator of , for all . Also, it follows (Serfling 1999, th. 2.3.3; David and Nagaraja 2003, th. 10.3 and application of Delta method, see e.g. Greene 2003, p. 913) that for the estimator

is asymptotically normally distributed, i.e.

where

(for theoretical details see Jędrzejczak et al. (2018)).

Let be the given confidence level. We have (the scale parameter is omitted)

where and is the -quantile of distribution.

Let

where and is the Lambert function (see Appendix 2). The confidence interval for at the confidence level has the form

The confidence interval with is the standard one, i.e.

The length of the confidence interval is a function of :

We want to minimize with respect to .


Lemma. is decreasing for ; is constant for ; is increasing for .

Proof. To obtain the thesis it is enough to observe that function is increasing for and it is convex. These properties as well as other interesting properties of the Lambert function may be found in Corless et al. (1996).


Theorem. There exists which minimizes .

Proof. If increases then decreases. Since and hence decreases. We have:

if then and ;

if then and .

Hence

From continuity of we obtain the thesis.

Note that for and we obtain one sided confidence intervals.


4 Numerical results

The analytical form of minimizing the length of the confidence interval for quantile ratios of the Dagum distribution cannot be obtained but it can be found numerically. In Appendix 1 there is given a short code in R-project language for finding the minimal length confidence interval.
Exemplary numerical results are given in Tables 1 and 2 for and . In particular, Table 1 summarizes the results of the calculations obtained for while in Table 2 the results for are presented. In columns entitled short and standard there are given appropriate interval lengths and the last column contain the corresponding length reductions which can be considered the precision gains obtained by means of the proposed estimation method. Note that is the risk of underestimation while is the risk of overestimation (for standard confidence interval both probabilities are equal to ).

Table 1. Results for .
short standard reduction
Table 2. Results for .
short standard reduction

5 Conclusions

One of the crucial problems in socio-economic research is estimation of income distribution inequality which can be evaluated, among others, by the ratio of appropriate quantiles of an income distribution. Such an approach is very convenient for practitioners, as the inequality measures based on quantiles are easy to obtain and have straightforward economic interpretation. In Jędrzejczak et al. (2018) an asymptotic confidence interval for a ratio of quantiles was constructed.
In this paper we constructed the shortest confidence interval. We confined ourselves to the Dagum distribution which was assumed as an underlying income distribution model throughout the paper. It was just because this distribution presents good statistical properties required for income distribution models and is widely applied in numerous empirical analyses. The confidence interval we constructed is asymptotic but in the real-world experiments on income and wage distributions thousands of data are available. Numerous simulation studies performed in Zielinski et al. (2018) revealed that under the Dagum model the sample size n = 1000 is large enough to do asymptotics.

The empirical analysis of the lengths of c.i. for quintile and decile ratios confirmed a reduction in the length of the proposed confidence interval by several percent with respect to the symmetric one. It is worth noting that the observed length reduction has strictly been related to the statistical characteristics of the Dagum distribution, namely its dispersion and inequality. The greater income inequality is observed the smaller the precision of interval estimation can be expected and the more reduction you can get due to the new approach. Therefore, the proposed shortest confidence interval can be applied in various income, wage and expenditure analysis, wherever we can successfully utilize the Dagum distribution. Because nowadays it is easy to calculate the shortest c.i. hence these intervals can be recommended for practical use. In the future, further investigations on confidence intervals for income inequality and poverty measures, involving different probability distributions, seem useful.

References

Corless, R. M., Gonnet, G. H., Hare, D. E. G., Jeffrey, D. J. and Knuth D. E. (1996): “On the LambertW function,” Advanced in Computational Mathematics, 5(1), 329–359.

Dagum, C. (1977): “A New Model of Personal Income Distribution: Specification and Estimation,” Economie Appliquee, 30, 413-437.

David, H. A. and Nagaraja, H. N. (2003): “Order Statistics, Third Edition,” John Wiley & Sons, Inc.

Eurostat (2016): “The Eurostat regional yearbook ISBN: 978-92-79-60090-6, ISSN: 23631̄716, doi: 10.2785/29084, cat. number: KS-HA-16-001-EN-N. (http://ec.europa.eu/eurostat/statistics-explained/index.php/Glossary:Incomequintileshareratio).”

Greene, W. H. (2003): “Econometric Analysis (5th ed.),” Prentice Hall.

Greselin, F. and Pasquazzi, L. (2009): “Asymptotic Confidence Intervals for a New Inequality Measure,” Communications in Statistics - Simulation and Computation,TaylorFrancis, 38(8), 1742-1756.

Greselin, F. and Pasquazzi, L. (2010): “Dagum Confidence Intervals for Inequality Measures,” Proceedings of the 45th Scientific Meeting of the Italian Statistical Society, Cleup Eds., Padua, https://www.academia.edu/17707359/Dagum confidence intervals for inequality measures.

Jędrzejczak, A. and Pekasiewicz D. (2018): “Properties of Selected Inequality Measures Based on Quantiles and their Application to the Analysis of Income Distribution in Poland by Macroregion,” Argumenta Oeconomica Cracoviensia, 18, 51-67.

Jędrzejczak, A., Pekasiewicz, D. and Zieliński, W. (2018): “Confidence Interval for Quantile Ratio of the Dagum Distribution,” REVSTAT-Statistical Journal, https://ine.pt/revstat/pdf/ ConfidenceIntervalQuantileRatioDagum.pdf.

Palma, J. G. (2011): “Homogeneous Middles vs. Heterogeneous Tails, and the End of the ’Inverted-U’: the Share of the Rich is what it’s all about,” Cambridge Working Papers in Economics (CWPE) 1111, .

Pekasiewicz, D. and Jędrzejczak, A. (2017): “Application of the Measures Based on Quantiles to the Analysis of Income Inequality and Poverty in Poland by Socio-Economic Group,” 35th International Conference Mathematical Methods in Economics, 532-537.

Serfling, R. J. (1980): “Approximation Theorems of Mathematical Statistics,” John Wiley & Sons.

Zieliński, W., Jędrzejczak, A. and Pekasiewicz, D. (2018): “Estimation of quantile ratios of the Dagum distribution,” The Professor Aleksander Zeliaś International Conference on Modelling and Forecasting of Socio-Economic Phenomena, 12, 603-611,
DOI: 10.14659/SEMF.2018.01.61.

Appendix 1

An exemplary R code for calculating the confidence interval is enclosed.


alpha=0.2 #input alpha
beta=0.8 #input beta
n=1000 #input n
rsample=2.5 #input estimated r
asample=0.1 #input estimated shape parameter a
lev=0.95 #input confidence level
stlev=(1-lev)/2
kryt=function(s)qnorm(s,0,1)

sigma2=function(A,B,aa)(aa*log((A^(-1/aa)-1)/(B^(-1/aa)-1)))^(-2)*((1-B)/B/(1-B^(1/aa))^2
  +(1-A)/A/(1-A^(1/aa))^2-2*(1-B)/B/((1-B^(1/aa))*(1-A^(1/aa))))

TheEnd=function(pr,nn,A,B,aa,kryt)uniroot(function(pop) sqrt(nn)*(pr-pop)
  -kryt*sqrt(sigma2(A,B,aa))*pop*log(pop), lower = 1, upper = 10, tol = 1e-20)$root

Leng=function(pr,nn,A,B,aa,s)
  TheEnd(pr,nn,A,B,aa,kryt(s))-TheEnd(pr,nn,A,B,aa,kryt(lev+s))
  #s -risk of overestimation to be optimized

FindMinimumLeng=function(pr,nn,A,B,aa,ll)optimize(Leng,interval=c(0,1-ll), pr=pr, nn=nn,
  A=A, B=B, aa=aa, tol=1e-20)$minimum

ss=FindMinimumLeng(rsample,n,alpha,beta,asample,lev)

print(c(" risk of overestimation:",ss),quote = FALSE)
print(c(" length of the shortest confidence interval:",
  Leng(rsample,n,alpha,beta,asample,ss)),quote = FALSE)
print(c(" length of the standard confidence interval:",
  Leng(rsample,n,alpha,beta,asample,stlev)),quote = FALSE)
print(c(" length reduction:",100*
  (1-Leng(rsample,n,alpha,beta,asample,ss)/Leng(rsample,n,alpha,beta,asample,stlev)),"%"),
  quote = FALSE)
print(c(" standard c.i.:",TheEnd(rsample,n,alpha,beta,asample,kryt(lev+stlev)),
  TheEnd(rsample,n,alpha,beta,asample,kryt(stlev))), quote = FALSE)
print(c(" shortest c.i.:",TheEnd(rsample,n,alpha,beta,asample,kryt(lev+ss)),
  TheEnd(rsample,n,alpha,beta,asample,kryt(ss))), quote = FALSE)

Appendix 2

Lambert function is defined as a solution with the respect to of the equation

It is seen that

Since the solution with respect to of the equation is , hence

Application of the above to the equation

gives the confidence interval for the ratio .