## 1 Introduction

Continuous probability density function (PDF) estimation using kernel methods is widely used in statistics, machine learning and signal processing

(Silverman, 1986). The optimal estimation depends upon the selected kernel function and its spread decided by the smoothing or bandwidth parameter. The selection of kernel has limited impact on optimal PDF estimation, although Epanechnikov kernel is the most optimal kernel (Epanechnikov, 1969). On the other hand, the optimal value of bandwidth parameter avoids either too rough or too smooth estimation of an unknown PDF.There exist variety of rules for bandwidth selection in KDE. The rules vary based on the criteria to measure accuracy of density estimation and to satisfy the used criteria. The brief survey of data driven bandwidth selectors is provided by Wand and Jones (1994); Park and Marron (1990); Jones and Sheather (1996); Park and Turlach (1992); Sheather (1986b). The Asymptotic Mean Integrated Square Error (AMISE) between the estimated PDF and the actual PDF is the most widely used performance criteria to derive the rules, though there are many others. The AMISE criteria requires estimating the roughness of the squared second order PDF as a prior step to estimate the kernel bandwidth parameter, where the roughness of a function is defined as integration of the squared function. The rules, based on the AMISE as a performance criteria, differ in a way to estimate the . The simplest Rule-of-Thumb (ROT), satisfying the AMISE, by Silverman (1986)

assumes Gaussian distribution for the unknown density. It is not the most optimal bandwidth selector but is used either as a very fast reasonably good estimator or as a first estimator in multistage bandwidth selectors. More precise

solve-the-equation plug-in rules (Sheather, 1983, 1986a) use estimation of integrated squared density derivative functionals to estimate . They demand high computations to solve a non-linear equation using iterative methods. They use ROT as a very first estimate. The fastest -exact approximation algorithm based solve-the-equation plug-in rule (Raykar and Duraiswami, 2005, 2006) requires order of computations, where is number of samples and is the selected number of evaluation points. So, deriving a data dependent bandwidth parameter selection rule for KDE that balances accuracy and computation is the goal of this article.The article achieves this goal by deriving an Extended Rule-of-Thumb

(ExROT). The assumption about Gaussianity of an unknown PDF in ROT is too restrictive. Expressing an unknown PDF, in terms of an infinite series of higher order statistics, based on a more generalized assumption should result into a better bandwidth selection rule. As a verification and demonstration to this concept, the ExROT extends the Gaussian assumption in ROT to near Gaussian assumption. This facilitates use of cumulants based Gram-Charlier A (GCA) Series expansion as an approximation for the unknown PDF to satisfy the same AMISE criteria. The empirical simulations prove that the ExROT for bandwidth selection is better than the ROT, with respect to an integrated mean square error (IMSE) or MISE performance criteria, for all types of nongaussian unimodal distributions including the skewed, the kurtotic and with outlier distributions. This is achieved with computation comparable to the ROT and too less compare to the

-exact solve-the-equation plug-in rule.The ExROT for bandwidth selection in univariate KDE is extended to the similar for multivariate KDE and kernel based multivariate density derivative estimation. The ExROT for multivariate KDE requires multivariate expression for AMISE, multivariate Taylor Series expansion, multivariate Hermite polynomials and multivariate GCA Series expansion. The required multivariate AMISE is conventionally derived using gradient and Hessian of the PDF of a random vector (Wand and Jones, 1994). Conventionally, the other required multivariate expressions are also derived using Tensor calculus, as higher order derivatives of a multivariate functions are involved. Often, the corresponding final expressions requires coordinatewise representations. But recently, the higher order cumulants (Terdik, 2002; S. Rao Jammalamadaka and Terdik, May, 2006) and multivariate Hermite polynomials (Terdik, 2002; Holmquist, 1996) are derived using only elementary calculus of several variables. This is achieved by replacing conventional multivariate differentiations by repeated applications of the Kronecker product to vector differential operator. The derived expressions are also more elementary as using vector notations and more comprehensive as apparently more nearer to their counterparts in univariate. The same approach has been used here to derive multivariate AMISE criteria in a vector notations. Overall, the multivariate ExROT is derived using the multivariate Taylor Series, the multivariate cumulants and the multivariate Hermite polynomials derived by Terdik (2002); Holmquist (1996), the multivariate GCA derived by Bhaveshkumar (2015a) and the multivariate AMISE obtained in Section 6 of this article. There is also derived bandwidth selection rule for kernel based density derivative estimation.

The next Section 2 derives the univariate AMISE criteria and gives brief on the existing rules for data driven kernel bandwidth selectors. The Section 3 derives the ExROT. The performance analysis is done using two separate experiments in Section 4. The preliminary background on multivariate KDE, Kronecker product, multivariate Taylor Series and others is briefed in Section 5. A compact derivation for multivariate GGC Series and GCA Series is provided in Section 5.4. Then, the Section 6 derives multivariate AMISE in a vector form using Kronecker Product. The multivariate AMISE and multivariate GCA Series are used to derive ExROT for multivariate KDE in Section 7. Similarly, the Section 8 derives ExROT for density derivative estimation. Finally, the article is concluded in Section 9.

## 2 Bandwidth Selection Criteria and Selectors

Given N realizations of an unknown PDF , the kernel density estimate is given by

(1) |

where, is the kernel function and h is the bandwidth parameter. Usually, is a symmetric, positive definite and bounded function; mostly a PDF; satisfying the following properties:

The accuracy of a PDF estimation can be quantified by the available distance measures between PDFs; like; norm based mean integrated absolute measure, norm based mean integrated square error (MISE), Kullback-Libeler divergence and others. The optimal smoothing parameter (the bandwidth) is obtained by minimizing the selected distance measure. The most widely used criteria MISE or IMSE (Integrated Mean Square Error) based bandwidth selection rule, as in (Silverman, 1986; Wand and Jones, 1994), is briefed in the Appendix A. It is given as under:

(2) | |||||

where, , and . In general, is identified as the roughness of function . An asymptotic large sample approximation AMISE is obtained, assuming and i.e. h reduces to 0 at a rate slower than .

(3) |

The Equation (3) interprets that a small

increases estimation variance, whereas, a larger

increases estimation bias. An optimal minimizing the total is given by,(4) |

Thus, the optimal bandwidth parameter depends upon some of the kernel parameters, number of samples and the second derivative of the actual PDF being estimated.

### 2.1 Brief Survey on the bandwidth selectors

As the bandwidth selection rules vary based on the choice of performance criteria for density estimation, they also vary based on the way the performance criteria is optimized. The various rules, satisfying AMISE, for bandwidth parameter selection differ in the way is estimated. The first group of rules named scale measures give rough estimate of the bandwidth parameter with less computation. It includes Silverman’s Rule-of-Thumb that estimates assuming being Gaussian (Silverman, 1986). For a Gaussian PDF and for a Gaussian kernel . Accordingly,

(5) |

where,

is the standard deviation of

. There are many other rules based on the assumption of other parametric family. There are also rules based on oversmoothed , difference based and others briefed by (Janssen et al., 1995).An another group of rules is based on the more accurate at high computation plug-in rules. They plug-in the kernel based estimate of the . The direct plug-in rules estimate derivative of the density functionals instead of estimating actual derivatives. Every order derivative functional estimation requires order estimate and pilot bandwidth to start with. Assuming, some parametric density for the order density the pilot bandwidth is selected and cumulatively the bandwidth parameter to estimate is obtained. The solve-the-equation plug-in rules use the same approach but, instead of assuming bandwidth parameter, they optimize it by directly putting it into the AMISE. This requires solving a non-linear equation iteratively. They have better performances at high computation. Other than the rules for bandwidth selection, there are also cross-validation methods selecting the best from a user-defined list of bandwidth parameter based on some performance criteria. But, there is always a compromise between a length of the list for possible bandwidth parameters and the amount of computation.

Over all, a bandwidth selection rule that achieves precise bandwidth parameter at low computation is still open for research.

## 3 Extended Rule-of-Thumb (ExROT) Bandwidth Selector

The Gaussianity assumption for an unknown PDF to estimate is too restrictive. Intuitively, better PDF estimations can be derived if is estimated by approximating PDFs through infinite series expansion. As a verification and demonstration to this concept, ExROT is derived in this section using cumulants based Gram-Charlier A Series expansion of based on near Gaussianity assumption for an unknown PDF . The series is given as:

where, is the cumulant of , is the cumulant of Gaussian PDF (G(x)) and is the derivative operator with respect to x. With , and taking derivative twice with respect to x yields:

Also, the nth derivative of Gaussian is given by

where, is the Gaussian PDF and is the nth order Hermite polynomial. Accordingly, approximating upto fourth order cumulant

(6) |

The integration is obtained using the following rules:

where, . Accordingly, the quantities in Equation (6) are obtained as under:

This gives:

(7) |

Combining above Equation (7) with equation (4), the Gram-Charlier A Series based an Extended Rule-of-Thumb for bandwidth parameter selection using near Gaussian PDF assumption and Gaussian kernel is given as under. As shown, the Silverman’s Rule-of-Thumb is one case of the extended rule.

(8) | |||||

## 4 Performance Analysis of ExROT Bandwidth Selector

There has been performed two separate experiments to test the performance of bandwidth selector. In both the experiments, the performance is tested on a set of 15 densities selected as a test-bed for density estimators by J. S. Marron (1992). The densities are shown in Figure 1. In both the experiments, the performance of ExROT is compared against Silverman’s Rule-of-Thumb and the -exact approximation algorithm based solve-the-equation plug-in rule (Raykar and Duraiswami, 2005, 2006).

### 4.1 Experiment 1 (Performance against varying PDFs)

The first experiment is done to test the performance against varying PDFs. The experiment is done with 50000 samples and for 100 trials. The results are shown in Table 1. Each table entry is an average of the 100 trials. The selected three rules are compared for performances against three parameters - the value of bandwidth estimated, the corresponding IMSE between the estimated PDF and the theoretical PDF and the time taken in Seconds to estimate the bandwidth. The theoretical PDF, required to calculate IMSE, is obtained from the normal mixture equations. That is why, all the 15 selected densities are generated using normal mixture equations.

The -exact solve-the-equation plug-in rule is the best giving minimum IMSE error in all the cases accept the pure Gaussian density estimation. For Gaussian density, ROT is slightly better than remaining both the rules. The best IMSE performance of -exact solve-the-equation plug-in rule is at the cost of very high computation time. The mean time to estimate the bandwidth parameter for ROT is less than one millisecond. For ExROT it is about 10 to 20 milliseconds and the same for -exact solve-the-equation plug-in rule is about 30 to 60 seconds. That means, the ExROT has time complexity comparable to that of the ROT. So, the IMSE performance of these two needs a comparision. The boldface values for IMSE comparison in Table 1

, show a better between these two. It shows that in all non-Gaussian unimodal density estimation cases - skewed or kurtotic or with outlier - ExROT has outperformed ROT. The worst performance of ExROT in multimodal density estimation is due to wrong estimation of the skewness and kurtosis. The ExROT has also outperformed ROT in some of the - claw and Asymmetric claw - multimodal density estimation cases. Thus, ExROT surely is a better option to ROT in unimodal density estimation.

Bandwidth (h) | Integrated MSE (IMSE)* | Estimation Time (in Sec) | |||||||
---|---|---|---|---|---|---|---|---|---|

Type | hrot | hexrot | heqfast | rot | exrot | eqfast | Trot | Texrot | Teqfast |

1 | 0.1217 | 0.1216 | 0.1213 | 0.1424 | 0.1424 | 0.1426 | 0.0005 | 0.0171 | 30.9182 |

2 | 0.0993 | 0.0860 | 0.0818 | 0.1770 | 0.1702 | 0.1702 | 0.0005 | 0.0157 | 35.9430 |

3 | 0.1263 | 0.0964 | 0.0200 | 3.7034 | 2.8516 | 0.4061 | 0.0006 | 0.0155 | 52.1223 |

4 | 0.0996 | 0.0693 | 0.0204 | 3.0476 | 1.8294 | 0.3834 | 0.0008 | 0.0154 | 48.2712 |

5 | 0.0402 | 0.0044 | 0.0129 | 1.9249 | 0.7042 | 0.4425 | 0.0006 | 0.0148 | 41.9652 |

6 | 0.1464 | 0.1632 | 0.0967 | 0.1908 | 0.2220 | 0.1504 | 0.0006 | 0.0149 | 41.0530 |

7 | 0.1999 | 0.2065 | 0.0925 | 0.3681 | 0.3897 | 0.1640 | 0.0006 | 0.0147 | 40.6588 |

8 | 0.1333 | 0.1596 | 0.0736 | 0.3122 | 0.4117 | 0.1920 | 0.0006 | 0.0153 | 41.7342 |

9 | 0.1552 | 0.1700 | 0.0785 | 0.3438 | 0.3954 | 0.1781 | 0.0005 | 0.0145 | 41.1552 |

10 | 0.1058 | 0.1042 | 0.0242 | 2.3709 | 2.3269 | 0.3392 | 0.0005 | 0.0149 | 48.2730 |

11 | 0.1459 | 0.1629 | 0.0895 | 0.7810 | 0.7961 | 0.7357 | 0.0005 | 0.0146 | 41.7426 |

12 | 0.1356 | 0.1350 | 0.0323 | 1.6634 | 1.6586 | 0.5287 | 0.0005 | 0.0156 | 54.3546 |

13 | 0.1450 | 0.1652 | 0.0461 | 1.1161 | 1.1926 | 0.5791 | 0.0005 | 0.0147 | 47.9025 |

14 | 0.2001 | 0.2058 | 0.0280 | 3.2280 | 3.2763 | 0.8810 | 0.0005 | 0.0140 | 51.0985 |

15 | 0.2059 | 0.2111 | 0.0230 | 3.2382 | 3.2824 | 0.4599 | 0.0006 | 0.0145 | 50.8321 |

### 4.2 Experiment 2 (Performance against varying number of samples)

The second experiment is done to have the performance comparision of the same selected three bandwidth estimators against varying number of samples. The results of estimated bandwidth parameter, the IMSE and the estimation time (in Seconds) versus number of samples for varying PDFs are tabulated in Table 2. For better interpretations, the IMSE versus log of the number of samples are plotted; for all 15 PDFs and number of samples varying from 100 to the 50000; as shown in Figure 2.

The IMSE performances against varying number of samples (Nsamples) for varying PDFs are similar to that discussed in Experiment 1. The ExROT performance is better for unimodal skewed, kurtotic or with outlier densities. Even it is better in some cases of multimodal skewed densities. Also, for small number of samples the ExROT performance is better compare to ROT. The convergence performance of ExROT is matching other two rules. The IMSE decreases almost inversely with increase in number of samples.

Nsamples | Bandwidth Parameter (h) | Integrated MSE (IMSE)* | Estimation Time (in Sec) | |||||||
---|---|---|---|---|---|---|---|---|---|---|

Type | * | hrot | hexrot | heqfast | rot | exrot | eqfast | Trot | Texrot | Teqfast |

0.0100 | 0.4189 | 0.4379 | 0.4059 | 6.2430 | 6.5102 | 6.5579 | 0.0011 | 0.0004 | 0.0968 | |

0.0200 | 0.3613 | 0.3797 | 0.3573 | 2.6582 | 2.6653 | 2.7344 | 0.0001 | 0.0002 | 0.1210 | |

0.0500 | 0.3038 | 0.3099 | 0.3008 | 0.7831 | 0.7855 | 0.8064 | 0.0001 | 0.0004 | 0.3287 | |

0.1000 | 0.2659 | 0.2681 | 0.2602 | 0.3148 | 0.3176 | 0.3239 | 0.0001 | 0.0006 | 0.6734 | |

1 | 0.2000 | 0.2324 | 0.2337 | 0.2287 | 0.1253 | 0.1262 | 0.1274 | 0.0001 | 0.0010 | 1.3470 |

0.5000 | 0.1929 | 0.1931 | 0.1911 | 0.0346 | 0.0346 | 0.0349 | 0.0001 | 0.0024 | 3.2634 | |

1.0000 | 0.1680 | 0.1678 | 0.1672 | 0.0127 | 0.0128 | 0.0128 | 0.0002 | 0.0038 | 6.3346 | |

2.0000 | 0.1464 | 0.1466 | 0.1455 | 0.0050 | 0.0050 | 0.0050 | 0.0002 | 0.0073 | 12.8339 | |

0.0100 | 0.3454 | 0.3723 | 0.2944 | 8.9172 | 10.3399 | 9.2006 | 0.0001 | 0.0002 | 0.0720 | |

0.0200 | 0.2993 | 0.3130 | 0.2533 | 3.4302 | 3.8549 | 3.4604 | 0.0001 | 0.0002 | 0.1420 | |

0.0500 | 0.2465 | 0.2339 | 0.2026 | 0.9394 | 0.9924 | 0.9915 | 0.0001 | 0.0004 | 0.3852 | |

0.1000 | 0.2165 | 0.1870 | 0.1819 | 0.3954 | 0.3974 | 0.3945 | 0.0001 | 0.0007 | 0.7551 | |

2 | 0.2000 | 0.1893 | 0.1663 | 0.1565 | 0.1399 | 0.1374 | 0.1381 | 0.0001 | 0.0010 | 1.5336 |

0.5000 | 0.1571 | 0.1367 | 0.1296 | 0.0425 | 0.0422 | 0.0422 | 0.0001 | 0.0023 | 3.7511 | |

1.0000 | 0.1370 | 0.1198 | 0.1134 | 0.0168 | 0.0162 | 0.0161 | 0.0002 | 0.0036 | 7.2034 | |

2.0000 | 0.1194 | 0.1038 | 0.0986 | 0.0066 | 0.0064 | 0.0064 | 0.0003 | 0.0065 | 14.2614 | |

0.0100 | 0.4429 | 0.3498 | 0.1650 | 40.3373 | 36.7614 | 25.9410 | 0.0001 | 0.0002 | 0.0864 | |

0.0200 | 0.3846 | 0.2996 | 0.1188 | 18.8112 | 16.7646 | 9.6509 | 0.0001 | 0.0002 | 0.1738 | |

0.0500 | 0.3183 | 0.2459 | 0.0844 | 6.8916 | 6.0170 | 2.8246 | 0.0001 | 0.0004 | 0.4436 | |

0.1000 | 0.2775 | 0.2125 | 0.0653 | 3.2038 | 2.7464 | 1.0352 | 0.0001 | 0.0006 | 0.9069 | |

3 | 0.2000 | 0.2410 | 0.1845 | 0.0510 | 1.4770 | 1.2452 | 0.3778 | 0.0001 | 0.0010 | 1.9033 |

0.5000 | 0.2003 | 0.1532 | 0.0384 | 0.5282 | 0.4362 | 0.1080 | 0.0001 | 0.0021 | 4.9425 | |

1.0000 | 0.1744 | 0.1332 | 0.0310 | 0.2397 | 0.1939 | 0.0377 | 0.0002 | 0.0032 | 10.3360 | |

2.0000 | 0.1518 | 0.1158 | 0.0257 | 0.1080 | 0.0856 | 0.0151 | 0.0003 | 0.0058 | 21.1275 | |

0.0100 | 0.3500 | 0.2631 | 0.1247 | 41.5059 | 36.6378 | 23.6608 | 0.0001 | 0.0002 | 0.1076 | |

0.0200 | 0.2999 | 0.2169 | 0.0934 | 19.3056 | 16.1740 | 8.6166 | 0.0001 | 0.0002 | 0.2175 | |

0.0500 | 0.2517 | 0.1805 | 0.0686 | 7.0407 | 5.6630 | 2.3757 | 0.0001 | 0.0003 | 0.5464 | |

0.1000 | 0.2167 | 0.1509 | 0.0557 | 3.2218 | 2.4513 | 0.9320 | 0.0001 | 0.0006 | 1.0900 | |

4 | 0.2000 | 0.1899 | 0.1333 | 0.0449 | 1.4626 | 1.0710 | 0.3232 | 0.0001 | 0.0010 | 2.1309 |

0.5000 | 0.1582 | 0.1102 | 0.0350 | 0.5031 | 0.3439 | 0.0875 | 0.0001 | 0.0022 | 4.8694 | |

1.0000 | 0.1375 | 0.0957 | 0.0296 | 0.2205 | 0.1448 | 0.0344 | 0.0002 | 0.0037 | 9.6654 | |

2.0000 | 0.1197 | 0.0833 | 0.0252 | 0.0951 | 0.0600 | 0.0136 | 0.0002 | 0.0058 | 19.3117 | |

0.0100 | 0.1329 | 0.0158 | 0.0511 | 56.5031 | 41.3602 | 21.4029 | 0.0003 | 0.0003 | 0.1138 | |

0.0200 | 0.1215 | 0.0145 | 0.0429 | 25.6093 | 14.6056 | 8.5744 | 0.0001 | 0.0002 | 0.2072 | |

0.0500 | 0.0992 | 0.0110 | 0.0352 | 8.1567 | 4.2720 | 2.5379 | 0.0001 | 0.0003 | 0.4943 | |

0.1000 | 0.0881 | 0.0100 | 0.0297 | 3.4558 | 1.6044 | 0.9628 | 0.0001 | 0.0006 | 0.9657 | |

5 | 0.2000 | 0.0761 | 0.0084 | 0.0257 | 1.4268 | 0.6472 | 0.4009 | 0.0001 | 0.0010 | 1.7802 |

0.5000 | 0.0640 | 0.0072 | 0.0209 | 0.4287 | 0.1696 | 0.1052 | 0.0001 | 0.0017 | 4.2263 | |

1.0000 | 0.0556 | 0.0062 | 0.0181 | 0.1705 | 0.0652 | 0.0397 | 0.0002 | 0.0028 | 8.4271 | |

2.0000 | 0.0483 | 0.0053 | 0.0156 | 0.0675 | 0.0244 | 0.0156 | 0.0002 | 0.0056 | 16.8823 | |

Nsamples | Bandwidth Parameter (h) | Integrated MSE (IMSE)* | h Calculation Time (T) | |||||||
---|---|---|---|---|---|---|---|---|---|---|

Type | * | hrot | hexrot | heqfast | rot | exrot | eqfast | Trot | Texrot | Teqfast |

0.0100 | 0.5128 | 0.5781 | 0.3875 | 8.3749 | 9.1194 | 8.1524 | 0.0001 | 0.0002 | 0.0670 | |

0.0200 | 0.4421 | 0.4948 | 0.3186 | 3.2862 | 3.6643 | 3.0184 | 0.0001 | 0.0002 | 0.1404 | |

0.0500 | 0.3652 | 0.4096 | 0.2540 | 0.9741 | 1.1004 | 0.8728 | 0.0001 | 0.0004 | 0.3652 | |

0.1000 | 0.3190 | 0.3558 | 0.2254 | 0.4326 | 0.4840 | 0.3629 | 0.0001 | 0.0006 | 0.7373 | |

6 | 0.2000 | 0.2780 | 0.3105 | 0.1927 | 0.1644 | 0.1873 | 0.1335 | 0.0001 | 0.0010 | 1.5391 |

0.5000 | 0.2315 | 0.2583 | 0.1558 | 0.0483 | 0.0550 | 0.0402 | 0.0001 | 0.0019 | 3.9894 | |

1.0000 | 0.2020 | 0.2251 | 0.1356 | 0.0186 | 0.0214 | 0.0145 | 0.0002 | 0.0028 | 8.0967 | |

2.0000 | 0.1759 | 0.1960 | 0.1174 | 0.0072 | 0.0083 | 0.0056 | 0.0003 | 0.0054 | 16.3610 | |

0.0100 | 0.6923 | 0.7155 | 0.3566 | 14.2086 | 14.7060 | 8.3466 | 0.0001 | 0.0002 | 0.0742 | |

0.0200 | 0.5997 | 0.6202 | 0.3015 | 5.8889 | 6.1350 | 3.1726 | 0.0001 | 0.0002 | 0.1494 | |

0.0500 | 0.5005 | 0.5175 | 0.2410 | 1.7750 | 1.8618 | 0.8813 | 0.0001 | 0.0003 | 0.3908 | |

0.1000 | 0.4367 | 0.4512 | 0.2086 | 0.7399 | 0.7760 | 0.3704 | 0.0001 | 0.0006 | 0.7544 | |

7 | 0.2000 | 0.3807 | 0.3933 | 0.1800 | 0.2883 | 0.3037 | 0.1360 | 0.0001 | 0.0010 | 1.5005 |

0.5000 | 0.3167 | 0.3272 | 0.1489 | 0.0854 | 0.0901 | 0.0397 | 0.0001 | 0.0018 | 3.8518 | |

1.0000 | 0.2759 | 0.2850 | 0.1285 | 0.0321 | 0.0340 | 0.0141 | 0.0002 | 0.0031 | 7.9127 | |

2.0000 | 0.2402 | 0.2481 | 0.1117 | 0.0130 | 0.0138 | 0.0058 | 0.0002 | 0.0054 | 16.0277 | |

0.0100 | 0.4647 | 0.5979 | 0.3305 | 10.3872 | 11.9845 | 9.8866 | 0.0001 | 0.0002 | 0.0731 | |

0.0200 | 0.4010 | 0.5166 | 0.2932 | 4.3730 | 5.1674 | 3.8251 | 0.0001 | 0.0002 | 0.1431 | |

0.0500 | 0.3390 | 0.4076 | 0.2206 | 1.4163 | 1.6669 | 1.1203 | 0.0001 | 0.0004 | 0.4028 | |

0.1000 | 0.2907 | 0.3550 | 0.1834 | 0.5798 | 0.7038 | 0.4435 | 0.0001 | 0.0007 | 0.8379 | |

8 | 0.2000 | 0.2538 | 0.3065 | 0.1534 | 0.2290 | 0.2850 | 0.1614 | 0.0001 | 0.0010 | 1.7051 |

0.5000 | 0.2114 | 0.2527 | 0.1225 | 0.0674 | 0.0856 | 0.0441 | 0.0001 | 0.0019 | 4.1356 | |

1.0000 | 0.1841 | 0.2201 | 0.1045 | 0.0268 | 0.0345 | 0.0173 | 0.0002 | 0.0030 | 8.2747 | |

2.0000 | 0.1602 | 0.1917 | 0.0896 | 0.0106 | 0.0139 | 0.0068 | 0.0002 | 0.0054 | 16.6340 | |

0.0100 | 0.5406 | 0.5921 | 0.3817 | 9.4215 | 10.1084 | 7.9126 | 0.0003 | 0.0002 | 0.0782 | |

0.0200 | 0.4662 | 0.5133 | 0.3161 | 4.0153 | 4.3435 | 3.4017 | 0.0001 | 0.0002 | 0.1410 | |

0.0500 | 0.3881 | 0.4268 | 0.2522 | 1.3227 | 1.4426 | 1.0262 | 0.0001 | 0.0003 | 0.3687 | |

0.1000 | 0.3397 | 0.3718 | 0.2046 | 0.5546 | 0.6094 | 0.3941 | 0.0001 | 0.0007 | 0.7998 | |

9 | 0.2000 | 0.2952 | 0.3235 | 0.1741 | 0.2397 | 0.2638 | 0.1620 | 0.0001 | 0.0010 | 1.6285 |

0.5000 | 0.2461 | 0.2696 | 0.1354 | 0.0713 | 0.0800 | 0.0426 | 0.0001 | 0.0018 | 4.1529 | |

1.0000 | 0.2143 | 0.2345 | 0.1148 | 0.0293 | 0.0330 | 0.0168 | 0.0002 | 0.0030 | 8.1136 | |

2.0000 | 0.1865 | 0.2042 | 0.0979 | 0.0119 | 0.0135 | 0.0066 | 0.0002 | 0.0055 | 16.2836 | |

0.0100 | 0.3648 | 0.3635 | 0.3384 | 22.3775 | 22.4492 | 22.3534 | 0.0001 | 0.0002 | 0.0631 | |

0.0200 | 0.3172 | 0.3375 | 0.2825 | 10.9313 | 10.9990 | 10.8045 | 0.0001 | 0.0002 | 0.1406 | |

0.0500 | 0.2635 | 0.2995 | 0.1727 | 4.2370 | 4.2810 | 3.5900 | 0.0001 | 0.0004 | 0.6232 | |

0.1000 | 0.2304 | 0.2471 | 0.0805 | 2.0575 | 2.0706 | 0.9325 | 0.0001 | 0.0006 | 1.0865 | |

10 | 0.2000 | 0.2011 | 0.2032 | 0.0563 | 0.9881 | 0.9879 | 0.3128 | 0.0001 | 0.0010 | 2.0001 |

0.5000 | 0.1675 | 0.1668 | 0.0427 | 0.3624 | 0.3609 | 0.0834 | 0.0001 | 0.0018 | 5.3371 | |

1.0000 | 0.1459 | 0.1454 | 0.0359 | 0.1648 | 0.1642 | 0.0329 | 0.0002 | 0.0028 | 10.9701 | |

2.0000 | 0.1271 | 0.1254 | 0.0303 | 0.0728 | 0.0719 | 0.0124 | 0.0002 | 0.0055 | 21.3417 |

Nsamples | Bandwidth Parameter (h) | Integrated MSE (IMSE)* | h Calculation Time (T) | |||||||
---|---|---|---|---|---|---|---|---|---|---|

Type | * | hrot | hexrot | heqfast | rot | exrot | eqfast | Trot | Texrot | Teqfast |

0.0100 | 0.5102 | 0.5779 | 0.3879 | 9.1443 | 9.9017 | 8.6536 | 0.0001 | 0.0002 | 0.0664 | |

0.0200 | 0.4393 | 0.4940 | 0.3334 | 3.9503 | 4.2723 | 3.6995 | 0.0001 | 0.0002 | 0.1355 | |

0.0500 | 0.3681 | 0.4133 | 0.2540 | 1.2492 | 1.3551 | 1.1489 | 0.0001 | 0.0003 | 0.3606 | |

0.1000 | 0.3193 | 0.3569 | 0.2210 | 0.5709 | 0.6103 | 0.5283 | 0.0001 | 0.0006 | 0.7447 | |

11 | 0.2000 | 0.2778 | 0.3103 | 0.1894 | 0.2513 | 0.2663 | 0.2331 | 0.0001 | 0.0010 | 1.5428 |

0.5000 | 0.2311 | 0.2585 | 0.1560 | 0.0902 | 0.0941 | 0.0848 | 0.0001 | 0.0018 | 3.9834 | |

1.0000 | 0.2013 | 0.2250 | 0.1332 | 0.0422 | 0.0435 | 0.0399 | 0.0002 | 0.0028 | 8.1323 | |

2.0000 | 0.1754 | 0.1958 | 0.1140 | 0.0204 | 0.0210 | 0.0193 | 0.0003 | 0.0055 | 16.4165 | |

0.0100 | 0.4851 | 0.4874 | 0.4530 | 16.3492 | 16.3720 | 16.2242 | 0.0001 | 0.0002 | 0.0590 | |

0.0200 | 0.4049 | 0.4045 | 0.3320 | 7.6083 | 7.6088 | 7.1462 | 0.0001 | 0.0002 | 0.1398 | |

0.0500 | 0.3403 | 0.3400 | 0.1940 | 2.8506 | 2.8496 | 2.2314 | 0.0001 | 0.0003 | 0.4242 | |

0.1000 | 0.2963 | 0.2950 | 0.1373 | 1.3352 | 1.3324 | 0.9125 | 0.0001 | 0.0006 | 0.8973 | |

12 | 0.2000 | 0.2583 | 0.2578 | 0.1070 | 0.6246 | 0.6240 | 0.3869 | 0.0001 | 0.0010 | 1.8709 |

0.5000 | 0.2151 | 0.2138 | 0.0748 | 0.2231 | 0.2223 | 0.1165 | 0.0001 | 0.0018 | 5.2212 | |

1.0000 | 0.1871 | 0.1864 | 0.0583 | 0.1022 | 0.1020 | 0.0480 | 0.0002 | 0.0028 | 10.5090 | |

2.0000 | 0.1628 | 0.1620 | 0.0449 | 0.0469 | 0.0468 | 0.0189 | 0.0002 | 0.0053 | 21.5027 | |

0.0100 | 0.5067 | 0.5846 | 0.3639 | 10.9392 | 11.8958 | 10.0277 | 0.0009 | 0.0002 | 0.0855 | |

0.0200 | 0.4336 | 0.5002 | 0.3073 | 4.8686 | 5.2675 | 4.5417 | 0.0001 | 0.0002 | 0.1442 | |

0.0500 | 0.3617 | 0.4161 | 0.2481 | 1.7277 | 1.8489 | 1.5896 | 0.0001 | 0.0004 | 0.3750 | |

0.1000 | 0.3177 | 0.3619 | 0.2087 | 0.7961 | 0.8408 | 0.7279 | 0.0001 | 0.0006 | 0.7774 | |

13 | 0.2000 | 0.2758 | 0.3146 | 0.1767 | 0.3753 | 0.3933 | 0.3341 | 0.0001 | 0.0010 | 1.6145 |

0.5000 | 0.2298 | 0.2622 | 0.1320 | 0.1372 | 0.1429 | 0.1116 | 0.0001 | 0.0022 | 4.6669 | |

1.0000 | 0.2002 | 0.2279 | 0.0903 | 0.0652 | 0.0680 | 0.0441 | 0.0002 | 0.0033 | 9.4382 | |

2.0000 | 0.1742 | 0.1985 | 0.0650 | 0.0307 | 0.0323 | 0.0179 | 0.0003 | 0.0057 | 19.0233 | |

0.0100 | 0.6986 | 0.7179 | 0.2714 | 29.3331 | 29.6279 | 19.9200 | 0.0001 | 0.0002 | 0.0831 | |

0.0200 | 0.6026 | 0.6199 | 0.2071 | 13.8366 | 13.9978 | 8.7139 | 0.0001 | 0.0002 | 0.1697 | |

0.0500 | 0.5026 | 0.5169 | 0.1452 | 5.1074 | 5.1724 | 2.8475 | 0.0001 | 0.0004 | 0.4440 | |

0.1000 | 0.4371 | 0.4496 | 0.1157 | 2.4004 | 2.4320 | 1.2555 | 0.0001 | 0.0006 | 0.9195 | |

14 | 0.2000 | 0.3807 | 0.3916 | 0.0894 | 1.1236 | 1.1389 | 0.5365 | 0.0001 | 0.0010 | 1.9072 |

0.5000 | 0.3169 | 0.3260 | 0.0638 | 0.4101 | 0.4159 | 0.1757 | 0.0001 | 0.0022 | 4.9003 | |

1.0000 | 0.2762 | 0.2840 | 0.0497 | 0.1913 | 0.1941 | 0.0738 | 0.0002 | 0.0035 | 9.9515 | |

2.0000 | 0.2404 | 0.2472 | 0.0388 | 0.0889 | 0.0903 | 0.0302 | 0.0003 | 0.0055 | 20.1263 | |

0.0100 | 0.7044 | 0.7231 | 0.2236 | 33.5149 | 33.7061 | 18.1842 | 0.0001 | 0.0002 | 0.0791 | |

0.0200 | 0.6215 | 0.6373 | 0.1796 | 16.1934 | 16.3224 | 8.1126 | 0.0001 | 0.0002 | 0.1713 | |

0.0500 | 0.5164 | 0.5295 | 0.1367 | 5.9831 | 6.0581 | 2.8509 | 0.0001 | 0.0004 | 0.4384 | |

0.1000 | 0.4496 | 0.4610 | 0.1143 | 2.7692 | 2.8119 | 1.3265 | 0.0001 | 0.0006 | 0.8907 | |

15 | 0.2000 | 0.3924 | 0.4022 | 0.0948 | 1.2618 | 1.2839 | 0.5925 | 0.0001 | 0.0010 | 1.8308 |

0.5000 | 0.3262 | 0.3345 | 0.0738 | 0.4410 | 0.4493 | 0.1936 | 0.0001 | 0.0022 | 4.7281 | |

1.0000 | 0.2841 | 0.2913 | 0.0561 | 0.1987 | 0.2024 | 0.0721 | 0.0002 | 0.0034 | 9.7408 | |

2.0000 | 0.2474 | 0.2536 | 0.0347 | 0.0905 | 0.0920 | 0.0200 | 0.0002 | 0.0055 | 19.9594 |

## 5 Prerequisites for Multivariate ExROT

The derivation for multivariate ExROT requires expressions for multivariate KDE, multivariate Taylor Series, multivariate cumulants, multivariate Hermite polynomials, multivariate GCA Series and multivariate AMISE for bandwidth selection in KDE. Due to the reasons discussed in the Section 1, the article uses the expressions in vector notations. The required pre-requisites are reported in this section and the multivariate AMISE is derived in the next section.

### 5.1 KDE for Multivariate PDF

The nonparametric estimation of a multivariate PDF requires a multivariate kernel. A multivariate kernel can be derived in two ways. The most popular technique is to use a product kernel i.e. a d-dimensional kernel is achieved through the product of 1-dimensional kernels in each direction. The product kernel may have unequal spread or bandwidth in each direction. The other way is to select a spherically symmetric multidimensional PDF as the kernel, called spherical kernel.

Let be a d-dimensional random vector. Let be the d-dimensional kernel. Then, the multivariate PDF of with available N realizations can be given as under:

(9) |

where, is the bandwidth matrix, implies the determinant of a matrix and the symbol . In a correlated data, is made proportional to the covariance matrix to compensate for the mutual correlations. Usually, the kernel is a multiplicative kernel given by . Also, it is symmetric, positive definite, zero mean and bounded function; usually a PDF.

Let be the class of all symmetric, positive definite matrices. Then, . A simplification can be achieved, if , where is a set of diagonal matrices. More precisely, . The multivariate PDF with available N realizations is now given as under:

(10) | ||||

(11) |

Further simplification is achieved if , where is a set set of matrices with constant diagonal. More precisely, i.e. equal bandwidth in all directions.

### 5.2 Taylor Series of a multivariate function

Let be a d-dimensional column vector and be the function of several variables differentiable in each variable. The definition and application of Kronecker product on vector derivative operator are briefed in Appendix B. Using them, the Taylor Series in vector notations for by expanding it at origin, is given as under:

(12) |

where, is the vector of dimension and given in terms of the derivative vector as

### 5.3 Moments, Cumulants and Hermite Polynomials

Let be a d-dimensional random vector, be its joint PDF differentiable in each variable. Also, let for , and -

be the Characteristic function,

be the Moment Generating Function (MGF),

be the other form of Characteristic function through natural log of , be the Cumulant Generating Function (CGF). Then, assuming and have been expanded using Taylor Series,(13) |

Assuming and have been expanded using Taylor Series,

(14) |

where, and . The details on the moments, cumulants and their relationships can be found in (Bhaveshkumar, 2015a).

The multivariate Hermite polynomials are defined as under in Equation (15).

(15) | ||||

(16) |

The d-variate Hermite polynomials, derived by Terdik (2002, Proposition 6), are given by the following recursion rule:

(17) | ||||

(18) |

where, the permutation is putting the element to the first and to the second place, keeping the other elements unchanged. More precisely,

### 5.4 A Compact Derivation for Multivariate GGC Series and GCA Series

A full derivation for multivariate GGC and corresponding GCA can be found in Bhaveshkumar (2015a). This is a compact derivation for Generalized Gram-Charlier Series. The detailed proof can be found in the article. Let be the characteristic function of an unknown multivariate PDF . Let be the characteristic function of a reference multivariate PDF . Also, let be the cumulant of d-dimensional and be the cumulant of d-dimensional . The difference of the cumulant vector is given by . Instead of the detailed proof, a compact derivation of GGC follows here.

Let , ; be the Kronecker product operator and

is the Fourier transform operator. Then,

(19) | |||||

(20) | |||||

(21) |

Taking inverse Fourier transform of the above equation brings

(22) | ||||

(23) |

where, indicates convolution. Thus, the GGC is obtained in a compact way.

The can be derived using its equality in terms of as:

This results into the following relations:

The multivariate GGC, for specific Gaussian PDF reference and matching first and second order moments, can be obtained by taking , and . The GGC with respect to a Gaussian PDF is identified as GCA Series, given as under:

(24) |

## 6 AMISE in vector notations for bandwidth selection multivariate KDE

The derivation for bandwidth parameter selection, satisfying AMISE between the estimated multivariate PDF and the actual multivariate PDF, can be found in (Wand and Jones, 1994). For the reasons described before, it is re-derived here in terms of vector notations using Kronecker product and differential operator as a column vector .

(25) |

The bias and variance estimations, using the Taylor Series expansion in Equation (12), are derived as under.

where,

Assuming the kernel with symmetric and bounded PDF the following properties are satisfied:

(26) | ||||

(27) | ||||

(28) |

Here, is the second order moment vector of the d-variate kernel with components and is a vector of size with only selected d values being 1. The second order moment of each component is constant with value and all cross-moments are zero. Using these properties, the bias can be written as:

(29) |

Similarly, the variance of the estimation can be approximated as under: