A New Estimator of Shannon Entropy with Application to Goodness-of-Fit Test to Normal Distribution
Mbanefo S. Madukaife *
Department of Statistics, University of Nigeria, Nsukka, Nigeria.
*Author to whom correspondence should be addressed.
Abstract
In this paper, a new estimator of the Shannon entropy of a random variable X having a probability density function \(\mathit{f}\)(\(\mathit{x}\)) is obtained based on window size spacings. Under the standard normal, standard exponential and uniform distributions, the estimator is shown to have relative low bias and low RMSE through extensive simulation study at sample sizes 10, 20, and 30. Based on the results, it is recommended as a good estimator of the entropy. Also, the new estimator is applied in goodness-of-fit test to normality. The statistic is affine invariant and consistent and the results show that it is a good statistic for assessing univariate normality of datasets.
Keywords: Entropy estimator, window size spacing, bias of an estimator, root mean square error of an estimator, test for normality