Information properties of order statistics and spacings

IEEE Transactions on Information Theory

Volumn 50, Issue 1, 2004, Pages 177-183

  Ebrahimi, Nader ^a   Soofi, Ehsan S ^b   Zahedi, Hassan ^c  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

^b UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^c FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Differential entropy; Entropy bounds; Kullback Leibler information; Mutual information; Probability integral transformation

Indexed keywords

ASYMPTOTIC STABILITY; INTEGRAL EQUATIONS; MATHEMATICAL TRANSFORMATIONS; PROBABILITY DENSITY FUNCTION; PROBABILITY DISTRIBUTIONS; STATISTICAL METHODS; THEOREM PROVING;

DIFFERENTIAL ENTROPY; DISCRIMINATION INFORMATION; KULLBACK-LEIBLER INFORMATION; ORDER STATISTICS; PROBABILITY INTEGRAL TRANSFORMATION;

DATA PROCESSING;

EID: 1242286147     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2003.821973     Document Type: Article

References (14)

1. B. C. Arnold, N. Balakrishnan, and H. N. Nagaraja, A First Course in Order Statistics. New York: Wiley, 1992.
2. K. M. Wong and S. Chen, "The entropy of ordered sequences and order statistics," IEEE Trans. Inform. Theory, vol. 36, pp. 276-284, Mar. 1990.
3. J. Beirlant, E. J. Dudewicz, L. Györfi, and E. C. van der Meulen, "Nonparametric entropy estimation: And overview," Int. J. Math. Statist. Sci., vol. 6, pp. 17-39, 1997.
4. S. Park, "The entropy of consecutive order statistics," IEEE Trans. Inform. Theory, vol. 41, pp. 2003-2007, Nov. 1995.
5. ____, "Fisher information on order statistics," J. Amer. Statist. Assoc., vol. 91, pp. 385-390, 1976.
6. D. S. Mitrinovic, Analytic Inequalities. New York: Springer-Verlag, 1970.
7. P. J. Bickel and E. L. Lehmann, "Descriptive statistics for nonparametric models. III. Dispersion," Ann. Statist., vol. 4, pp. 1139-1157, 1976.
8. H. Oja, "On location, scale, skewness and kurtosis of univariate distributions," Scand. J. Statist., vol. 8, pp. 154-168, 1981.
9. M. Shaked and J. G. Shanthikumar, Stochastic Orders and Their Applications. San Diego, CA: Academic, 1994.
10. R. E. Barlow and F. Prochan, Statistical Theory of Reliability and Life Testing. Silver Spring, MD: To Begin With, 1981.
11. A. Rényi, "On the theory of order statistics," Acta Math, vol. 4, pp. 191-231, 1953.
12. R. Pyke, "Spacings (with Discussions)," J. Roy. Statist. Soc., Ser. B, vol. 27, pp. 395-449, 1965.
13. Y. Shao and M. G. Hahn, "Limit theorems for the logarithm of sample spacings," Statist. Probab. Lett., vol. 24, pp. 121-132, 1995.
14. M. Ekström, "Strong limit theorems for sums of logarithm of high order spacings," Statistics, vol. 33, pp. 153-169, 1999.