Testing System Entropy and Prediction Error Probability

IEEE Transactions on Systems, Man and Cybernetics

Volumn 23, Issue 5, 1993, Pages 1352-1358

  Feistauerová, Jaroslava ^a   Vajda, Igor ^a  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION SUPPORT SYSTEMS; ENTROPY; ERROR ANALYSIS; EXPERT SYSTEMS; SYSTEM STABILITY;

BAYES PREDICTOR; ERROR PROBABILITY; SYSTEM ENTROPY; SYSTEM STATES;

SYSTEMS ANALYSIS;

EID: 0027666905     PISSN: 00189472     EISSN: 21682909     Source Type: Journal    
DOI: 10.1109/21.260666     Document Type: Article

References (21)

1. G. P. Basharin, “On the statistical estimate of the entropy of a sequence of independent random variables,” Teor. Verojatnost. i Primenen., vol. 4, pp. 361-364, (in Russian), 1959.
2. M. Ben-Bassat, “f-entropies, probability of error and feature selection,” Inform. Control, vol. 39, pp. 227-242, 1978.
3. M. Ben-Bassat and J. Raviv, “Rényi's entropy and the probability error, IEEE Trans. Inform. Theory, vol. 24, pp. 769-772, 1978.
4. A. Buzo, A. H. Gray Jr., R. M. Gray, and J. D. Markel, “Speech coding based upon vector quantization,” IEEE Trans. Inform. Theory, vol. 28, pp. 562-574. 1980.
5. B. S. Clarke and A. R. Barron, “Information-theoretic asymptotics of Bayes methods,” IEEE Trans. Inform. Theory, vol. 36, pp. 453-471, 1990.
6. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
7. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. Englewood Cliffs: Prentice-Hall, 1982.
8. E. L. Hall, Computer Image Processing and Recognition. New York: Academic, 1979.
9. G. H. Hardy, J. E. Littlewood, and G. Polya, Inequalities., 2nd ed. Cambridge: Cambridge Univ. Press, 1959.
10. L. K. Jones and C. L. Byrne, “Generalized entropy criteria for inverse problems, with applications to data compression, pattern classification and cluster analysis,” IEEE Trans. Inform. Theory, vol. 36, pp. 23-30, 1990.
11. J. N. Kapur, P. K. Sahoo, and A. K. C. Wong, “A new method for gray level picture thresholding using the entropy of the histogram,” Comput. Graphic, Vision, Image Processing, vol. 29, pp. 273-285, 1985.
12. E. L. Lehman, Testing Statistical Hypotheses. New York: Wiley, 1962.
13. J. Lin, “Divergence measures based on Shannon entropy,” IEEE Trans. Inform. Theory, vol. 37, 1991.
14. Z. Lomnicki and S. Zaremba, “The asymptotic distributions of estimators of the amount of transmitted information,” Inform. Control, vol. 2, pp. 260-284, 1959.
15. A. W. Marshal, I. Olkin, Inequalities. Theory of Majorization and its Applications. New York: Academic, 1979.
16. S. K. Pal and B. Chakraborty. “Fuzzy set theoretic measure for automatic feature evaluation,” IEEE Trans. Syst., Man, Cybern., vol. 16, pp. 754-760, 1986.
17. N. R. Pal and S. K. Pal, “Entropy: A new definition and its applications,” IEEE Trans. Syst., Man, Cvbern., vol. 21, pp. 1260-1270, 1991.
18. P. K. Sahoo and A. K. C. Wong, “Generalized Jensen difference based on entropy functions,” Kybernetika, vol. 24, pp. 241-250, 1988.
19. I. Vajda, Theory of Statistical Inference and Information. Boston, MA: Kluwer, 1989.
20. I. Vajda and K. Vašek, “Majorization, concave entropies, and comparison of experiments,” Problems Control, Inform. Theory, vol. 14, pp. 105-115, 1985.
21. A. K. C. Wong and M. You, “Entropy and distance of random graphs with application to structural pattern recognition,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, no. 5, pp. 599-609, Sept. 1985.