Error entropy in classification problems: A univariate data analysis

Neural Computation

Volumn 18, Issue 9, 2006, Pages 2036-2061

  Silva, Luís M ^a   Felgueiras, Carlos S ^a   Alexandre, Luís A ^b,c   Marques De Sa J ^a,d  

^a INEB INSTITUTO DE ENGENHARIA BIOMÉDICA   (Portugal)

^b UNIVERSITY OF BEIRA INTERIOR   (Portugal)

^c INSTITUTO DE TELECOMUNICAÇÕES   (Portugal)

^d UNIVERSITY OF PORTO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLASSIFICATION; ENTROPY; METHODOLOGY; NORMAL DISTRIBUTION; THEORETICAL MODEL;

CLASSIFICATION; ENTROPY; MODELS, THEORETICAL; NORMAL DISTRIBUTION;

EID: 33748288090     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2006.18.9.2036     Document Type: Article

References (17)

1. Devroye, L., Gyorfi, L., & Lugosi, G. (1996). A probabilistic theory of pattern recognition, Berlin: Springer-Verlag.
2. Erdogmus, D., & Principe, J. (2000). Comparison of entropy and mean square error criteria in adaptive system training using higher order statistics. In Proceedings of the Intl. Conf., on ICA and Signal Separation (pp. 75-80). Helsinki, Finland.
3. Erdogmus, D., & Principe, J. C. (2002). An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems. IEEE Transactions on Signal Processing, 50(7), 1780-1786.
4. Kapur, J. (1993). Maximum-entropy models in science and engineering (rev. ed). New York: Wiley.
5. Kullback, S. (1959). Statistics and information theory. New York: Wiley.
6. Linsker, R. (1988). Self-organization in a perceptual network. IEEE Computer, 21, 105-117.
7. Marques de Sa, J. (2001). Pattern recognition: Concepts, methods and applications. Berlin: Springer-Verlag.
8. Newman, D., Hettich, S., Blake, C., & Merz, C. (1998). UCI repository of machine learning databases. Irvine: University of California, Irvine, Department of Information and Computer Sciences. Available online at http://www.ics.uci.edu/~mlearn/MLRepository.html.
9. Parzen, E. (1962). On the estimation of a probability density function and the mode. Annals of Mathematical Statistics, 33, 1065-1076.
10. Press, W., Teukolsky, S., Vetterling, W., & Flannery, B. (1992). Numerical recipes in C: The art of scientific computing. Cambridge: Cambridge University Press.
11. Principe, J. C., Xu, D., & Fisher, J. (2000). Information theoretic learning. In S. Haykin (Ed.), Unsupervised adaptive filtering, Vol. 1: Blind source separation (pp. 265-319). New York: Wiley.
12. Santos, J., Alexandre, L., & Marques de Sá, J. (2004). The error entropy minimization algorithm for neural network classification. In Int. Conf. on Recent Advances in Soft Computing. Nottingham, U.K.: Nottingham Trent University.
13. Santos, J., Marques de Sa, J., Alexandre, L., & Sereno, F. (2004). Optimization of the error entropy minimization algorithm for neural network classification. In C. Dagli, A. Buczak, D. Enke, M. Embrechts, & O. Ersoy (Eds.), Intelligent engineering systems through artificial neural networks (Vol. 14, pp. 81-86). New York: American Society of Mechanical Engineers.
14. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423, 623-656.
15. Silva, L., Marques de Sa, J., & Alexandre, L. (2005). Neural network classification using Shannon's entropy. In European Symposium on Artificial Neural Networks. Bruges, Belgium: d-side publications.
16. Silverman, B. (1986). Density estimation for statistics and data analysis. London: Chapman & Hall.
17. Stoller, D. (1954). Univariate two-population distribution free discrimination. Journal of the American Statistical Association, 49, 770-777.