Application of the cross entropy method to the GLVQ algorithm

Pattern Recognition

Volumn 41, Issue 10, 2008, Pages 3173-3178

  Boubezoul, Abderrahmane ^a   Paris, Sébastien ^a   Ouladsine, Mustapha ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Cross entropy method; Generalized learning vector quantization; Initialization sensitiveness

Indexed keywords

AEROSPACE APPLICATIONS; ALGORITHMS; BOOLEAN FUNCTIONS; CERIUM; EDUCATION; EVOLUTIONARY ALGORITHMS; FUNCTION EVALUATION; INTEGER PROGRAMMING; LEARNING SYSTEMS; OPTIMIZATION; PAPER; SCHEDULING ALGORITHMS; SET THEORY; SOFTWARE PROTOTYPING; STRUCTURAL OPTIMIZATION; VECTOR QUANTIZATION;

ALTERNATIVE APPROACH; APPLIED (CO); CROSS-ENTROPY (CE) METHOD; ELSEVIER (CO); GENERALIZED LEARNING VECTOR QUANTIZATION; GRADIENT SEARCH; OBJECTIVE FUNCTION (OF); PARAMETER OPTIMIZATION; REAL WORLD DATA SETS; STOCHASTIC OPTIMIZATIONS;

LEARNING ALGORITHMS;

EID: 45649084222     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.03.016     Document Type: Article

References (28)

1. T. Kohonen, Learning vector quantization for pattern recognition, Technical Report TKK-F-A601, 1986.
2. T. Kohonen, Improved versions of learning vector quantization, INJCN, 1990.
3. M. Pregenzer, D. Flotzinger, G. Pfurtscheller, Distinction sensitive learning vector quantization-a noise-insentitive classification method, in: IEEE International Joint Conference on Neural Networks, vol. 10, 1994, pp. 2890-2894.
4. Somervuo P., and Kohonen T. Self-organizing maps and learning vector quantization for feature sequences. Neural Process. Lett. 10 (1999) 151-159
5. T. Bojer, B. Hammer, D. Schunk, K.V. Toschanowitz, Relevance determination in learning vector quantization, in: The European Symposium on Artificial Neural Networks, 2001, pp. 271-276.
6. Hammer B., and Villman T. Generalized relevance learning vector quantization. Neural Networks 15 8-9 (2002) 1059-1068
7. Sato A.S., and Yamada K. A formulation of learning vector quantization using a new misclassification measure. The 14th International Conference on Pattern Recognition (1998)
8. Qin A., and Suganthan P. Initialization insensitive LVQ algorithm based on cost-function adaptation. Pattern Recognition 38 5 (2005) 773-776
9. Hammer B., Strickert M., and Villmann T. Supervised neural gas with general similarity measure. Neural Process. Lett. 21 1 (2004) 21-44
10. T. Bojer, B. Hammer, C. Koers, Monitoring technical systems with prototype based clustering, in: The European Symposium on Artificial Neural Networks, 2002, pp. 271-276.
11. K. Crammer, R. Gilad-Bachrach, A. Navot, N. Tishby, Margin analysis of the LVQ algorithm, in: NIPS'2002, 2002.
12. Rubinstein R. Optimization of computer simulation models with rare events. Eur. J. Oper. Res. 99 (1997) 89-112
13. Kroese D.P., Rubinstein R.Y., T., and T. Application of the cross-entropy method to clustering and vector quantization. Eur. J. Oper. Res. 37 (2007) 137-157
14. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), Wiley, New York
15. Diamantini C., and Spalvieri A. Certain facts about Kohonen's LVQ1 algorithm. IEEE Trans. Circuits Syst. I 47 (1996) 425-427
16. Juang B.H., and Katagiri S. Discriminative learning for minimum error classification. IEEE Trans. Signal Process. 40 2 (1992) 3043-3054
17. Fu M.C., Glover F.W., and April J. Simulation optimization: a review, new developments, and applications. The 37th Winter Simulation Conference (WSC2005) (2005) 83-95
18. Kroese D., Porotsky S., and Rubinstein R. The cross-entropy method for continuous multi-extremal optimization. Methodol. Comput. Appl. Probab. 8 (2006) 383-407
19. O. Wittner, B.E. Helvik, Cross entropy guided ant-like agents finding dependable primary/backup path patterns in networks, in: Congress on Evolutionary Computation (CEC2002), 2002.
20. Liu Z., Doucet A., and Singh S.S. The cross-entropy method for blind multiuser detection. IEEE International Symposium on Information Theory (2004)
21. Boer P.D., Kroese D., Mannor S., and Rubinstein R.Y. A tutorial on the cross-entropy method. Ann. Oper. Res. (2005) 19-67
22. Chepuri K., and de Mello T.H. Solving the vehicle routing problem with stochastic demands using the cross entropy method. Ann. Oper. Res. 134 (2005) 153-181
23. Rubinstein R.Y., and Kroese D.P. The Cross-Entropy Method: A Unified Approach to Combinatorial Method, Monte-Carlo Simulation, Randomized Optimization and Machine Learning (2004), Springer, Berlin
24. Botev Z., and Kroese D. Global likelihood optimization via the cross-entropy method, with an application to mixture models. Proceedings of the 2004 Winter Simulation Conference (2004)
25. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, Uci Repository of Machine Learning Databases. URL: 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, 1998.
26. Zeng X., and Martinez T.R. Distribution-balanced stratified cross-validation for accuracy estimation. J. Exp. Theor. Artif. Intell. 12 (2000) 1-12
27. Wu J., and Chung A. Cross entropy: a new solver for Markov random field modeling and applications to medical image segmentation. The Eighth International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI'05) (2005) 229-237
28. Hammer B., Strickert M., and Villmann T. Relevance LVQ versus svm. Seventh International Conference on Artificial Intelligence Soft Computing (ICAISC 2004) (2004) 592-597