Application of the cross-entropy method to clustering and vector quantization

Journal of Global Optimization

Volumn 37, Issue 1, 2007, Pages 137-157

  Kroese, Dirk P ^a   Rubinstein, Reuven Y ^b   Taimre, Thomas ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Clustering; Cross entropy method; Global optimization; Simulation; Vector quantization

Indexed keywords

COMPUTER SIMULATION; FUZZY SETS; GLOBAL OPTIMIZATION; ITERATIVE METHODS; PARTIAL DIFFERENTIAL EQUATIONS; PROBABILITY DISTRIBUTIONS; VECTOR QUANTIZATION;

CROSS ENTROPY (CE) ALGORITHM; DATA SETS; LINEAR VECTOR QUANTIZATION;

ALGORITHMS;

EID: 33845335812     PISSN: 09255001     EISSN: 15732916     Source Type: Journal    
DOI: 10.1007/s10898-006-9041-0     Document Type: Article

References (29)

1. The USC-SIPI Image Database.: http://sipi.usc.edu/services/database/ Database.html
2. TSPLIB : A Traveling Salesman Problem Library, http://www.iwr.uni- heidelberg.de/groups/com-opt/software/TSPLIB95/
3. Ahalt, S.C., Krishnamurthy, A.K., Chen, P., Melton, D.E.: Competitive learning algorithms for vector quantization. Neural Net. 3, 277-290 (1990)
4. Betke, M., Makris, N.: Fast object recognition in noisy images using simulated annealing. In: Proceedings of the Fifth International Conference on Computer Vision, pp. 523-530 (1995)
5. Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)
6. Botev, Z., Kroese, D.P.: Global likelihood optimization via the cross-entropy method, with an application to mixture models. In: Ingalls, R.Q., Rossetti, M.D., Smith, J.S., Peters, B.A. (eds.) Proceedings of the 2004 Winter Simulation Conference, IEEE, Washington, DC, December 2004
7. Brown, L.: A survey of image registration techniques. Technical report, Department of Computer Science, Columbia University (1992)
8. Chen, J., Kundu, A.: Unsupervised texture segmentation using multichannel decomposition and hidden Markov models. IEEE Trans. Image Process. 4, 603-619 (1995)
9. de Boer, P.T., Kroese, D.P., Marmor, S., Rubinstein, R.Y.: A tutorial on the cross-entropy method. Ann Oper. Res. Vol. 134, pp.19-67. Springer-Verlag (2005)
10. Dorigo, M., Di Caro, G.: The ant colony optimization meta-heuristic. In: Corne, D., Dorigo, M., Glover, F. (eds.) New Ideas in optimization, pp. 11-32. McGraw-Hill (1999)
11. Duda, R.O., Hart, P.E., Stork, D.O.: Pattern Classification. Wiley, New York (2001)
12. Geman, S., Geman, D.: Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images. IEEE Trans. PAMI 6, 721-741 (1984)
13. Glover, F., Laguna, M.L.: Modern Heuristic Techniques for Combinatorial Optimization, Chapter 3: Tabu Search. Blackwell Scientific Publications, Oxford (1993)
14. Goldberg, D.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley, Reading, MA (1989)
15. Hansen, P., Mladenović, N.: J-means: a new local search heuristic for minimum sum of squares clustering. Pattern Recogn. 34, 405-413 (2001)
16. Hansen, P., Mladenović, N., Perez-Brito, D.: Variable neighborhood decomposition search. J Heuristics 7, 335-350, 2001.
17. Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31, 264-323 (1999)
18. Kaufman, L., Rousseeuw, P.: Finding Groups in Data, and Introduction to Cluster Analysis. Wiley, New York (1990)
19. Keith, J., Kroese, D.P.: Sequence alignment by rare event simulation. In: Proceedings of the 2002 Winter Simulation Conference, pp. 320-327. San Diego (2002)
20. McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions. Wiley, New York (1997)
21. Rubinstein, R.Y.: The cross-entropy method for combinatorial and continuous optimization. Methodol Comp. Appl. Prob. 2, 127-190 (1999)
22. Rubinstein, R.Y., Kroese, D.P.: The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning. Springer-Verlag, New York (2004)
23. Salomon, D.: Data Compression: The Complete Reference. Springer-Verlag, New York (2000)
24. Sherali, H.D., Desai, J.: A global optimization rlt-based approach for solving the hard clustering problem. J Global Optim. 32, 281-306 (2005)
25. Shi, L., Olafsson, S.: Nested partitioning method for global optimization. Oper. Res. 48(3), 390-407 (2000)
26. Spall, J.C.: Introduction to Stochastic Search and Optimization. John Wiley, New York (2003)
27. Stork, D.G., Yom-Tov, E.: Computer Manual to Accompany Pattern Classification. Wiley, New York (2004)
28. Webb, A.: Statistical Pattern Recognition. Arnold, London (1999)
29. Yang, M.-S., Wu, K.-L.: Unsupervised possibilistic clustering. Pattern Recog. 39, 5-21 (2006)