Random swap em algorithm for Gaussian mixture models

Pattern Recognition Letters

Volumn 33, Issue 16, 2012, Pages 2120-2126

  Zhao, Qinpei ^a   Hautamäki, Ville ^a   Kärkkäinen, Ismo ^a   Fränti, Pasi ^a  

^a UNIVERSITY OF EASTERN FINLAND   (Finland)

Author keywords

Data clustering; Expectation maximization; Gaussian mixture model; Genetic based EM; Random swap EM; Split and merge EM

Indexed keywords

DATA CLUSTERING; EXPECTATION MAXIMIZATION; GAUSSIAN MIXTURE MODEL; GENETIC-BASED EM; RANDOM SWAP EM; SPLIT-AND-MERGE;

CLUSTERING ALGORITHMS; IMAGE SEGMENTATION; MAXIMUM PRINCIPLE; OBJECT RECOGNITION; RANDOM PROCESSES;

COMMUNICATION CHANNELS (INFORMATION THEORY);

EID: 84866537971     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2012.06.017     Document Type: Article

References (29)

1. Asuncion, A.; Newman, D.; 2007. "UCI machine learning repository". .
2. G. Biernacki, C. Celeux, and G. Govaert "Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models" Comput. Statist. Data Anal. 41 2003 561 575 (Pubitemid 36073008)
3. C. Bishop Pattern Recognition and Machine Learning 2006 Springer-Verlag
4. G. Celeux, and J. Diebolt "The SEM algorithm: A probabilistic teacher algorithm derived from the EM algorithm for the mixture problem" Comput. Statist. Quater. 2 1985 73 82
5. A. Dempster, N. Laird, and D. Rubin "Maximum likelihood from incomplete data via the EM algorithm" J. Roy. Statist. Soc. Ser. B 39 1977 1 38
6. M. Figueiredo, and A. Jain "Unsupervised learning of finite mixture models" IEEE Trans. Pattern Anal. Machine Intell. 2002 381 396 (Pubitemid 35289353)
7. M. Figueiredo, and A. Jain "Unsupervised learning of finite mixture models" IEEE Trans. Pattern Anal. Machine Intell. 24 2002 381 396 (Pubitemid 35289353)
8. Fränti P.; 2009. "Clustering data sets". .
9. P. Fränti, and J. Kivijärvi "Randomized local search algorithm for the clustering problem" Pattern Anal. Appl. 3 2000 358 369 (Pubitemid 33213769)
10. Fränti, P.; Virmajoki, O.; Hautamäki, V.; 2008. "Probabilistic clustering by random swap algorithm". In: 19th Internat. Conf. on Pattern Recognition, vol. 55, pp. 287-314.
11. T. Kanungo, D.M. Mount, N.S. Netanyahu, C. Piatko, R. Silverman, and A.Y. Wu A local search approximation algorithm for k-means clustering Comput. Geometry: Theory Appl. 28 2004 11 89
12. Li, Y.; Li, L.; 2009. "A split and merge EM algorithm for color image segmentation". In: IEEE Internat. Conf. on Intelligent Computing and Intelligent Systems, pp. 395-399.
13. G. Mclachlan, and T. Krishnan The EM Algorithm and Extensions 1996 John Wiley & Sons
14. G. McLachlan, and D. Peel Finite Mixture Models 2000 John Wiley & Sons
15. P. Merz "An iterated local search approach for minimum sum-of-squares clustering" Adv. Intell. Data Anal. V 2003 1 38
16. A. Minagawa, N. Tagawa, and T. Tanaka "SMEM algorithm is not fully compatible with maximum-likelihood framework" Neural Comput. 14 2002 1261 1266
17. M. Ortega, Y. Rui, K. Chakrabati, K. Porkaew, S. Mehrotra, and T. Huang "Supporting ranked boolean similarity queries in MARS" IEEE Trans. Knowledge Data Eng. 10 1998 905 925 (Pubitemid 128752570)
18. N. Udea, R. Nakano, Z. Gharhamani, and G. Hinton "SMEM algorithm for mixture models" Neural Comput. 12 2000 2109 2128
19. C. Veenman, M. Reinders, and E. Backer "A maximum variance cluster algorithm" IEEE Trans. Pattern Anal. Machine Intell. 24 2002 1273 1280 (Pubitemid 35242587)
20. J. Verbeek, N. Vlassis, and B. Krose "Efficient greedy learning of Gaussian mixture models" Neural Comput. 15 2003 469 485 (Pubitemid 37049830)
21. H. Wang, B. Luo, and Z. Zhang "Estimation for the number of components in a mixture model using stepwise split-and-merge EM algorithm" Pattern Recognition Lett. 25 2004 1799 1809
22. G. Wei, and M. Tanner "A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms" J. Amer. Statist. Assoc. 85 1990 699 704
23. Z. Zhang, C. Chen, J. Sun, and K. Chan "EM algorithms for Gaussian mixtures with split-and-merge operation" Pattern Recognit. 36 2003 1973 1983 (Pubitemid 36726817)
24. B. Zhang, C. Zhang, and X. Yi "Competitive EM algorithm for finite mixture models" Pattern Recognit. 37 2004 131 144 (Pubitemid 37418423)
25. Zhang, Z.; Dai, B.; Tung, A.; 2008."Estimating local optimums in EM algorithm over Gaussian mixture model", In: Proc. of the 25th Internat. Conf. on Machine Learning, pp. 1240-1247.
26. Zhao, Q.; Hautamäki, V.; Kärkkäinen, I.; Fränti, P.; 2009."Random swap EM algorithm for finite mixture models in image segmentation", In: Proc. IEEE Internat. Conf. on Image Processing, Cairo, Egypt, pp. 2397-2400.
27. Zhao, Q.; Hautamäki V.; Fränti, P.; 2011. "Rsem: An accelerated algorithm on repeated em", In: 2011 Sixth Internat. Conf. on Image and Graphics, pp. 135-140.
28. Helen, M.; Virtanen, T.: Query by example of audio signals using Euclidean 399 distance between gaussian mixture models, In: ICASSP'07, 2007, pp. 225-228.
29. F. Pernkopf, and D. Bouchaffra Genetic-based em algorithm for learning Gaussian mixture models IEEE Trans. Pattern Anal. Mach. Intell. 27 8 2005 1344 1348 (Pubitemid 41245064)