The BYY annealing learning algorithm for Gaussian mixture with automated model selection

Pattern Recognition

Volumn 40, Issue 7, 2007, Pages 2029-2037

  Ma, Jinwen ^a   Liu, Jianfeng ^a  

^a LMAM   (China)

Author keywords

Automated model selection; Bayesian Ying Yang (BYY) learning; Gaussian mixture; Simulated annealing; Unsupervised image segmentation

Indexed keywords

COLOR IMAGE PROCESSING; DATA REDUCTION; DATA STRUCTURES; MATHEMATICAL MODELS; PATTERN RECOGNITION; SIMULATED ANNEALING;

AUTOMATED MODEL SELECTION; BAYESIAN YING-YANG (BYY) LEARNING; GAUSSIAN MIXTURE; UNSUPERVISED IMAGE SEGMENTATION;

LEARNING ALGORITHMS;

EID: 33947709464     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.12.028     Document Type: Article

References (23)

1. Devijver P.A., and Kittter J. Pattern Recognition: A Statistical Approach (1982), Prentice-Hall, Englewood Cliffs, NJ
2. Render R.A., and Walker H.F. Mixture densities, maximum likelihood and the EM algorithm. SIAM Rev. 26 2 (1984) 195-239
3. Hartigan J.A. Distribution problems in clustering. In: Van Ryzin J. (Ed). Classification and Clustering (1977), Academic Press, New York 45-72
4. Akaike H. A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19 (1974) 716-723
5. Bozdogan H. Model selection and Akaike's information criterion: the general theory and its analytical extensions. Psychometrika 52 3 (1987) 345-370
6. Escobar M.D., and West M. Bayesian density estimation and inference using mixtures. J. Am. Stat. Assoc. 90 430 (1995) 577-588
7. Recgardson S., and Green P.J. On Bayesian analysis of mixtures with an unknown number of components. J. R. Stat. Soc. B 59 4 (1997) 731-792
8. Hofmann T., and Buhmann J.M. Pairwise data clustering by deterministic annealing. IEEE Trans. Pattern Anal. Mach. Intell. 19 1 (1997) 1-14
9. Kloppenburg M., and Tavan P. Deterministic annealing for density estimation by multivariate normal mixtures. Phys. Rev. E 55 3 (1997) R2089-R2092
10. Rose K. Deterministic annealing for clustering, compression, classification, regression, and related optimization problem. Proc. IEEE 86 11 (1998) 2210-2239
11. Ueda N., and Nakano R. Deterministic annealing EM algorithm. Neural Networks 11 (1998) 271-282
12. Robert S.J., Everson R., and Rezek I. Maximum certainty data partitioning. Pattern Recognition 33 (2000) 833-839
13. Ueda N., and Ghahramani Z. Bayesian model search for mixture models based on optimizing variational bounds. Neural Network 15 (2002) 1223-1241
14. L. Xu, Ying-Yang machine: a Bayesian-Kullback scheme for unified learnings and new results on vector quantization, in: Proceedings of the 1995 International Conference on Neural Information Processing (ICONIP'95), 30 October-3 November 1995, vol. 2, pp. 977-988.
15. Xu L. Bayesian Ying-Yang machine, clustering and number of clusters. Pattern Recognition Lett. 18 (1997) 1167-1178
16. Xu L. Best harmony, unified RPCL and automated model selection for unsupervised and supervised learning on Gaussian mixtures, three-layer nets and ME-RBF-SVM models. Int. J. Neural Syst. 11 1 (2001) 43-69
17. Xu L. BYY harmony learning, structural RPCL, and topological self-organizing on mixture modes. Neural Networks 15 (2002) 1231-1237
18. Ma J., Wang T., and Xu L. A gradient BYY harmony learning rule on Gaussian mixture with automated model selection. Neurocomputing 56 (2004) 481-487
19. Ma J., Gao B., Wang Y., and Cheng Q. Conjugate and natural gradient rules for BYY harmony learning on Gaussian mixture with automated model selection. Int. J. Pattern Recognition Artif. Intell. 19 (2005) 701-713
20. Ma J., and Wang L. BYY harmony learning on finite mixture: adaptive gradient implementation and a floating RPCL mechanism. Neural Processing Lett 24 1 (2006) 19-40
21. Xu L., Krzyak A., and Oja E. Rival penalized competitive learning for clustering analysis, RBF net, and curve detection. IEEE Trans. Neural Networks 4 4 (1993) 636-649
22. C.L. Blake, C.J. Merz, UCI repository of machine learning databases 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, University of California, Irvine, Department of Information and Computer Science, 1998.
23. Boujeman N. Generalized competitive clustering for image segmentation. Proceedings of the 19th International Conference of the North American Fuzzy Information Processing Society (2000) 133-137