A fast fixed-point BYY harmony learning algorithm on Gaussian mixture with automated model selection

Pattern Recognition Letters

Volumn 29, Issue 6, 2008, Pages 701-711

  Ma, Jinwen ^a   He, Xuefeng ^a  

^a LMAM   (China)

Author keywords

Automated model selection; Bayesian Ying Yang (BYY) system; Fixed point; Gaussian mixture; Harmony learning

Indexed keywords

AUTOMATION; COMPUTER SIMULATION; GAUSSIAN DISTRIBUTION; LEARNING SYSTEMS; PARAMETER ESTIMATION;

AUTOMATED MODEL SELECTION; BAYESIAN YING-YANG (BYY) SYSTEM;

LEARNING ALGORITHMS;

EID: 39949085586     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2007.11.014     Document Type: Article

References (26)

1. Akaike H. A new look at the statistical model identification. IEEE Trans. Automat. Control AC-19 (1974) 716-723
2. Blake, C.L., Merz, C.J., 1998. UCI Repository of Machine Learning Databases. University of California, Department of Information and Computer Science, Irvine. .
3. Boujemaa, N., 2000. Generalized competitive clustering for image segmentation. In: Proc. 19th Internat. Conf. of the North American Fuzzy Information Processing Society, pp. 133-137.
4. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), Wiley
5. Friedman H.P., and Rubin J. On some invariant criteria for grouping data. J. Amer. Statist. Assoc. 62 (1967) 1159-1178
6. Halbe Z., and Aladjem M. Regularized mixture discriminant analysis. Pattern Recognition Lett. 28 15 (2007) 2104-2115
7. Hartigan J.A. Distribution problems in clustering. In: Van Ryzin J. (Ed). Classification and Clustering (1977), Academic Press, New York 45-72
8. Jain A.K., and Dubes R.C. Algorithm for Clustering Data (1988), Prentice Hall, Englewood Cliffs, NJ
9. Ma J., and Cao B. The Mahalanobis distance based rival penalized competitive learning algorithm. Lecture Notes Comput. Sci. 3971 (2006) 442-447
10. Ma J., and He Q. A dynamic merge-or-split learning algorithm on Gaussian mixture for automated model selection. Lecture Notes Comput. Sci. 3578 (2005) 203-210
11. Ma J., and Liu J. The BYY annealing learning algorithm for Gaussian mixture with automated model selection. Pattern Recognition 40 7 (2007) 2029-2037
12. Ma J., and Wang T. Entropy penalized automated model selection on Gaussian mixture. Internat. J. Pattern Recognition Artificial Intell. 18 8 (2004) 1501-1512
13. Ma J., and Wang L. BYY harmony learning on finite mixture: Adaptive gradient implementation and a floating RPCL mechanism. Neural Process. Lett. 24 1 (2006) 19-40
14. Ma J., and Wang T. A cost-function approach to rival penalized competitive learning (RPCL). IEEE Trans. Systems Man Cybernet. Part B: Cybernet. 36 4 (2006) 722-737
15. Ma J., Wang T., and Xu L. A gradient BYY harmony learning rule on Gaussian mixture with automated model selection. Neurocomputing 54 (2004) 481-487
16. Ma J., Gao B., Wang Y., and Cheng Q. Conjugate and natural gradient rules for BYY harmony learning on Gaussian mixture with automated model selection. Internat. J. Pattern Recognition Artificial Intell. 19 (2005) 701-713
17. Millgan G.W., and Copper M.C. An examination of procedures for determining the number of clusters in a data set. Psychometrika 46 (1985) 187-199
18. Render R.A., and Walker H.F. Mixture densities, maximum likelihood and the EM algorithm. SIAM Rev. 26 2 (1984) 195-239
19. Roberts S.J., Everson R., and Rezek I. Maximum certainty data partitioning. Pattern Recognition 33 (2000) 833-839
20. Scott A.J., and Symons M.J. Clustering methods based on likelihood ratio criteria. Biometrics 27 (1971) 387-397
21. Xu, L., 1995. Ying-Yang machine: A Bayesian-Kullback scheme for unified learnings and new results on vector quantization. In: Proc. 1995 Internat. Conf. on Neural Information Processing, ICONIP'95, 30 October-3 November, vol. 2, pp. 977-988.
22. Xu L. Best harmony, unified RPCL and automated model selection for unsupervised and supervised learning on Gaussian mixtures, three-layer nets and ME-RBF-SVM models. Internat. J. Neural Syst. 11 1 (2001) 43-69
23. Xu L. Ying-Yang learning. In: Arbib M.A. (Ed). The Handbook of Brain Theory and Neural Networks. second ed. (2002), The MIT Press, Cambridge, MA 1231-1237
24. Xu L. BYY harmony learning, structural RPCL, and topological self-organizing on mixture modes. Neural Networks 15 (2002) 1231-1237
25. Xu L., Krzyak A., and Oja E. Rival penalized competitive learning for clustering analysis, RBF net, and curve detection. IEEE Trans. Neural Networks 4 4 (1993) 636-649
26. Xu, L. 1998. Rival penalized competitive learning, finite mixture, and multisets clustering. In: Proc. 1998 IEEE Int. Joint Conf. On Neural Networks, Anchrorage, Alaska, May 4-9, vol. 3, pp. 251-2530.