Parameter estimation of Poisson mixture with automated model selection through BYY harmony learning

Pattern Recognition

Volumn 42, Issue 11, 2009, Pages 2659-2670

  Ma, Jinwen ^a   Liu, Jianfeng ^a   Ren, Zhijie ^a  

^a LAMA   (China)

Author keywords

Automated model selection; Bayesian Ying Yang (BYY) harmony learning; Gradient learning algorithm; Poisson mixture; Texture classification

Indexed keywords

AUTOMATED MODEL SELECTION; BAYESIAN YING-YANG (BYY) HARMONY LEARNING; GRADIENT LEARNING ALGORITHM; POISSON MIXTURE; TEXTURE CLASSIFICATION;

ADAPTIVE ALGORITHMS; AUTOMATION; BAYESIAN NETWORKS; DATA PROCESSING; EDUCATION; LEARNING SYSTEMS; MIXTURES; PARAMETER ESTIMATION; POISSON DISTRIBUTION; POISSON EQUATION; SET THEORY; TEXTURES;

LEARNING ALGORITHMS;

EID: 67649408773     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.03.029     Document Type: Article

References (46)

1. Mclachlan G.J., and Basford K.E. Mixture Models: Inference and Applications to Clustering (1988), Marcel Dekker, New York
2. Titterington D.M., Smith A.F.M., and Makov U.E. Statistical Analysis of Finite Mixture Distributions (1985), Wiley, New York
3. Frühwirth-Schnatter S. Finite Mixture and Markov Switching Models, Springer Series in Statistics (2005), Springer, New York
4. Farewell V.T., and Sprott D.A. The use of a mixture model in the analysis of count data. Biometrics 44 (1988) 1191-1194
5. Pauler D.K., Escobar M.D., Sweeney J.A., and Greenhouse J. Mixture models for eye-tracking data: a case study. Statistics in Medicine 15 (1996) 1365-1376
6. S. Gunduz, O.M. Tamer, A Poisson model for user accesses to web pages, in: Proceedings of the Eighteenth International Symposium on Computer and Information Sciences ISCIS'2003, Lecture Notes in Computer Science, vol. 2869, Springer, Berlin, pp. 332-339.
7. Li J., and Zha H. Two-way Poisson mixture models for simultaneous document classification and word clustering. Computational Statistics & Data Analysis 50 1 (2006) 163-180
8. Brijs T., Karlis T., Swinnen G., et al. A multivariate Poisson mixture model for marketing applications. Statistica Neerlandica 58 3 (2004) 322-348
9. D.R. Carmichael, S.J. Clarke, L.M. Linnett, Spatial models for texture classification, in: Proceedings of IEE Colloquium on Texture Classification: Theory and Application, London, October 1994, pp. 9/1-9/5.
10. Feller W. On a general class of contagious distributions. The Annals of Mathematical Statistics 14 (1943) 389-400
11. Karlis D., and Xekalaki E. Mixed Poisson distributions. International Statistical Review 73 1 (2005) 35-58
12. Pearson K. Contribution to the mathematical theory of evolution. Philosophical Transactions of the Royal Society of London Series A 185 (1894) 71-110
13. Everitt B.S. Mixture distributions. In: Kotz S., and Johnson N.L. (Eds). Encyclopedia of Statistical Sciences vol. 5 (1985), Wiley, New York 559-569
14. Render R.A., and Walker H.F. Mixture densities, maximum likelihood and the EM algorithm. SIAM Review 26 2 (1984) 195-239
15. Karlis D. An EM algorithm for multivariate Poisson distribution and related models. Journal of Applied Statistics 30 1 (2003) 63-77
16. Ma J., Xu L., and Jordan M.I. Asymptotic convergence rate of the EM algorithm for Gaussian mixtures. Neural Computation 12 12 (2000) 2881-2907
17. Ma J., and Xu L. Asymptotic convergence properties of the EM algorithm with respect to the overlap in the mixture. Neurocomputing 68 (2005) 105-129
18. Ma J., and Fu S. On the correct convergence of the EM algorithm for Gaussian mixtures. Pattern Recognition 138 12 (2005) 2602-2611
19. Parr W.C. Minimum distance estimation: a bibliography. Communications in Statistics Part A 10 (1981) 1205-1224
20. Hartigan J.A. Distribution problems in clustering. In: Garrett J. (Ed). Classification and Clustering (1977), Academic Press, New York 45-72
21. Akaike H. A new look at statistical model identification. IEEE Transactions on Automatic Control AC-19 (1974) 716-723
22. Scharz G. Estimating the dimension of a model. The Annals of Statistics 6 (1978) 461-464
23. Bozdogan H. Model selection and Akaike's information criterion: the general theory and its analytical extensions. Psychometrika 52 (1987) 345-370
24. Rissanen J. Modeling by shortest data description. Automatica 14 (1978) 465-471
25. Wallace C., and Dowe D. Minimum message length and Kolmogorov complexity. Computer Journal 42 4 (1999) 270-283
26. Self S., and Liang K. Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. Journal of the American Statistical Association 82 (1987) 605-610
27. Karlis D., and Xekalaki E. On testing for the number of components in a mixed Poisson model. Annals of the Institute of Statistical Mathematics 51 1 (1999) 149-162
28. Schlattmann P. On bootstrapping the number of components in finite mixtures of Poisson distributions. Statistics and Computing 15 3 (2005) 179-188
29. Escobar M.D., and West M. Bayesian density estimation and inference using mixtures. Journal of the American Statistical Association 90 430 (1995) 577-588
30. Recgardson S., and Green P.J. On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society B 59 4 (1997) 731-792
31. Figueiredo M.A.T., and Jain A.K. Unsupervised learning of finite mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 (2002) 381-396
32. L. Xu, Ying-Yang machine: a Bayesian-Kullback scheme for unified learnings and new results on vector quantization, in: Proceedings of 1995 International Conference on Neural Information Processing (ICONIP'95), vol. 2, pp. 977-988.
33. Xu L. Bayesian Ying-Yang machine, clustering and number of clusters. Pattern Recognition Letters 18 (1997) 1167-1178
34. Xu L. Best harmony, unified RPCL and automated model selection for unsupervised and supervised learning on Gaussian mixtures, three-layer nets and ME-RBF-SVM models. International Journal of Neural Systems 11 1 (2001) 43-69
35. Xu L. BYY harmony learning, structural RPCL, and topological self-organizing on mixture modes. Neural Networks 15 (2002) 1231-1237
36. Ma J., Wang T., and Xu L. A gradient BYY harmony learning rule on Gaussian mixture with automated model selection. Neurocomputing 56 (2004) 481-487
37. Ma J., and Wang L. BYY harmony learning on finite mixture: adaptive gradient implementation and a floating RPCL mechanism. Neural Processing Letters 24 1 (2006) 19-40
38. Ma J., Gao B., Wang Y., and Cheng Q. Conjugate and natural gradient rules for BYY harmony learning on Gaussian mixture with automated model selection. International Journal of Pattern Recognition and Artificial Intelligence 19 5 (2005) 701-713
39. Ma J., and He X. A fast fixed-point BYY harmony learning algorithm on Gaussian mixture with automated model selection. Pattern Recognition Letters 29 6 (2008) 701-711
40. Ma J., and Liu J. The BYY annealing learning algorithm for Gaussian mixture with automated model selection. Pattern Recognition 40 (2007) 2029-2037
41. Johnson N.L., Kotz S., and Balakrishnan N. Discrete Multivariate Distributions (1997), Wiley, New York
42. J. Ma, Automated model selection (AMS) on finite mixtures: a theoretical analysis, in: Proceedings of the 2006 International Joint Conference on Neural Networks (IJCNN), July 16-21, 2006, Vancouver, Canada, pp. 8255-8261.
43. Tuceryan M., and Jain A.K. Texture analysis. In: Chen C.H., Pau L.P., and Wang P.S.P. (Eds). Handbook of Pattern Recognition and Computer Vision (1993), World Scientific, Singapore 235-276
44. Ripley B.D. Spatial Statistics (1981), Wiley, New York
45. Liu X., and Wang D. Texture classification using spectral histograms. IEEE Transactions on Signal Processing 12 6 (2003) 661-670
46. Choy S.K., and Tong C.S. Statistical properties of bit-plane probability model and its application in supervised texture classification. IEEE Transactions on Signal Processing 17 8 (2008) 1399-1405