Unsupervised learning of a finite discrete mixture: Applications to texture modeling and image databases summarization

Journal of Visual Communication and Image Representation

Volumn 18, Issue 4, 2007, Pages 295-309

  Bouguila, Nizar ^a   Ziou, Djemel ^b  

^a Concordia University ^*  (Canada)

^b UNIVERSITÉ DE SHERBROOKE   (Canada)

Author keywords

Cooccurrence matrix; EM; Finite mixture models; Image retrieval; Maximum likelihood; Multinomial Dirichlet; Semantic features; Vistex

Indexed keywords

IMAGE RETRIEVAL; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD; OPTIMIZATION; SEMANTICS;

COOCCURRENCE MATRIX; FINITE MIXTURE MODELS; MULTINOMIAL DIRICHLET; SEMANTIC FEATURES;

UNSUPERVISED LEARNING;

EID: 34250816203     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2007.02.005     Document Type: Article

References (45)

1. McLachlan J.G., and Peel D. Finite Mixture Models (2000), Wiley
2. Figueiredo M.A.T., and Jain A.K. Unsupervised learning of finite mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 (2002) 4-37
3. Nigam K., McCallum A., Thrun S., and Mitchell T. Text classification from labeled and unlabeled documents using EM. Machine Learning 39 2 (2000) 103-134
4. Cadez I.V., McLachlan J.G., and McLarn C.E. Maximum likelihood estimation of mixture densities for binned and truncated multivariate data. Machine Learning 47 (2002) 7-43
5. Raftery A.E., and Banfield J.D. Model-based Gaussian and non-Gaussian clustering. Biometrics 49 (1993) 803-821
6. Bouguila N., Ziou D., and Vaillancourt J. Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application. IEEE Transactions on Image Processing 13 11 (2004) 1533-1543
7. Deerwester S., Dumais S., Landauer T., Furnas G., and Harshman R. Indexing by latent semantic analysis. Journal of the American Society of Information Science 41 6 (1990) 391-407
8. Hofman T. Unsupervised learning by probabilistic latent semantic analysis. Machine Learning 42 1 (2001) 177-196
9. Blei D., Ng A., and Jordan M. Latent Dirichlet allocation. Journal of Machine Learning Research 3 (2003) 993-1022
10. N. Bouguila, D. Ziou, Apprentissage non Supervisé d'un Mélange Discret et Fini Basé sur la Distribution de Dirichlet Multinomiale: Application à la Modélisation de la Texture, in: Proc. Of 14ème Congrès Francophone AFRIF-AFIA de Reconnaissance des Formes et Intelligence Artificielle (RFIA2004), 2004, pp. 469-479.
11. J.D.M. Rennie, L. Shih, J. Teevan, D.R. Karger, Parametric mixture models for multi-labeled text, in: Proc. Neural Information Processing Systems (NIPS2002), 2002, pp. 721-728.
12. J.D.M. Rennie, L. Shih, J. Teevan, D.R. Karger, Tackling the poor assumptions of naive Bayes text classifiers, in: Proc. International Conference on Machine Learning (ICML2003), 2003, pp. 616-623.
13. D. Lewis, Naive (Bayes) at forty: The independence assumption in information retrieval, in: Proc. European Conference on Machine Learning (ECML1998), 1998, pp. 4-15.
14. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B 39 (1977) 1-38
15. McLachlan J.G., and Krishnan T. The EM Algorithm and Extensions (1997), Wiley
16. Church K.W., and Gale W.A. Poisson mixtures. Natural Language Engineering 1 (1995) 163-190
17. Katz S.M. Distribution of content words and phrases in text and language modelling. Natural Language Engineering 2 (1996) 15-59
18. J. Teevan, D.R. Karger, Empirical development of an exponential probabilistic model for text retrieval: Using textual analysis to build a better model, in: Proc. 26th Annual International ACMSIGIR Conference on Research and Development in Informaion Retrieval, 2003, p. 1825.
19. Hsu C.N., Huang H.J., and Wong T.T. Implications of the Dirichlet assumption for discretization of continuous variables in naive Bayesian classifier. Machine Learning 53 (2003) 235-623
20. Kotz S., Ng K.W., and Fang K. Symmetric Multivariate and Related Distributions (1990), Chapman and Hall, London/New York
21. Mosimann J.E. On the compound multinomial distribution, the multivariate β-distribution, and correlations among proportions. Biometrika 49 1 and 2 (1962) 65-82
22. Blackwll D., and MacQueen J.B. Ferguson distributions via polya urn schemes. The Annals of Statistics 1 (1973) 353-355
23. Griffiths D.A. Maximum likelihood estimation for the beta-binomial distribution and an application to the household distribution of the total number of cases of a disease. Biometrics 29 4 (1973) 637-648
24. S.A. Lowe, The beta-binomial mixture model and its application to TDT tracking and detection, in: Proc. of the DARPA Broadcast News Workshop, 1999.
25. Redner R.A., and Walker H.F. Mixture densities, maximum likelihood and EM algorithm. SIAM Review 26 2 (1984) 195-239
26. Akaike H.A. New look at the statistical model identification. IEEE Transaction on Automatic Control 19 6 (1994) 716-723
27. Rissanen J. Modeling by shortest data description. Automatica 49 1 and 2 (1978) 65-82
28. Schwarz G. Estimating the dimension of a model. The Annals of Statistics 6 2 (1978) 361-464
29. Rong Z., and Zwolinski M. Mutual information theory for adaptive mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 4 (2001) 713-724
30. A.A. Salah, E. Alpaydin, Incremental mixtures of factor analysers, in: International Conference on Pattern Recognition (ICPR'04), 2004, pp. 276-279.
31. Rao C.R. Advanced Statistical Methods in Biomedical Research (1952), John Wiley and Sons, New York
32. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum Press, New York
33. Fielitz B.D., and Myers B.L. Estimation of parameters in the beta distribution. Decision Sciences 6 (1975) 1-13
34. M. Tuceryan, A.K. Jain, Texture analysis, in: The Handbook of Pattern Recognition and Computer Vision, 1998, pp. 207-248.
35. Haralick R.M., Shanmugan K., and Dinstein I. Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics 8 (1973) 610-621
36. Unser M. Sum and difference histograms for texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 1 (1986) 118-125
37. Vickers A.L., and Modestino J.W. A maximum likelihood approach to texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 4 1 (1982) 61-68
38. Ripley B.D. Pattern Recognition and Neural Networks (1996), Cambridge University Press
39. Garge N.R., Page G.P., Sprague A.P., Gorman B.S., and Allison D.B. Reproducible Clusters from Microarray Research: Whither. BMC Bioinformatics 6 Suppl.+2 (2005) S10
40. Carson C., Belongie S., Greenspan H., and Malik J. Blobworld: image segmentation using expectation maximization and its application to image querying. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 8 (2002) 1026-1038
41. Kherfi M.L., Ziou D., and Bernardi A. Combining positive and negative examples in relevance feedback for content-based image retrieval. Journal of Visual Communication and Image Representation 14 (2003) 428-457
42. Salton G., Wang A., and Yang C.A. Vector space model for information retrieval. Journal of the American Society for Information Science 18 (1975) 613-620
43. Barnard K., Duygulu P., Forsyth D., De Freitas N., Blei D.M., and Jordan M.I. Matching words and pictures. Journal of Machine Learning Research 3 (2003) 1107-1135
44. Gradshteyn I.S., and Ryzhik I.M. Table of Integrals, Series, and Products (1965), Academic Press
45. Graybill F.A. Matrices with Applications in Statistics (1983), Wadsworth, California