Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application

IEEE Transactions on Image Processing

Volumn 13, Issue 11, 2004, Pages 1533-1543

  Bouguila, Nizar ^a   Ziou, Djemel ^a   Vaillancourt, Jean ^b  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b UNIVERSITÉ DU QUÉBEC EN OUTAOUAIS   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; IMAGE SEGMENTATION; MATHEMATICAL MODELS; MATRIX ALGEBRA; MAXIMUM LIKELIHOOD ESTIMATION; MULTIMEDIA SYSTEMS;

DIRICHLET DISTRIBUTION; FISHERS SCORING METHOD; IMAGE SUMMARIZING; MIXTURE MODELING; NATURAL GRADIENT; RIEMANNIAN SPACE;

IMAGE RETRIEVAL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; CLUSTER ANALYSIS; COLORIMETRY; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER SIMULATION; EVALUATION; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; SKIN PIGMENTATION; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING; VALIDATION STUDY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COLORIMETRY; COMPUTER GRAPHICS; COMPUTER SIMULATION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SKIN PIGMENTATION; STATISTICAL DISTRIBUTIONS; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE;

EID: 7444239786     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2004.834664     Document Type: Article

References (46)

1. S. J. Roberts and L. Rezek, "Bayesian approach to Gaussian mixture modeling," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 1133-1142, Nov. 1998.
2. M. A. T. Figeiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 4-37, Mar. 2002.
3. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 4-37, Jan. 2000.
4. B. S. Everitt and D. J. Hand, Finite Mixture Distributions. London, U.K.: Chapman & Hall, 1981.
5. S. Medasani and R. Krishnapuram, "A comparison of Gaussian and pearson mixture modeling for pattern recognition and computer vision applications," Pattern Recognit. Lett., vol. 20, pp. 305-313, 1999.
6. A. E. Raftery and J. D. Banfield, "Model-based Gaussian and non-Gaussian clustering," Biometrics, vol. 49, pp. 803-821, 1993.
7. T Kato, S. Omachi, and H. Aso, "Asymmetric Gaussian and its application to pattern recognition," in Proc. Joint IAPR Int. Workshops SSPR 2002 and SPR 2002, Aug. 2002, pp. 404-413.
8. A. El Zaart and D. Ziou, "Statistical modeling of multimodal SAR images," Int. J. Remote Sens., to be published.
9. R. J. Connor and J. E. Mosimann, "Concepts of independence for proportions with a generalization of the Dirichlet distribution," J. Amer. Stat. Assoc., vol. 39, pp. 1-38, 1977.
10. A. Narayanan, "A note on parameter estimation in the multivariate Beta distribution," Comput. Math. Applicat., vol. 24, no. 10, pp. 11-17, 1992.
11. G. Ronning, "Maximum likelihood estimation of Dirichlet distributions," J. Stat. Comput. Simul., vol. 32, pp. 215-221, 1989.
12. B. D. Fielitz and B. L. Myers, "Estimation of parameters in the Beta distribution," Decision Sci., vol. 6, pp. 1-13, 1975.
13. G. H. Weis and M. Dishon, "Small sample comparison of estimation methods for the Beta distribution," J. Stat. Comput. Simul., vol. 11, pp. 1-11, 1980.
14. K. Samuel, K. W. Ng, and K. Fang, Symmetric Multivariate and Related Distributions. London, U.K.: Chapman & Hall, 1990.
15. K. Samuel, K. Balakrishman, and J. Norman, Continous Multivariate Distributions. New York: Wiley, 2000, vol. 1.
16. R. A. Redner and H. F. Walker, "Mixture densities, maximum likelihood and EM algorithm," SIAM Rev., vol. 26, no. 2, pp. 195-239, Apr. 1984.
17. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
18. T. J. Santner and D. E. Duffy, The Statistical Analysis of Discrete Data. New York: Springer-Verlag, 1989.
19. P. Rao, "Asymtotic theory of statistical inference," in Wiley Series in Probability and Mathematical Statistics. New York: Wiley, 1987.
20. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Stat. Soc. B, vol. 39, pp. 1-38, 1977.
21. S. Ikeda, "Acceleration of the EM algorithm," Syst. Comput. Jpn., vol. 31, no. 2, pp. 10-18, Feb. 2000.
22. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Automat. Contr., vol. AC-19, pp. 716-723, June 1974.
23. J. Rissanen, "Modeling by shortest data description," Biometrika, vol. 14, pp. 465-471, 1978.
24. G. Schwarz, "Estimating the dimension of a model," Ann. Stat., vol. 6, no. 2, pp. 461-464, 1978.
25. Z. Rong and M. Zwolinski, "Mutual information theory for adaptive mixture models," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, no. 4, pp. 713-724, Apr. 2001.
26. S. Medasani and R. Krishnapuram, "Categorization of image databases for efficient retrieval using robust mixture decomposition," Comput. Vis. Image Understanding, vol. 83, pp. 216-235, 2001.
27. N. Bouguila, D. Ziou, and J. Vaillancourt, "A maximum likelihood estimation of the generalized Dirichlet mixture," Dept. Mathé matiques et d'informatique, Univ. Sherbrooke, Shrebrooke, QC, Canada, 2002.
28. C. R. Rao, Advanced Statistical Methods in Biomedical Research. New York: Wiley, 1952.
29. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
30. S. Amari, O. E. Barndorff-Nielsen, R. E. Kass, S. L. Lauritzen, and C. R. Rao, Differential Geometry in Statistical Inference. Hayward, CA: Inst. Math. Stat., 1987, vol. 10.
31. S. Amari, "Natural gradient works efficiently in learning," Neural Comput., vol. 10, pp. 251-276, 1998.
32. J. C. Bezdek, Pattern Recognition With Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
33. S. C. Choi and R. Wette, "Maximum likelihood estimation of parameters of the gamma distribution and their bias," Technometrics, vol. 11, no. 4, pp. 683-690, Nov. 1969.
34. T. B. Nguyen and D. Ziou, "Contextual and noncontextual performance evaluation of edge detectors," Pattern Recognit. Lett., no. 21, pp. 805-816, 2000.
35. W. Niblack, R. Barber, W. Equitz, M. Flickner, E. H. Glasman, D. Yanker, P. Faloutsos, and G. Taubin, "The QBIC project: Querying images by content using color, texture and shape," in Proc. SPIE Conf. Storage and Retrieval for Images and Video Databases, 1993, pp. 173-187.
36. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: tools for content-based manipulation of image databases," in Proc. SPIE Conf. Storage and Retrieval for Images and Video Databases II, Feb. 1994.
37. C. Carson, M. Thomas, S. Belongie, J. M. Hellerstein, and J. Malik, "Blobworld: A system for region-based image indexing and retrieval," in Proc. 3rd Int. Conf. Visual Information Systems, 1999.
38. J. R. Smith and S. F. Chang, "VisualSEEK: A fully automated content-based image query system," in Proc. ACM Int. Conf. Multimedia, Boston, Nov. 1996, pp. 87-98.
39. A. Vailaya, M. A. T. Figueiredo, A. K. Jain, and H. Zhang, "Image classification for content-based indexing," IEEE Trans. Image Processing, vol. 10, pp. 117-130, Jan. 2001.
40. S. Newsman, B. Sumengen, and B. S. Manjunath, "Category-based image retrieval," in Proc. IEEE Int. Conf. Image Processing Special Session on Multimedia Indexing, Browsing and Retrieval, Thessaloniki, Greece, Sept. 2001.
41. M. L. Kherfi, D. Ziou, and A. Bernardi, "Combining positive and negative examples in relevance feedback for content-based image retrieval," J. Vis. Commun. Image Representation, vol. 14, pp. 428-457, 2003.
42. H. P. Graf, E. Cosatto, D. Gibbon, M. Kocheison, and E. Petajan, " Multimodal system for location heads and faces," in Proc. 2nd IEEE Int. Conf. Automatic Face and Gesture Recognition, 1996, pp. 88-93.
43. M. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 34-58, Jan. 2002.
44. M. Yang and N. Ahuja, "Extracting gestural motion trajectory," in Proc. 3rd Int. Conf. Automatic Face and Gesture Recognition, 1998, pp. 10-15.
45. J. Yang, W. Lu, and A. Waibel, "Skin-color modeling and adaption," in Proc. Asian Conf. Computer Vision, 1998, pp. 687-694.
46. G. Wyszecki and W. S. Styles, Color Science: Concepts and Methods, Quantative Data and Formulae, 2nd ed. New York: Wiley, 1982.