On Bayesian analysis of a finite generalized Dirichlet mixture via a Metropolis-within-Gibbs sampling

Pattern Analysis and Applications

Volumn 12, Issue 2, 2009, Pages 151-166

  Bouguila, Nizar ^a   Ziou, Djemel ^b   Hammoud, Riad I ^c  

^a Concordia University ^*  (Canada)

^b UNIVERSITÉ DE SHERBROOKE   (Canada)

^c DELPHI CORPORATION   (United States)

Author keywords

Bayesian analysis; EM; Generalized Dirichlet mixture; Gibbs sampling; Images classification; Metropolis Hastings; SVM

Indexed keywords

EID: 60949093876     PISSN: 14337541     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10044-008-0111-4     Document Type: Article

References (70)

1. N Bouguila D Ziou 2006 A hybrid SEM algorithm for high-dimensional unsupervised learning using a finite generalized Dirichlet mixture IEEE Trans Image Process 15 9 2657 2668
2. McLachlan GJ, Peel D (2000) Finite mixture models. Wiley, New York
3. Titterington DM, Smith AFM, Markov UE (1985) Statistical analysis of finite mixture distributions. Wiley, New York
4. Everitt BS, Hand DJ (1981) Finite mixture distributions. Chapman and Hall, London
5. Hammoud RI, Mohr R (2000) Mixture densities for video objects recognition. In: Proceedings of the international conference on pattern recognition, ICPR2000, pp 2071-2075
6. M Funaro M Marinaro A Petrosino S Scarpetta 2002 Finding hidden events in astrophysical data using PCA and mixture of Gaussians clustering Pattern Anal Appl 5 15 22
7. AK Jain RPW Duin J Mao 2000 Statistical pattern recognition: a review IEEE Trans Pattern Anal Mach Intell 22 1 4 37
8. N Bouguila D Ziou J Vaillancourt 2004 Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application IEEE Trans Image Process 13 11 1533 1543
9. N Bouguila D Ziou 2006 Unsupervised selection of a finite Dirichlet mixture model: an MML-based approach IEEE Trans Knowl Data Eng 18 8 993 1009
10. N Bouguila D Ziou 2006 Online clustering via finite mixtures of Dirichlet and minimum message length Eng Appl Artif Intell 19 4 371 379
11. Bouguila N, Ziou D (2005) On fitting finite Dirichlet mixture using ECM and MML. In: Singh S, Singh M, Apté C, Perner P (eds) Pattern recognition and data mining, third international conference on advances in pattern recognition, ICAPR (1). Springer, LNCS, vol 3686. Springer, Heidelberg, pp 172-182
12. AP Dempster NM Laird DB Rubin 1977 Maximum likelihood from incomplete data via the EM algorithm J Roy Stat Soc B 39 1 38
13. McLachlan GJ, Krishnan T (1997) The EM algorithm and extensions. Wiley, New York
14. Robert CP, Casella G (1999) Monte Carlo statistical methods. Springer, Heidelberg
15. Scott DW, Thompson JR (1983) Probability density estimation in higher dimensions. Computer Science and Statistics, pp 173-179
16. J Diebolt CP Robert 1994 Estimation of finite mixture distributions through Bayesian sampling J Roy Stat Soc B 56 2 363 375
17. Neal RM (1991) Bayesian mixture modeling. In: Erickson GJ, Smith R, Neudorfer PO (eds) Maximum entropy and Bayesian methods: proceedings of the 11th international workshop on maximum entropy and Bayesian methods of statistical analysis. Kluwer, Dordrecht, pp 197-211
18. K Roeder L Wasserman 1997 Practical Bayesian density estimation using mixtures of normals J Am Stat Assoc 92 894 902
19. H Bensmail G Celeux A Raftery CP Robert 1997 Inference in model-based cluster analysis Stat Comput 7 1 10
20. IL Tsung CL Jack FN Huey 2004 Bayesian analysis of mixture modeling using the multivariate t distribution Stat Comput 14 119 130
21. EG Tsionas 2004 Bayesian inference for multivariate gamma distributions Stat Comput 14 223 233
22. N Bouguila D Ziou E Monga 2006 Practical Bayesian estimation of a finite beta mixture through Gibbs sampling and its applications Stat Comput 16 2 215 225
23. SP Brooks 2001 On Bayesian analyses and finite mixtures for proportions Stat Comput 11 179 190
24. RE Kass AE Raftery 1995 Bayes factors J Am Stat Assoc 90 773 795
25. S Richardson PJ Green 1997 On Bayesian analysis of mixtures with an unknown number of components (with discussion) J Roy Stat Soc B 59 731 792
26. Mengersen K, Robert CP (1996) Testing for mixtures: a Bayesian entropic approach (with discussion). In: Dawid A, Lindley D, Berger J, Bernardo J, Smith A (eds) Bayesian statistics, vol 5. Oxford University Press, Oxford, pp 255-276
27. S Sahu R Cheng 2003 A fast distance based approach for determining the number of components in mixtures Can J Stat 31 3 22
28. M Gruet A Philippe CP Robert 1999 MCMC control spreadsheets for exponential mixture estimation J Comput Graph Stat 8 298 317
29. M Stephens 2000 Bayesian analysis of mixture models with an unknown number of components: an alternative to reversible jump methods Ann Stat 28 40 74
30. O Cappé CP Robert T Rydén 2002 Reversible jump MCMC converging to birth-and-death MCMC and more general continuous time samplers J Roy Stat Soc B 65 679 700
31. Bouguila N, Ziou D (2004) A powerful finite mixture model based on the generalized Dirichlet distribution: unsupervised learning and applications. In: Proceedings of the 17th international conference on pattern recognition, ICPR2004, pp 280-283
32. Bouguila N, Ziou D (2004) Dirichlet-based probability model applied to human skin detection. In: IEEE international conference on acoustics, speech, and signal processing, ICASSP2004, pp 521-524
33. Bouguila N, Ziou D (2005) MML-based approach for high-dimensional learning using the generalized Dirichlet mixture. In: Proceedings of the 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05)-workshops, vol 03, p 53
34. N Bouguila D Ziou 2007 High-dimensional unsupervised selection and estimation of a finite generalized Dirichlet mixture model based on minimum message length IEEE Trans Pattern Anal Mach Intell 29 10 1716 1731
35. Kotz S, Balakrishnan N, Johnson NL (2000) Continous multivariate distributions, vol 1. Wiley-Interscience, New York
36. RJ Beckman GL Tietjen 1978 Maximum likelihood estimation for the beta distribution J Stat Comput Simulat 7 253 258
37. Bouguila N, Ziou D, Vaillancourt J (2003) Novel mixtures based on the Dirichlet distribution: application to data and image classification. In: machine learning and data mining in pattern recognition (MLDM2003). LNAI2734, pp 172-181
38. Marin JM, Mengersen K, Robert CP (2004) Bayesian modeling and inference on mixtures of distributions. In: Dey D, Rao CR (eds) Handbook of statistics, vol 25. Elsevier, Amsterdam
39. Robert CP (2001) The Bayesian choice. Springer, Heidelberg
40. Lee PM (1997) Bayesian statistics: an introduction. Arnold
41. GD Kleiter 1992 Bayesian diagnosis in expert systems Artif Intell 54 1-2 1 32
42. E Castillo AS Hadi C Solares 1997 Learning and updating of uncertainty in Dirichlet models Mach Learn 26 1 43 63
43. G Celeux M Hurn CP Robert 2000 Computational and inferential difficulties with mixture posterior distributions J Am Stat Assoc 95 957 970
44. SM Lewis AE Raftery 1997 Estimating Bayes factors via posterior simulation with the Laplace-Metropolis estimator J Am Stat Assoc 92 648 655
45. G Schwarz 1978 Estimating the dimension of a model Ann Stat 6 461 464
46. J Rissanen 1978 Modeling by shortest data description Automatica 14 465 471
47. RE Kass L Wasserman 1995 A reference Bayesian test for nested hypothesis and its relationship to the Schwarz Criterion J Am Stat Assoc 90 928 934
48. Grauman K, Betke M, Gips J, Bradski GR (2001) Communication via eye blinks: detection and duration analysis in real time. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1010-1017
49. Haro A, Flickner M, Essa I (2000) Detecting and tracking eyes by using their physiological properties. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 163-168
50. Hansen DW, Hammoud RI (2005) Boosting particle filter-based eye tracker performance through adapted likelihood function to reflexions and light changes. In: IEEE conference on advanced video and signal based surveillance, pp 111-116
51. Hansen DW, Hansen JP, Nielsen M, Johansen AS (2003) Eye typing using Markov and active appearance models. In: IEEE workshop on applications on computer vision, pp 132-136
52. Edenborough N, Hammoud RI, Harbach A et al (2004) Drowsy driver monitor from Delphi. In: Demo session, IEEE conference on computer vision and pattern recognition, CVPR
53. DW Hansen RI Hammoud 2007 An improved likelihood model for eye tracking Comp Vis Image Understanding 106 2 3
54. RT Al-Zubi DI Abu-Al-Nadi 2007 Automated personal identification system based on human Iris analysis Pattern Anal Appl 10 147 164
55. Hammoud RI (2005) A Robust eye position tracker based on invariant local features, eye motion, and infrared-eye responses. In: SPIE automatic target recognition XV, vol 5807, pp 35-43
56. Bouguila N, Ziou D, Hammoud RI (2007) A Bayesian non-Gaussian mixture analysis: application to eye modeling. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR)
57. X Jiang M Binkert B Achermann H Bunke 2000 Towards detection of glasses in facial images Pattern Anal Appl 3 9 18
58. Z Zhu Q Ji 2005 Robust real-time eye detection and tracking under variable lighting conditions and various face orientations Comp Vis Image Understanding 98 124 154
59. AK Jain A Vailaya 1996 Image retrieval using color and shape Pattern Recogn 29 8 1233 1244
60. RM Haralick K Shanmugan I Dinstein 1973 Texture features for image classification IEEE Trans Syst Man Cybern 8 610 621
61. T Randen JH Husoy 1999 Filtering for texture classication: a comparative study IEEE Trans Pattern Anal Mach Intell 21 4 291 310
62. M Unser 1986 Sum and difference histograms for texture classification IEEE Trans Pattern Anal Mach Intell 8 1 118 125
63. J Canny 1986 A computational approach to edge detection IEEE Trans Pattern Anal Mach Intell 8 679 698
64. Vapnik VN (1998) Statistical learning theory. Wiley, New York
65. Srivastava AN (2004) Mixture density Mercer Kernels: a method to learn kernels directly from data. In: Proceedings of the fourth SIAM international conference on data mining
66. Tian Y, Kanade T, Cohn JF (2000) Dual-state parametric eye tracking. In: Proceedings of IEEE international conference on automatic face and gesture recognition (FGR), pp 110-115
67. N Bouguila D Ziou 2007 Unsupervised learning of a finite discrete mixture: applications to texture modeling and image databases summarization J Vis Commun Image Representation 18 4 295 309
68. S Lyu H Farid 2005 How realistic is photorealistic? IEEE Trans Signal Process 53 845 850
69. Athitsos V, Swain MJ, Frankel C (1997) Distinguishing photographs and graphics on the World Wide Web. In: IEEE workshop on content-based access of image and video libraries, pp 10-17
70. J Huang SR Kumar M Mitra W Zhu R Zabih 1999 Spatial color indexing and applications Int J Comp Vis 35 3 245 268