Practical Bayesian estimation of a finite beta mixture through gibbs sampling and its applications

Statistics and Computing

Volumn 16, Issue 2, 2006, Pages 215-225

  Bouguila, Nizar ^a   Ziou, Djemel ^a   Monga, Ernest ^a  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

Author keywords

Bayesian analysis; Beta distribution; EM; Gibbs sampling; Maximum likelihood; Metropolis Hastings; Mixture modeling; SAR images; SEM

Indexed keywords

EID: 33646682404     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-006-8451-7     Document Type: Article

References (29)

1. McLachlan G. J. and Peel D. 2000. Finite Mixture Models. New York: Wiley.
2. Everitt B. S. and Hand D. J. 1981. Finite Mixture Distributions. Chapman and Hall, London, UK.
3. Roberts S. J. and Rezek L. 1998. Bayesian Approach to Gaussian Mixture Modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11): 1133-1142.
4. Samuel K., Ng K. W., and Fang K. 1990. Symmetric Multivariate and Related Distributions. London/New York: Chapman and Hall.
5. Bouguila N., Ziou D., and Vaillancourt J. November 2004. Unsupervised Learning of a Finite Mixture Model Based on the Dirichlet Distribution and its Application. IEEE Transactions on Image Processing 13(11): 1533-1543.
6. Beckman R. J. and Tietjen G. L. 1978. Maximum Likelihood Estimation for the Beta Distribution. Journal of Statistics and Computational Simulation 7: 253-258.
7. Klieter G. 1992. Bayesian Diagnosis in Expert Systems. In AIJ92.
8. Lee J. C. and Lio Y. L. 1999. A Note on Bayesian Estimation and Prediction for the Beta-binomial Model. Journal of Statistical Computation and Simulation (63): 73-91.
9. Dempster A. P., Laird N. M., and Rubin D. B. 1977. Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, B 39: 1-38.
10. McLachlan G. J. and Krishnan T. 1997. The EM Algorithm and Extensions. New York: Wiley.
11. Robert C. P. and Casella G. 1999. Monte Carlo Statistical Methods. Springer-Verlag.
12. Diebolt J. and Robert C. P. 1994. Estimation of Finite Mixture Distributions Through Bayesian Sampling. Journal of the Royal Statistical Society. B 56(2): 363-375.
13. Tsung I. L., Jack C. L., and Huey F. N. 2004. Bayesian Analysis of Mixture Modeling Using the Multivariate t Distribution. Statistics and Computing 14: 119-130.
14. Tsionas E. G. 2004. Bayesian Inference for Multivariate Gamma Distributions. Statistics and Computing 14: 223-233.
15. Celeux G. and Diebolt J. 1985. The SEM Algorithm: a Probabilistic Teacher Algorithm Derived from the EM Algorithm for the Mixture Problem. Computational Statistics Quarterly 2(1): 73-82.
16. Celeux G. and Diebolt J. 1992. A Stochastic Approximation Type EM Algorithm for the Mixture Problem. Stochastics and Stochastics Reports 41: 119-134.
17. Escobar M. and West M. 1995. Bayesian Prediction and Density Estimation. Journal of the American Statistical Association 90: 577-588.
18. Marin J. M., Mengersen K., and Robert C. P. 2004. Bayesian modeling and inference on mixtures of distributions. In D. Dey and C.R. Rao, editors, Handbook of Statistics 25. Elsevier-Sciences.
19. Robert C. P. and Rousseau J. 2002. A Mixture Approach To Bayesian Goodness of Fit. Technical Report 02009, Cahier du CEREMADE, Université Paris Dauphine.
20. Casella G., Mengersen K., Robert C., and Titterington D. 2000. Perfect Slice Samplers for Mixtures of Distributions. Journal of the Royal Statistical Society. B 64(4): 777-790.
21. Bezdek J. C. 1981. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press. New York.
22. Fielitz B. D and Myers B. L 1975. Estimation of Parameters in the Beta Distribution. Decision Sciences 6: 1-13, 1975.
23. Crawford S. L. 1994. An application of the Laplace Method to Finite Mixture Distributions. Journal of the American Statistical Association 89: 259-267.
24. Schwarz G. 1978. Estimating the Dimension of a Model. Annals of Statistics 6: 461-464.
25. Biernacki C., Celeux G. and Govaert G. 2000. Assessing a Mixture Model for Clustering with the Integrated Complete Likelihood. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(7): 719-725.
26. Kass R. E. and Raftery A. E. 1995. Bayes Factor. Journal of the American Statistical Association 90: 733-795.
27. Roeder K. and Wasserman L. 1997. Practical Bayesian Density Estimation Using Mixture of Normals. Journal of the American Statistical Association 92: 894-902.
28. Richardson S. and Green P. J. 1997. On Bayesian Analysis of Mixtures with an Unknown Number of Components (With Discussion). Journal of the Royal Statistical Society. B 59: 731-792.
29. Stephens M. 2000. Bayesian Analysis of mixture Models with an Unknown Number of Components: An Alternative to reversible Jump Methods. Annals of Statistics 28:40-74.