Variational Bayes approach for model aggregation in unsupervised classification with Markovian dependency

Computational Statistics and Data Analysis

Volumn 56, Issue 8, 2012, Pages 2375-2387

  Volant, Stevenn ^a,b   Martin Magniette, Marie Laure ^a,b,c   Robin, Stéphane ^a,b  

^a AGROPARISTECH   (France)

^b AgroParisTech   (France)

^c INSTITUTE OF PLANT SCIENCES PARIS SACLAY IPS2   (France)

Author keywords

Markov chain; Model averaging; Unsupervised classification; Variational Bayes inference

Indexed keywords

BAYESIAN MODEL AVERAGING; CLASSIFICATION PERFORMANCE; COMBINING MODEL; DATA SETS; MARKOVIAN; MIXTURE COMPONENTS; MIXTURE MODEL; MODEL AVERAGING; OPTIMAL APPROXIMATION; POSTERIOR PROBABILITY; SIMULATION STUDIES; UNSUPERVISED CLASSIFICATION; VARIATIONAL BAYES; VARIATIONAL BAYESIAN FRAMEWORKS; VARIATIONAL THEORY; WEIGHTED AVERAGES;

BAYESIAN NETWORKS; HIDDEN MARKOV MODELS; MARKOV PROCESSES; PROBABILITY;

ESTIMATION;

EID: 84859104152     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2012.01.027     Document Type: Article

References (28)

1. C. Andrieu An introduction to MCMC for machine learning Machine Learning 2003
2. L. Baum, T. Petrie, G. Soules, and N. Weiss A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains The Annals of Mathematical Statistics 41 1970 164 171
3. M.J. Beal, and Z. Ghahramani The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures Bayesian Statistics 2003
4. C. Berard, M.L. Martin-Magniette, V. Brunaud, S. Aubourg, and S. Robin Unsupervised classification for tiling arrays: chipchip and transcriptome Statistical Applications in Genetics and Molecular Biology 2011
5. A. Corduneanu, and C.M. Bishop Variational Bayesian model selection for mixture distributions Statistics in Medicine 18 2001 3463 3478
6. P. Delmar, S. Robin, and J.J. Daudin Varmixt: efficient variance modelling for the differential analysis of replicated gene expression data Bioinformatics 21 2005 502 508
7. J.A. Hoeting, D. Madigan, A.E. Raftery, and C.T. Volinsky Bayesian model averaging: a tutorial Statistical Science 14 1999 382 417
8. Jaakkola, T.S.; Jordan, M.I.; 1998, Improving the mean field approximation via the use of mixture distributions, pp. 163173.
9. Y. Le Strat, and F. Carrat Monitoring epidemiologic surveillance data using hidden Markov models Statistics in Medicine 18 1999 3463 3478
10. D. Madigan, and F. Hutchinson Enhancing the predictive performance of Bayesian graphical models Communications in Statistics: Theory and Methods 24 1995
11. D. Madigan, and A.E. Raftery Model selection and accounting for model uncertainty in graphical models using Occam's window Journal of the American Statistical Association 1993 1535 1546
12. Marin, J.; Robert, C.P.; 2010, Importance sampling methods for Bayesian discrimination between embedded models, 0910.2325.
13. C.A. McGrory, and D.M. Titterington Variational Bayesian analysis for hidden Markov models Australian & New Zealand Journal of Statistics 51 2006 227 244
14. G.J. McLachlan, R.W. Bean, and D. Peel A mixture model-based approach to the clustering of microarray expression data Bioinformatics 18 2002 413 422
15. G. Parisi Statistical Field Theory 1988 Addison Wesley
16. A. Raftery, and Y. Zheng Long-run performance of Bayesian model averaging Journal of the American Statistical Association 98 2003 931 938
17. B.S.F.A. Ren Q.; and J. Hodges Variational Bayesian methods for spatial data analysis Computational Statistics and Data Analysis 55 2011 3197 3217
18. C.P. Robert, and Casella Monte Carlo Statistical Methods second ed. 2004 Springer New York volume
19. S. Robin, A. Bar-Hen, J. Daudin, and L. Pierre A semi-parametric approach for mixture models: application to local false discovery rate estimation Computational Statistics and Data Analysis 51 2007 5483 5493
20. E. Ruggieri, and C.E. Lawrence On efficient calculations for Bayesian variable selection Computational Statistics and Data Analysis 2011
21. G. Schwarz Estimating the dimension of a model The Annals of Statistics 6 1978 461 464
22. W. Sun, and T. Cai Large-scale multiple testing under dependence Journal of the Royal Statistical Society 71 2009 393 424
23. C.T. Volinsky, D. Madigan, A.E. Raftery, and R.A. Kronmal Bayesian model averaging in proportional hazard models: assessing the risk of a stroke Applied Statistics 1997 433 448
24. M.J. Wainwright, and M.I. Jordan Graphical Models, Exponential Families, and Variational Inference 2008 Hanover MA, USA
25. B. Wang, and D.M. Titterington Lack of consistency of mean field and variational Bayes approximations for state space models Neural Processing Letters 20 2003 151 170
26. Wang, B.; Titterington, D.M.; 2003b, Local convergence of variational Bayes estimators for mixing coefficients, Technical report.
27. B. Wang, and D.M. Titterington Convergence and Asymptotic Normality of Variational Bayesian Approximations for Exponential Family Models with Missing Values 2004 AUAI Press
28. Wang, B.; Titterington, D.M.; 2004b, Inadequacy of interval estimates corresponding to variational Bayesian approximations.