Model choice using reversible jump Markov chain Monte Carlo

Statistica Neerlandica

Volumn 66, Issue 3, 2012, Pages 309-338

  Hastie, David I ^a   Green, Peter J ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Across model sampling; Bayes factors; Bayesian model determination; Posterior model probabilities; Transdimensional inference; Variable dimension problems

Indexed keywords

EID: 84864003110     PISSN: 00390402     EISSN: 14679574     Source Type: Journal    
DOI: 10.1111/j.1467-9574.2012.00516.x     Document Type: Article

References (56)

1. Al-Awadhi, F., M. Hurn and C. Jennison (2004), Improving the acceptance rate of reversible jump MCMC proposals. Statistics & Probability Letters 69, 189-198.
2. Andrieu, C., N. de Freitas and A. Doucet (2000), Reversible jump MCMC simulated annealing for neural networks, in: Uncertainty in artificial intelligence, Morgan Kauffman, San Francisco, CA, pp. 11-18.
3. Bartolucci, F., L. Scaccia and A. Mira (2006), Efficient Bayes factor estimation from the reversible jump output. Biometrika 93, 41-52.
4. Besag, J. E. (1997), Contribution to the discussion of paper by Richardson and Green. Journal of the Royal Statistical Society, B 59, 774.
5. J. E. Besag (2000), Markov chain Monte Carlo for statistical inference. Technical Report Working paper no. 9, Center for Statistics and the Social Sciences, University of Washington.
6. Besag, J. E., P. J. Green, D. Higdon and K. Mengersen (1995), Bayesian computation and stochastic systems (with discussion). Statistical Science 10, 3-66.
7. Brooks, S. and A. Gelman (1998), Some issues in monitoring convergence of iterative simulations, in: American Statistical Association: 1998 Proceedings of the Statistical Computing Section, ASA.
8. Brooks, S. P. (1998), Markov chain Monte Carlo method and its application. The Statistician 47, 69-100.
9. Brooks, S. P. and P. Giudici (2000), Markov chain Monte Carlo convergence assessment via two-way analysis of variance. Journal of Computational Graphical Statistics 9, 266-285.
10. Brooks, S. P., N. Friel and R. King (2003a), Classical model selection via simulated annealing. Journal of the Royal Statistical Society Series B-Statistical Methodology 65, 503-520
11. Brooks, S. P., P. Giudici and G. O. Roberts (2003b) Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions. Journal of the Royal Statistical Society Series B-Statistical Methodology 65, 3-39.
12. Brooks, S. P., Y. Fan and J. S. Rosenthal (2006), Perfect forward simulation via simulated tempering. Comm. In Statistics-Simulation Computation 35, 683-713.
13. Cappé, O., C. P. Robert and T. Ryden (2003), Reversible jump, birth-and-death and more general continuous time Markov chain Monte Carlo samplers. Journal of the Royal Statistical Society Series B-Statistical Methodology 65, 679-700.
14. Cappé, O., A. Guillin, J. M. Marin and C. P. Robert (2004), Population Monte Carlo. Journal of Computational Graphical Statistics 13, 907-929.
15. Carlin, B. P. and S. Chib (1995), Bayesian model choice via Markov chain Monte Carlo. Journal of the Royal Statistical Society, B 57, 473-484.
16. Dellaportas, P., J. J. Forster and I. Ntzoufras (2002), On Bayesian model and variable selection using MCMC. Statistics and Computing 12, 27-36.
17. Didelot, X., R. G. Everitt, A. M. Johansen and D. J. Lawson (2011), Likelihood-free estimation of model evidence. Bayesian Analysis 6, 49-76.
18. Doucet, A., J. F. G. De Frietas and N. J. Gordon (2001), Sequential Monte Carlo methods in practice. Springer, New York.
19. Ehlers, R. S. and S. P. Brooks (2008), Adaptive proposal construction for reversible jump MCMC. Scandinavian Journal of Statistics 35, 677-690.
20. Erland, S. (2003) On adaptivity and Eigen-decompositions of Markov chains. Ph.D. Thesis, Department of Mathematical Sciences, Norwegian University of Science and Technology.
21. Figueiredo, M. A. T. and A. K. Jain (2002), Unsupervised learning of finite mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 381-396.
22. Gamerman, D. (1997), Markov Chain Monte Carlo: stochastic simulation for Bayesian inference. Chapman & Hall/CRC, New York.
23. Geman, S. and D. Geman (1984), Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Transcation on Pattern Analysis and Machine Intelligen 6, 721-741.
24. Godsill, S. J. (2001), On the relationship between Markov chain Monte Carlo methods for model uncertainty. J. Computational Graphical Statistics 10, 230-248.
25. Godsill, S. J. (2003), Proposal densities and product-space methods, in: P.J. Green, N.L. Hjort, S. Richardson (eds), Highly Structured Stochastic Systems. Oxford University Press, Oxford. pp. 199-203.
26. Gramacy, R., R. Samworth and R. King (2008), Importance tempering. Technical report, Statistical Laboratory, University of Cambridge.
27. Green, P. J. (1995), Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711-732.
28. Green, P. J. (2003), Trans-dimensional Markov chain Monte Carlo, in: P.J. Green, N.L. Hjort, S. Richardson (eds), Highly Structured Stochastic Systems. Oxford University Press, Oxford. pp. 179-198.
29. Green, P. J. and A. Mira (2001), Delayed rejection in reversible jump Metropolis-Hastings. Biometrika 88, 1035-1053.
30. Green, P. J. and A. O'Hagan (1998), Model choice with MCMC on product spaces without using pseudo-priors. Technical report, Department of Mathematics, University of Nottingham, Nottingham.
31. Green, P. J. and S. Richardson (2001), Modelling heterogeneity with and without the Dirichlet process. Scandinavian Journal of Statistics 28, 355-375.
32. Grenander, U. and M. I. Miller (1994), Representations of knowledge in complex systems (with discussion). Journal of the Royal Statistical Society, B 56, 549-603.
33. Han, C. and B. P. Carlin (2001), Markov chain Monte Carlo methods for computing Bayes factors: a comparative review. Journal of American Statistical Association 96, 1122-1132.
34. Hastie, D. I. (2005), Towards automatic reverible jump Markov chain Monte Carlo. Ph.D. Thesis, Department of Mathematics, University of Bristol, Bristol.
35. Heikkinnen, J. (2003), Trans-dimensional Bayesian nonparametrics with spatial point processes, in: P.J. Green, N.L. Hjort, S. Richardson (eds), Highly Structured Stochastic Systems. Oxford University Press, Oxford. pp. 203-206.
36. Jasra, A., D. A. Stephens and C. C. Holmes (2007), Population-based reversible jump Markov chain Monte Carlo. Biometrika 94, 787-807.
37. Jasra, A., A. Doucet, D. A. Stephens and C. C. Holmes (2008), Interacting sequential Monte Carlo samplers for trans-dimensional simulation. Computational Statistics & Data Analysis 52, 1765-1791.
38. Keith, J. M., D. P. Kroese and D. Bryant (2004), A generalized Markov sampler. Methodology Computing In Applied Probability 6, 29-53.
39. Liang, F. M. and W. H. Wong (2000), Evolutionary Monte Carlo: applications to C-p model sampling and change point problem. Statistica Sinica 10, 317-342.
40. Meng, X.-L. and W. H. Wong (1996), Simulating ratios of normalizing constants via a simple identity: a theoretical exploration. Statistica Sinica 6, 831-860.
41. Newton, M. A. and D. I. Hastie (2006), Assessing Poisson variation of intestinal tumour multiplicity in mice carrying a Robertsonian translocation. Journal of the Royal Statistical Society Series C-Applied Statistics 55, 123-138.
42. Petris, G. and L. Tardella (2003), A geometric approach to transdimensional Markov chain Monte Carlo. Canadian Journal of Statistics-revue Canadienne De Statistique 31, 469-482.
43. Preston, C. J. (1977) Spatial birth-and-death processes. Bulletin of the International Statistical Institute 46, 371-391.
44. Richardson, S. and P. J. Green (1997), On Bayesian analysis of mixtures with an unknown number of components (with discussion). Journal of the Royal Statistical Society, B 59, 731-792.
45. Ripley, B. D. (1977), Modelling spatial patterns (with discussion). Journal of the Royal Statistical Society, B 39, 172-212.
46. Roberts, G. O. and J. S. Rosenthal (1998), Optimal scaling of discrete approximations to Langevin diffusions. Journal of the Royal Statistical Society, B 60, 255-268.
47. Roberts, G. O. and Rosenthal, J. S. (2006), Harris recurrence of Metropolis-within-Gibbs and trans-dimensional Markov chains. Annals of Applied Probability 16, 2123-2139.
48. Roberts, G. O., A. Gelman and W. R. Gilks (1997), Weak convergence and optimal scaling of random walk metropolis algorithms. Annals of Applied Probability 7, 110-120.
49. Rosenthal, J. S. (2011), Optimal proposal distributions and adaptive MCMC, in: S. Brooks, A. Gelman, G. Jones, and X.-L. Meng (eds), Handbook of Markov Chain Monte Carlo. Chapman and Hall, CRC Handbooks of Modern Statistical Methods, Boca Raton. pp. 93-112.
50. Sisson, S. A. (2005), Transdimensional Markov chains: a decade of progress and future perspectives. Journal of American Statistical Association 100, 1077-1089.
51. Sisson, S. A. and Y. Fan (2007) A distance-based diagnostic for trans-dimensional Markov chains. Statistics and Computing 17, 357-367.
52. Spirling, A. (2007), ''Turning points" in the Iraq conflict: reversible jump Markov chain Monte Carlo in political science. American Statistician 61, 315-320.
53. Stephens, M. (2000), Bayesian analysis of mixture models with an unknown number of components - an alternative to reversible jump methods. Annals of Statistics 28, 40-74.
54. Tierney, L. and A. Mira (1999), Some adaptive Monte Carlo methods for Bayesian inference. Statistics in Medicine 18, 2507-2515.
55. Tjelmeland, H. and B. K. Hegstad (2001), Mode jumping proposals in MCMC. Scandinavian Journal of Statistics 28, 205-223.
56. Waagepetersen, R. and D. Sorensen (2001), A tutorial on reversible jump MCMC with a view toward applications in QTL-mapping. International Statistical Review 69, 49-61.