Markov chain Monte Carlo method and its application

Journal of the Royal Statistical Society Series D: The Statistician

Volumn 47, Issue 1, 1998, Pages 69-100

  Brooks, Stephen P ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Bayesian statistics; Gibbs sampler; Metropolis Hastings updating; Simulation; Software

Indexed keywords

EID: 0346205399     PISSN: 00390526     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9884.00117     Document Type: Article

References (116)

1. Almond, R. (1995) Graphical Belief Modelling. London: Chapman and Hall.
2. Amit, Y. (1991) On rates of convergence of stochastic relaxation for Gaussian and non-Gaussian distributions. J. Multiv. Anal., 38, 82-99.
3. Amit, Y. and Grenander, U. (1991) Comparing sweep strategies for stochastic relaxation. J. Multiv. Anal., 37, 197-222.
4. Applegate, D., Kannan, R. and Polson, N. G. (1990) Random polynomial time algorithms for sampling from joint distributions. Technical Report 500. Carnegie Mellon University, Pittsburgh.
5. Asmussen, S., Glynn, P. W. and Thorisson, H. (1992) Stationarity detection in the initial transient problem. ACM Trans. Modllng Comput. Simuln, 2, 130-157.
6. Berzuini, C., Best, N. G., Gilks, W. R. and Larizza, C. (1997) Dynamic graphical models and Markov chain Monte Carlo methods. J. Am. Statist. Ass., to be published.
7. Besag, J. and Green, P. J. (1993) Spatial statistics and Bayesian computation. J. R. Statist. Soc. B, 55, 25-37.
8. Besag, J. E., and York, J. C. (1989) Bayesian restoration of images. In Analysis of Statistical Information (ed. T. Matsunawa), pp. 491-507. Tokyo: Institute of Statistical Mathematics.
9. Bowmaker, J. K., Jacobs, G. H., Spiegelhalter, D. J. and Mollon, J. D. (1985) Two types of trichromatic squirrel monkey share a pigment in the red-green region. Vis. Res., 25, 1937-1946.
10. Brooks, S. P. (1996) Quantitative convergence diagnosis for MCMC via CUSUMS. Technical Report. University of Bristol, Bristol.
11. _ (1997) Discussion on On Bayesian analysis of mixtures with an unknown number of components (by S. Richardson and P. J. Green). J. R. Statist. Soc. B, 59, 774-775.
12. _ (1998) MCMC convergence diagnosis via multivariate bounds on log-concave densities. Ann. Statist., to be published.
13. Brooks, S. P., Dellaplortas, P. and Roberts, G. O. (1997) A total variation method for diagnosing convergence of MCMC algorithms. J. Comput. Graph. Statist., 6, 251-265.
14. Brooks, S. P. and Gelman, A. (1997) Alternative methods for monitoring convergence of iterative simulations. J. Comput. Graph. Statist., to be published.
15. Brooks, S. P. and Morgan, B. J. T. (1994) Automatic starting point selection for function optimisation. Statist. Comput., 4, 173-177.
16. Brooks, S. P. and Roberts, G. O. (1996) Discussion on Convergence of Markov chain Monte Carlo algorithms (by N. G. Polson). In Bayesian Statistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press.
17. Buck, C. E., Cavanagh, W. G. and Litton, C. D. (1996) Bayesian Approach to Interpreting Archaeological Data. Chishester: Wiley.
18. Buck, C. E., Litton, C. D. and Stephens, D. A. (1993) Detecting a change in the shape of a prehistoric corbelled tomb. Statistician, 42, 483-490.
19. Cai, H. (1997) A note on an exact sampling algorithm and Metropolis-Hastings Markov chains. Technical Report. University of Missouri, St Louis.
20. Chan, K. S. (1993) Asymptotic behaviour of the Gibbs sampler. J. Am. Statist. Ass., 88, 320-328.
21. Chib, S. and Greenberg, E. (1995) Understanding the Metropolis-Hastings algorithm. Am. Statistn, 49, 327-335.
22. Cowles, M. K. and Carlin, B. P. (1996) Markov chain Monte Carlo convergence diagnostics: a comparative review. J. Am. Statist. Ass., 91, 883-904.
23. Cowles, M. K. and Rosenthal, J. S. (1996) A simulation approach to convergence rates for Markov chain Monte Carlo. Technical Report. Harvard School of Public Health, Boston.
24. Damien, P., Wakefield, J. and Walker, S. (1997) Gibbs sampling for Bayesian nonconjugate and hierarchical models using auxiliary variables. Technical Report. University of Michigan Business School, Ann Arbor.
25. Diaconis, P. and Stroock, D. (1991) Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Probab., 1, 36-61.
26. Diebolt, J. and Robert, C. P. (1994) Estimation of finite mixture distributions through Bayesian sampling. J. R. Statist. Soc. B, 56, 363-375.
27. Edwards, D. (1995) Introduction to Graphical Modelling. New York: Springer.
28. Edwards, R. G. and Sokal, A. D. (1988) Generalisation of the Fortuin-Kasteleyn-Swendsen-Wang representation and Monte Carlo algorithm. Phys. Rev. Lett., 38, 2009-2012.
29. Feng, Z. D. and McCulloch, C. E. (1996) Using bootstrap likelihood ratios in finite mixture models. J. R. Statist. Soc. B, 58, 609-617.
30. Foss, S. G. and Tweedie, R. L. (1997) Perfect simulation and backward coupling. Technical Report. Institute of Mathematics, Novosibirsk.
31. Gafarian, A. V., Ancker, C. J. and Morisaku, T. (1978) Evaluation of commonly used rules for detecting "steady state" in computer simulation. Nav. Res. Logist. Q., 25, 511-529.
32. Garren, S. and Smith, R. L. (1995) Estimating the second largest eigenvalue of a Markov transition matrix. Technical Report. University of Cambridge, Cambridge.
33. Gelfand, A. E., Hills, S. E., Racine-Poon, A. and Smith, A. F. M. (1990) Illustration of Bayesian inference in normal data models using Gibbs sampling. J. Am. Statist. Ass., 85, 972-985.
34. Gelfand, A. E., Sahu, S. K. and Carlin, B. P. (1995) Efficient parameterizations for normal linear mixed models. Biometrika, 82, 479-488.
35. Gelfand, A. E., and Smith, A. F. M. (1990) Sampling based approaches to calculating marginal densities. J. Am. Statist. Ass., 85, 398-409.
36. Gelman, A. and Rubin, D. (1992) Inference from iterative simulation using multiple sequences. Statist. Sci., 7, 457-511.
37. Geman, S. and Geman, D. (1984) Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattn Anal. Mack. Intell., 6, 721-741.
38. Geweke, J. (1992) Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. In Bayesian Statistics 4 (eds J. M. Bernardo, A. F. M. Smith, A. P. Dawid and J. O. Berger), pp. 169-193. Oxford: Oxford University Press.
39. Geyer, C. J. (1990) Reweighting Monte Carlo mixtures. Technical Report. University of Minnesota, Minneapolis.
40. _ (1991) Markov chain Monte Carlo likelihood. In Computing Science and Statistics: Proc. 23rd Symp. Interface (ed. E. M. Keramidas), pp. 156-163. Fairfax Station: Interface Foundation.
41. _ (1992) Practical Markov chain Monte Carlo. Statist. Sci., 7, 473-511.
42. Geyer, C. J. and Møller, J. (1994) Simulation procedures and likelihood inference for spatial point processes. Scand. J. Statist., 21, 359-373.
43. Geyer, C. J. and Thompson, E. A. (1995) Annealing Markov chain Monte Carlo with applications to ancestral inference. J. Am. Statist. Ass., 90, 909-920.
44. Gilks, W. R. and Roberts, G. O. (1996) Improving MCMC mixing. In Markov Chain Monte Carlo in Practice (eds W. R. Gilks, S. Richardson and D. J. Spiegelhalter). London: Chapman and Hall.
45. Gilks, W. R., Thomas, D. and Spiegelhalter, D. J. (1992) Software for the Gibbs sampler. Comput. Sci. Statist., 24, 439-448.
46. Gilks, W. R. and Wild, P. (1992) Adaptive reaction sampling for Gibbs sampling. Appl. Statist., 41, 337-348.
47. Green, P. J. (1995) Reversible jump MCMC computation and Bayesian model determination. Biometrika, 82, 711-732.
48. Grenander, U. and Miller, M. I. (1994) Representations of knowledge in complex systems (with discussion). J. R. Statist. Soc. B, 56, 549-603.
49. Haggstrom, O., van Lieshout, M. N. M. and Møller, J. (1996) Characterisation results and Markov chain Monte Carlo algorithms including exact simulation for some spatial point processes. Technical Report. Department of Mathematics, Aalborg University, Aalborg.
50. Hastings, W. K. (1970) Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
51. Heidelberger, P. and Welch, P. D. (1983) Simulation run length control in the presence of an initial transient. Ops Res., 31, 1109-1144.
52. Higdon, D. (1996) Auxiliary variable methods for Markov chain Monte Carlo with applications. Technical Report. Institute of Statistics and Decision Sciences, Duke University, Durham.
53. Hills, S. E. and Smith, A. F. M. (1992) Parameterization issues in Bayesian inference. In Bayesian Statistics 4 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press.
54. Hinkley, D. V. (1969) Inference about the intersection of two-phase regression. Biometrika, 56, 495-504.
55. _ (1971) Inference in two-phase regression. J. Am. Statist. Ass., 66, 736-743.
56. Ikeda, N. and Watanabe, S. (1989) Stochastic Differential Equations and Diffusion Processes. Amsterdam: Elsevier.
57. Kass, R. E., Carlin, B. P., Gelman, A. and Neal, R. M. (1997) MCMC in practice: a roundtable discussion. Am. Statistn, to be published.
58. Kendall, W. S. (1996) Perfect simulation for the area-interaction point process. Technical Report. University of Warwick, Coventry.
59. Kimbler, D. L. and Knight, B. D. (1987) A survey of current methods for the elimination of initialization bias in digital simulation. In Proc. 20th A. Simulation Symp., pp. 133-152.
60. Lauritzen, S. L. (1996) Graphical Models. Oxford: Oxford University Press.
61. Lauritzen, S. L. and Spiegelhalter, D. J. (1988) Local computations with probabilities on graphical structures and their application to expert systems (with discussion). J. R. Statist. Soc. B, 50, 157-224.
62. 2 spectrum for Markov chains and their applications. Trans. Am. Math. Soc., 309, 557-580.
63. Liu, C., Liu, J. and Rubin, D. B. (1993) A control variable for assessment of the convergence of the Gibbs sampler. Proc. Statist. Comput. Sect. Am. Statist. Ass., 74-78.
64. Liu, J. S. (1994) Metropolized independent sampling with comparisons to rejection sampling and importance sampling. Technical Report. Harvard University, Cambridge.
65. Madigan, D. and York, J. (1995) Bayesian graphical models for discrete data. Int. Statist. Rev., 63, 215-232.
66. Marinari, E. and Parisi, G. (1992) Simulated tempering: a new Monte Carlo scheme. Europhys. Lett., 19, 451-458.
67. McLachlan, G. J. and Basford, K. E. (1988) Mixture Models: Inference and Applications to Clustering. New York: Dekker.
68. Mengersen, K. and Robert, C. (1996) Testing for mixtures: a Bayesian entropy approach. In Bayesian Statistics 5 (eds J. M. Bernardo, A F. M. Smith, A. P. Dawid and J. O. Berger). Oxford: Oxford University Press.
69. Mengersen, K. L. and Tweedie, R. L. (1995) Rates of convergence of the Hastings and Metropolis algorithms. Ann. Statist., 24, 101-121.
70. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953) Equations of state calculations by fast computing machines. J. Chem. Phys., 21, 1087-1091.
71. Meyn, S. P. and Tweedie, R. E. (1993) Markov Chains and Stochastic Stability. New York: Springer.
72. _ (1994) Computable bounds for geometric convergence rates of Markov chains. Ann. Appl. Probab., 4, 981-1011.
73. Mira, A. and Tierney, L. (1997) On the issue of auxiliary variables in Markov chain Monte Carlo sampling. Technical Report. University of Minnesota, Minneapolis.
74. Møller, J. (1997) Markov chain Monte Carlo and spatial point processes. In Stochastic Geometry, Likelihood and Computation (eds W. S. Kendall and M. N. M. van Lieshout). New York: Chapman and Hall.
75. Murdoch, D. J. and Green, P. J. (1997) Exact sampling from a continuous state space. Technical Report. Queen's University. Kingston.
76. Mykland, P., Tierney, L. and Yu, B. (1995) Regeneration in Markov chain samplers. J. Am. Statist. Ass., 90, 233-241.
77. Neal, R. M. (1993) Probabilistic inference using Markov chain Monte Carlo methods. Technical Report CRG-TR-93-1. Department of Computer Science, University of Toronto, Toronto.
78. Nobile, A. (1994) Bayesian analysis of finite mixture distributions. PhD Thesis. Carnegie Mellon University, Pittsburgh.
79. Peskun, P. H. (1973) Optimun Monte Carlo sampling using Markov chains. Biometrika, 60, 607-612.
80. Phillips, D. B. and Smith, A. F. M. (1996) Bayesian model comparison via jump diffusions. In Practical Markov Chain Monte Carlo (eds W. R. Gilks, S. Richardson and D. J. Spiegelhalter). London: Chapman and Hall.
81. Polson, N. G. (1996) Convergence of Markov chain Monte Carlo algorithms. In Bayesian Statistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press.
82. Propp, J. G. and Wilson, D. B. (1996) Exact sampling with coupled Markov chains and applications to statistical mechanics. Rand. Struct. Alg., 9, 223-252.
83. Raftery, A. E. and Lewis, S. M. (1992) How many iterations in the Gibbs sampler? In Bayesian Statistics 4 (eds J. M. Bernardo, A. F. M. Smith, A. P. Dawid and J. O. Berger). Oxford: Oxford University Press.
84. Richardson, S. and Green, P. J. (1997) On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. R. Statist. Soc. B, 59, 731-792.
85. Ritter, C. and Tanner, M. A. (1992) Facilitating the Gibbs sampler: the Gibbs stopper and the griddy-Gibbs sampler. J. Am. Statist., Ass., 87, 861-868.
86. Robert, C. (1995) Mixtures of distributions: inference and estimation. In Practical Markov Chain Monte Carlo (eds W. R. Gilks, S. Richardson and D. J. Spiegelhalter). London: Chapman and Hall.
87. _ (1996) Convergence assessments for Markov chain Monte Carlo methods. Statist. Sci., 10, 231-253.
88. Robert, C. P. and Mengersen, K. L. (1995) Reparameterisation issues in mixture modelling and their bearing on the Gibbs sampler. Technical Report. Laboratoire de Statistique, Paris.
89. 2 convergence of Markov chain Monte Carlo. In Bayesian Statistics and Econometrics: Essays in Honor of Arnold Zellner (eds D. Berry, K. Chaloner and J. Geweke). Amsterdam: North-Holland.
90. Roberts, G. O. and Polson, N. G. (1994). On the geometric convergence of the Gibbs sampler. J. R. Statist. Soc. B, 56, 377-384.
91. Roberts, G. O. and Rosenthal, J. S. (1996) Quantitative bounds for convergence rates of continuous time Markov chains. Technical Report. University of Cambridge, Cambridge.
92. _ (1997) Convergence of slice sampler Markov chains. Technical Report. University of Cambridge, Cambridge.
93. Roberts, G. O. and Sahu, S. K. (1997) Updating schemes, correlation structure, blocking and parameterization for the Gibbs sampler. J. R. Statist. Soc. B, 59, 291-317.
94. Roberts, G. O. and Smith, A. F. M. (1994) Simple conditions for the convergence of the Gibbs sampler and Metropolis Hastings algorithms. Stoch. Process. Applic., 49, 207-216.
95. Roberts, G. O. and Tweedie, R. L. (1995) Exponential convergence of Langevin diffusions and their discrete approximations. Technical Report. University of Cambridge, Cambridge.
96. _ (1996) Geometric convergence and central limit theorems, for multidimensional Hastings and Metropolis algorithms. Biometrika, 83, 95-110.
97. Rosenthal, J. S. (1995a) Minorization conditions and convergence rates for Markov chain Monte Carlo. J. Am. Statist. Ass., 90, 558-566.
98. _ (1995b) Rates of convergence for Gibbs campling for variance component models. Ann. Statist., 23, 740-761.
99. _ (1995c) Rates of convergence for data augmentation on finite sample spaces. Ann. Appl. Probab., 3, 319-339.
100. Schervish, M. J. and Carlin, B. P. (1992) On the convergence of successive substitution sampling. J. Comput. Graph. Statist., 1, 111-127.
101. Sinclair, A. J. and Jerrum, M. R. (1988) Conductance and the rapid mixing property for Markov chains: the approximation of the permanent resolved. In Proc. 20th A. Symp. Theory of Computing.
102. Smith, A. F. M. (1991) Bayesian computational methods. Phil. Trans. R. Soc. Lond. A, 337, 369-386.
103. Smith, A. F. M. and Cook, D. G. (1980) Straight lines with a change-point: a Bayesian analysis of some renal transplant data. Appl. Statist., 29, 180-189.
104. Smith, A. F. M. and Roberts, G. O. (1993) Bayesian compitation via the Gibbs sampler and related Markov chain Monte Carlo methods. J. R. Statist. Soc. B, 55, 3-23.
105. Smith, R. L. and Tierney, L. (1996) Exact transition probabilities for the independence Metropolis sampler. Technical Report. Unibversity of Cambridge, Cambridge.
106. Speigelhalter, D. J., Thomas, A. and Best, N. G. (1996a) Computation on Bayesian graphical models. In Bayesian Satistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press.
107. Spiegelhalter, D. J., Thomas, A., Best, N. G. and Gilks, W. R. (1996b) BUGS: Bayesian Inference using Gibbs Sampling, Version 0.50. Cambridge: Medical Research Council Biostatistics Unit.
108. _ (1996c) BUGS Examples, vol. 2. Cambridge: Medical Research Council Biostatistics Unit.
109. Swendsen, R. H. and Wang, J. S. (1987) Non-universal critical dynamics in Monte Carlo simulations. Phys. Rev. Lett., 58, 86-88.
110. Tierney, L. (1994) Markov chains for exploring posterior distributions. Ann. Statist., 22, 1701-1762.
111. Titterington, D. M., Smith, A. F. M. and Makov, U. E. (1985) Statistical Analysis of Finite Mixture Distributions. Chichester: Wiley.
112. Wakefield, J. C., Gelfand, A. E. and Smith, A. F. M. (1991) Efficient generation of random variates via the ratio-of-uniforms method. Statist. Comput., 1, 129-133.
113. Whittaker, J. (1990) Graphical Models in Applied Multivariate Statistics. Chichester: Wiley.
114. 1 error of kernel estimator: monitoring convergence of Markov samplers. Technical Report. Department of Statistics, University of California, Berkeley.
115. Yu, B. and Mykland, P. (1997) Looking at Markov sampler through Cusum path plots: a simple diagnostic idea. Statist. Comput., to be published.
116. Zellner, A. and Min, C. (1995) Gibbs sampler convergence criteria. J. Am. Statist. Ass., 90, 921-927.