Implementing MCMC: Estimating with confidence

Handbook of Markov Chain Monte Carlo

Volumn , Issue , 2011, Pages 175-198

  Flegal, James M ^a   Jones, Galin L ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85059361617     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (69)

1. Alexopoulos, C. and Goldsman, D. 2004. To batch or not to batch? ACM Transactions on Modeling and Computer Simulation, 14(1):76-114
2. Alexopoulos, C., Andradóttir, S., Argon, N. T., and Goldsman, D. 2006. Replicated batch means variance estimators in the presence of an initial transient. ACM Transactions on Modeling and Computer Simulation, 16:317-328
3. Atchadé, Y. F. and Perron, F. 2007. On the geometric ergodicity of Metropolis-Hastings algorithms. Statistics, 41:77-84
4. Bertail, P. and Clémençon, S. 2006. Regenerative block-bootstrap for Markov chains. Bernoulli, 12:689-712
5. Bratley, P., Fox, B. L., and Schrage, L. E. 1987. A Guide to Simulation. Springer, New York
6. Brockwell, A. E. 2006. Parallel Markov chain Monte Carlo by pre-fetching. Journal of Computational and Graphical Statistics, 15:246-261
7. Bühlmann, P. 2002. Bootstraps for time series. Statistical Science, 17:52-72
8. Casella, G. and Robert, C. P. 1996. Rao-Blackwellisation of sampling schemes. Biometrika, 83:81-94
9. Chan, K. S. and Geyer, C. J. 1994. Comment on Markov chains for exploring posterior distributions. Annals of Statistics, 22:1747-1758
10. Christensen, O. F., Møller, J., and Waagepetersen, R. P. 2001. Geometric ergodicity of Metropolis-Hastings algorithms for conditional simulation in generalized linear mixed models. Methodology and Computing in Applied Probability, 3:309-327
11. Cowles, M. K. and Carlin, B. P. 1996. Markov chain Monte Carlo convergence diagnostics: A comparative review. Journal of the American Statistical Association, 91:883-904
12. Cowles, M. K., Roberts, G. O., and Rosenthal, J. S. 1999. Possible biases induced by MCMC convergence diagnostics. Journal of Statistical Computing and Simulation, 64:87-104
13. Datta, S. and McCormick, W. P. 1993. Regeneration-based bootstrap for Markov chains. Canadian Journal of Statistics, 21:181-193
14. Doss, H. and Hobert, J. P. 2010. Estimation of Bayes factors in a class of hierarchical random effects models using a geometrically ergodic MCMC algorithm. Journal of Computational and Graphical Statistics, 19(2):295-312
15. Ferguson, T. S. 1996. A Course in Large Sample Theory. Chapman & Hall, London
16. Flegal, J. M. and Jones, G. L. 2010a. Batch means and spectral variance estimators in Markov chain Monte Carlo. Annals of Statistics, 38:1034-1070
17. Flegal, J. M. and Jones, G. L. 2010b. Quantile estimation via Markov chain Monte Carlo. Technical report, Department of Statistics, University of California, Riverside
18. Flegal, J. M. and Jones, G. L. 2010c. Sweave documentation for Implementing Markov chain Monte Carlo: Estimating with confidence. http://arXiv.org/abs/1006.5690
19. Flegal, J. M., Haran, M., and Jones, G. L. 2008. Markov chain Monte Carlo: Can we trust the third significant figure? Statistical Science, 23:250-260
20. Fosdick, L. D. 1959. Calculation of order parameters in a binary alloy by the Monte Carlo method. Physical Review, 116:565-573
21. Fristedt, B. and Gray, L. F. 1997. A Modern Approach to Probability Theory. Birkhäuser, Boston
22. Gelman, A. and Rubin, D. B. 1992. Inference from iterative simulation using multiple sequences (with discussion). Statistical Science, 7:457-511
23. Geyer, C. J. 1992. Practical Markov chain Monte Carlo (with discussion). Statistical Science, 7:473-511
24. Geyer, C. J. 1995. Conditioning in Markov chain Monte Carlo. Journal of Computational and Graphical Statistics, 4:148-154
25. Geyer, C. J. 1999. Likelihood inference for spatial point processes. In O. E. Barndorff-Nielsen, W. S. Kendall, and M. N. M. van Lieshout (eds), Stochastic Geometry: Likelihood and Computation, pp. 79-140. Chapman & Hall/CRC, Boca Raton, FL
26. Glynn, P. W. and Heidelberger, P. 1991. Analysis of initial transient deletion for replicated steady-state simulations. Operations Research Letters, 10:437-443
27. Glynn, P. W. and Whitt, W. 1991. Estimating the asymptotic variance with batch means. Operations Research Letters, 10:431-435
28. Glynn, P. W. and Whitt, W. 1992. The asymptotic validity of sequential stopping rules for stochastic simulations. Annals of Applied Probability, 2:180-198
29. Hobert, J. P. and Geyer, C. J. 1998. Geometric ergodicity of Gibbs and block Gibbs samplers for a hierarchical random effects model. Journal of Multivariate Analysis, 67:414-430
30. Hobert, J. P., Jones, G. L., Presnell, B., and Rosenthal, J. S. 2002. On the applicability of regenerative simulation in Markov chain Monte Carlo. Biometrika, 89:731-743
31. Jarner, S. F. and Hansen, E. 2000. Geometric ergodicity of Metropolis algorithms. Stochastic Processes and Their Applications, 85:341-361
32. Johnson, A. A. and Jones, G. L. 2010. Gibbs sampling for a Bayesian hierarchical general linear model. Electronic Journal of Statistics, 4:313-333
33. Jones, G. L. 2004. On the Markov chain central limit theorem. Probability Surveys, 1:299-320
34. Jones, G. L. and Hobert, J. P. 2001. Honest exploration of intractable probability distributions via Markov chain Monte Carlo. Statistical Science, 16:312-334
35. Jones, G. L. and Hobert, J. P. 2004. Sufficient burn-in for Gibbs samplers for a hierarchical random effects model. Annals of Statistics, 32:784-817
36. Jones, G. L., Haran, M., Caffo, B. S., and Neath, R. 2006. Fixed-width output analysis for Markov chain Monte Carlo. Journal of the American Statistical Association, 101:1537-1547
37. Kelton, A. M. and Law, W. D. 1984. An analytical evaluation of alternative strategies in steady-state simulation. Operations Research, 32:169-184
38. Kosorok, M. R. 2000. Monte Carlo error estimation for multivariate Markov chains. Statistics and Probability Letters, 46:85-93
39. Latuszynski, K. and Niemiro, W. 2009. Rigorous confidence bounds for MCMC under a geometric drift condition. http://arXiv.org/abs/0908.2098v1
40. Liu, J. S., Wong, W. H., and Kong, A. 1994. Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes. Biometrika, 81:27-40
41. Marchev, D. and Hobert, J. P. 2004. Geometric ergodicity of van Dyk and Meng's algorithm for the multivariate Student's t model. Journal of the American Statistical Association, 99:228-238
42. Mengersen, K. and Tweedie, R. L. 1996. Rates of convergence of the Hastings and Metropolis algorithms. Annals of Statistics, 24:101-121
43. Meyn, S. P. and Tweedie, R. L. 1993. Markov Chains and Stochastic Stability. Springer, London
44. Meyn, S. P. and Tweedie, R. L. 1994. Computable bounds for geometric convergence rates of Markov chains. Annals of Applied Probability, 4:981-1011
45. Muñoz, D. F. and Glynn, P. W. 2001. Multivariate standardized time series for steady-state simulation output analysis. Operations Research, 49:413-422
46. Mykland, P., Tierney, L., and Yu, B. 1995. Regeneration in Markov chain samplers. Journal of the American Statistical Association, 90:233-241
47. Neath, R. and Jones, G. L. 2009. Variable-at-a-time implementations of Metropolis-Hastings. Technical report, School of Statistics, University of Minnesota
48. Nummelin, E. 1984. General Irreducible Markov Chains and Non-negative Operators. Cambridge University Press, Cambridge
49. Peltonen, J., Venna, J., and Kaski, S. 2009. Visualizations for assessing convergence and mixing of Markov chain Monte Carlo simulations. Computational Statistics and Data Analysis, 53:4453-4470
50. Politis, D. N. 2003. The impact of bootstrap methods on time series analysis. Statistical Science, 18:219-230
51. Politis, D. N., Romano, J. P., and Wolf, M. 1999. Subsampling. Springer, New York
52. Roberts, G. O. 1999. A note on acceptance rate criteria for CLTs for Metropolis-Hastings algorithms. Journal of Applied Probability, 36:1210-1217
53. Roberts, G. O. and Polson, N. G. 1994. On the geometric convergence of the Gibbs sampler. Journal of the Royal Statistical Society, Series B, 56:377-384
54. Roberts, G. O. and Rosenthal, J. S. 1999. Convergence of slice sampler Markov chains. Journal of the Royal Statistical Society, Series B, 61:643-660
55. Roberts, G. O. and Rosenthal, J. S. 2004. General state space Markov chains and MCMC algorithms. Probability Surveys, 1:20-71
56. Rosenthal, J. S. 1995. Minorization conditions and convergence rates for Markov chain Monte Carlo. Journal of the American Statistical Association, 90:558-566
57. Rosenthal, J. S. 1996. Analysis of the Gibbs sampler for a model related to James-Stein estimators. Statistics and Computing, 6:269-275
58. Rosenthal, J. S. 2000. Parallel computing and Monte Carlo algorithms. Far East Journal of Theoretical Statistics, 4:201-236
59. Roy, V. and Hobert, J. P. 2007. Convergence rates and asymptotic standard errors for Markov chain Monte Carlo algorithms for Bayesian probit regression. Journal of the Royal Statistical Society, Series B, 69(4):607-623
60. Roy, V. and Hobert, J. P. 2010. On Monte Carlo methods for Bayesian multivariate regression models with heavy-tailed errors. Journal of Multivariate Analysis, 101(5):1190-1202
61. Rudolf, D. 2009. Error bounds for computing the expectation by Markov chain Monte Carlo. Preprint.
62. Schruben, L. 1983. Confidence interval estimation using standardized time series. Operations Research, 31:1090-1108
63. Seila, A. F. 1982. Multivariate estimation in regenerative simulation. Operations Research Letters, 1:153-156
64. Sturtz, S., Ligges, U., and Gelman, A. 2005. R2WinBUGS: A package for running WinBUGS from R. Journal of Statistical Software, 12(3)
65. Tan,A. and Hobert, J. P. 2009. Block Gibbs sampling for Bayesian random effects models with improper priors: Convergence and regeneration. Journal of Computational and Graphical Statistics, 18:861-878
66. Tierney, L. 1994. Markov chains for exploring posterior distributions (with discussion). Annals of Statistics, 22:1701-1762
67. van der Vaart, A. W. 1998. Asymptotic Statistics. Cambridge University Press, Cambridge
68. Wei, G. C. G. and Tanner, M. A. 1990. AMonte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. Journal of the American Statistical Association, 85:699-704
69. Yang, W.-N. and Nelson, B. L. 1992. Multivariate batch means and control variates. Management Science, 38:1415-1431