A Hellinger distance approach to MCMC diagnostics

Journal of Statistical Computation and Simulation

Volumn 84, Issue 4, 2014, Pages 833-849

  Boone, Edward L ^a   Merrick, Jason R W ^a   Krachey, Matthew J ^b  

^a VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Bayesian robustness; Hellinger distance; kernel density estimation; Markov chain Monte Carlo

Indexed keywords

EID: 84893502233     PISSN: 00949655     EISSN: 15635163     Source Type: Journal    
DOI: 10.1080/00949655.2012.729588     Document Type: Article

References (36)

1. L.W. Schruben, Detecting initialization Bias in simulation output, Oper. Res. 30(3) (1982), pp. 569-590. doi: 10.1287/opre.30.3.569
2. L.W. Schruben, Confidence interval estimate from standardized simulation output, Oper. Res. 31 (1983), pp. 1090-1108. doi: 10.1287/opre.31.6.1090
3. L.W. Schruben, H. Singh, and L. Tierney, Optimal tests for initialization bias in simulation output, Oper. Res. 31(6) (1983), pp. 1167-1178. doi: 10.1287/opre.31.6.1167
4. A. Gelman and D.B. Rubin, Inference from iterative simulation using multiple sequences, Statist. Sci. 7 (1992), pp. 457-472. doi: 10.1214/ss/1177011136
5. S.P. Brooks and G.O. Roberts, Convergence assessment techniques for Markov chain Monte Carlo, Statist. Comput. 8 (1998), pp. 319-335. doi: 10.1023/A:1008820505350
6. S.P. Brooks and A. Gelman, Alternative methods for monitoring convergence of iterative simulations, J. Comput. Graphical Statist. 7 (1998), pp. 434-455.
7. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin, Bayesian Data Analysis, 2nd ed., Chapman & Hall/CRC, Boca Raton, FL, 2004.
8. A. Gelman and K. Shirley, Inference from simulations and monitoring convergence, in Handbook of Markov Chain Monte Carlo, S. Brooks, A. Gelman, G. Jones, and X.L. Meng, eds., CRC Press, Boca Raton, FL, 2011, pp. 163-174.
9. J. Geweke, Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments, in Bayesian Statistics 4, J.M. Bernardo, J.O. Berger, A.P. Dawid, and A.F.M. Smith, eds., Oxford University Press, Oxford, 1992, pp. 169-193.
10. G.L. Jones, M. Haran, B.S. Caffo, and R. Neath, Fixed-width output analysis for Markov Chain Monte Carlo, J. Amer. Statist. Assoc. 101(476) (2006), pp. 1537-1547. doi: 10.1198/016214506000000492
11. J.M. Flegal, M. Haran, and G.L. Jones, Markov Chain Monte Carlo: Can we trust the third significant figure?, Statist. Sci. 23 (2008), pp. 250-260. doi: 10.1214/08-STS257
12. J.M. Flegal and G.L. Jones, Batch means and spectral variance estimators in Markov chain Monte Carlo, Ann. Statist. 38(2) (2010), pp. 1034-1070. doi: 10.1214/09-AOS735
13. P. Heidelberger and P.D. Welch, Quantile estimation in dependent sequences, Oper. Res. 32(1) (1984), pp. 185-209. doi: 10.1287/opre.32.1.185
14. A.E. Raftery and S.M. Lewis, How many iterations in the Gibbs sampler?, in Bayesian Statistics 4, J.M. Bernardo, A.F. M. Smith, A.P. Dawid, and J.O. Berger, eds., Oxford University Press, Oxford, 1992, 763-773.
15. B. Yu and P.A. Mykland, Looking at Markov samplers through CUSUM path plots: A simple diagnostic idea, Statist. Comput. 8 (1998), pp. 275-286. doi: 10.1023/A:1008917713940
16. G.O. Roberts, Convergence diagnostics of the Gibbs sampler, in Bayesian Statistics 4, J.M. Bernardo, A.F.M. Smith, A.P. Dawid, and J.O. Berger, eds., Oxford University Press, Oxford, 1992, pp. 775-782.
17. G.O. Roberts, Methods for estimating L2 convergence of Markov chain Monte Carlo, in Bayesian Statistics and Econometrics: Essays in Honor of Arnold Zellner, D.A. Berry, K.M. Chaloner, and J.K. Geweke, eds., North Holland, Amsterdam, 1994, 373-383.
18. C. Ritter and M.A. Tanner, Facilitating the Gibbs sampler: The Gibbs stopper and the griddy Gibbs sampler, J. Amer. Statist. Assoc. 87 (1992), pp. 861-868. doi: 10.1080/01621459.1992.10475289
19. A. Zellner and C. Min, Gibbs sampler convergence criteria, J. Amer. Statist. Assoc. 90 (1995), pp. 921-927. doi: 10.1080/01621459.1995.10476591
20. J.S. Liu, W.H. Wong, and A. Kong, Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes, Biometrika 81 (1994), pp. 27-40. doi: 10.1093/biomet/81.1.27
21. S.T. Garren and R.L. Smith, Convergence diagnostics for Markov chain samplers, Tech. Rep., Department of Statistics, University of North Carolina, 1993.
22. V.E. Johnson, Studying convergence of Markov chain Monte Carlo Algorithms using coupled sample paths, J. Amer. Statist. Assoc. 91 (1996), pp. 154-166. doi: 10.1080/01621459.1996.10476672
23. P. Mykland, L. Tierney, and B. Yu, Regeneration in Markov chain samplers, J. Amer. Statist. Assoc. 90 (1995), pp. 233-241. doi: 10.1080/01621459.1995.10476507
24. B. Yu, Estimating the L1 error of kernel estimators based on Markov samplers, Tech. Rep. 409, Statistics Department, University of California, Berkeley, 1994.
25. P. Heidelberger and P.D. Welch, Simulation run length control in the presence of an initial transient, Oper. Res. 31(6) (1983), pp. 1109-1144. doi: 10.1287/opre.31.6.1109
26. S.P. Brooks, P. Giudici, and G.O. Roberts, Efficient construction of reversible Jump Markov Chain Monte Carlo proposal distributions, J. Roy. Statist. Soc. Ser. B 65 (2003), pp. 3-55. doi: 10.1111/1467-9868.03711
27. M.K. Cowles and B.P. Carlin, Markov Chain Monte Carlo convergence diagnostics: A comparative review, J. Amer. Statist. Assoc. 91 (1996), pp. 883-904. doi: 10.1080/01621459.1996.10476956
28. W.J. Conover, Practical Nonparametric Statistics, John Wiley & Sons, New York, 1971.
29. S.P. Brooks, P. Giudici, and A. Philippe, Nonparametric convergence assessment for MCMC model selection, J. Comput. Graph. Statist. 12 (2003), pp. 1-22. doi: 10.1198/1061860031347
30. F.W. Scholz and M.A. Stephens, K-sample Anderson-Darling tests, J. Amer. Statist. Assoc. 82 (1987), pp. 918-924.
31. U. Hjorth and A. Vadeby, Subsample distribution distance and MCMC convergence, Scand. J. Statist. 32 (2005), pp. 313-326. doi: 10.1111/j.1467-9469.2005.00424.x
32. B.W. Silverman, Density Estimation for Statistics and Data Analysis, Chapman & Hall, London, 1986.
33. V.S.M. Campos and C.C.Y. Dorea, Kernel estimation for stationary density of Markov chains with general state space, Ann. Inst. Statist. Math. 57 (2005), pp. 443-453. doi: 10.1007/BF02509234
34. J. Elith, J.R. Leathwick, and T. Hastie, A working guide to boosted regression trees, J. Appl. Ecol. 77(4) (2008), pp. 802-813. doi: 10.1111/j.1365-2656.2008.01390.x
35. R.J. Hijmans, S. Phillips, J. Leathwick, and J. Elith, dismo: Species distribution modeling. R package version 0.7-17, 2012. Available at http://CRAN.R-project.org/package=dismo
36. J.R. Leathwick, J. Elith, W.L. Chadderton, D. Rowe, and T. Hastie, Dispersal, disturbance and the contrasting biogeographies of New Zealand's diadromous and non-diadromous fish species, J. Biogeogr. 35 (2008), pp. 1481-1497. doi: 10.1111/j.1365-2699.2008.01887.x