Improving transparency and replication in Bayesian statistics: The WAMBS-checklist

Psychological Methods

Volumn 22, Issue 2, 2017, Pages 240-261

  Depaoli, Sarah ^a   van de Schoot, Rens ^b,c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UTRECHT UNIVERSITY   (Netherlands)

^c NORTH WEST UNIVERSITY   (South Africa)

Author keywords

Bayesian checklist; Bayesian estimation; Convergence; Prior; Sensitivity analysis

Indexed keywords

BAYES THEOREM; CHECKLIST; HUMAN; HUMAN EXPERIMENT; MODEL; QUESTIONNAIRE; STATISTICS; STRESS; STATISTICAL ANALYSIS;

BAYES THEOREM; CHECKLIST; DATA INTERPRETATION, STATISTICAL; HUMANS;

EID: 84951310169     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000065     Document Type: Article

References (97)

1. Albert, J. (2009). Bayesian computation with R. New York, NY: Springer. http://dx.doi.org/10.1007/978-0-387-92298-0
2. Arbuckle, J. L. (2006). Amos (Version 7.0) [Computer program]. Chicago, IL: SPSS.
3. Asparouhov, T., & Muthén, B. (2010). Bayesian analysis using Mplus: Technical implementation. Tech. Rep. No. Version 3. https://www .statmodel.com/download/Bayes3.pdf
4. Berger, J. (2006). The case for objective Bayesian analysis. Bayesian Analysis, 3, 385-402.
5. Bijak, J., & Wisniowski, A. (2010). Bayesian forecasting of immigration to selected European countries by using expert knowledge. Journal of the Royal Statistical Society Series A, 173, 775-796. http://dx.doi.org/10 .1111/j.1467-985X.2009.00635.x
6. Bolstad, W. M. (2007). Introduction to Bayesian statistics. New York, NY: Wiley. http://dx.doi.org/10.1002/9780470181188
7. Brooks, S. P., & Roberts, G. O. (1998). Convergence assessment techniques for Markov chain Monte Carlo. Statistics and Computing, 8, 319-335. http://dx.doi.org/10.1023/A:1008820505350
8. Brown, L. D. (2008). In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologies. The Annals of Applied Statistics, 2, 113-152. http://dx.doi.org/10.1214/07-AOAS138
9. Browne, W. J. (2009). MCMC Estimation in MLwiN v2.1. Bristol, UK: Centre for Multilevel Modelling, University of Bristol.
10. Candel, J. J. M., & Winkens, B. (2003). Performance of empirical Bayes estimators of level-2 random parameters in multilevel analysis: A Monte Carlo study for longitudinal designs. Journal of Educational and Behavioral Statistics, 28, 169 -194. http://dx.doi.org/10.3102/ 10769986028002169
11. Carlin, B. P., & Louis, T. A. (2009). Bayesian methods for data analysis. Boca Raton, FL: Chapman and Hall/CRC Press.
12. Casella, G., & George, E. I. (1992). Explaining the Gibbs sampler. The American Statistician, 46, 167-174.
13. Christensen, R., Johnson, W. O., Branscum, A. J., & Hanson, T. E. (2010). Bayesian ideas and data analysis: An introduction for scientists and statisticians. Boca Raton, FL: CRC Press.
14. Darnieder, W. F. (2011). Bayesian methods for data-dependent priors (Doctoral Dissertation). Ohio State University, Columbus, OH.
15. Depaoli, S. (2012). Measurement and structural model class separation in mixture-CFA: ML/EM versus MCMC. Structural Equation Modeling, 19, 178-203. http://dx.doi.org/10.1080/10705511.2012.659614
16. Depaoli, S. (2013). Mixture class recovery in GMM under varying degrees of class separation: Frequentist versus Bayesian estimation. Psychological Methods, 18, 186-219. http://dx.doi.org/10.1037/a0031609
17. Depaoli, S. (2014). The impact of inaccurate "informative" priors for growth parameters in Bayesian Growth Mixture Modeling. Structural Equation Modeling, 21, 239-252. http://dx.doi.org/10.1080/10705511 .2014.882686
18. Depaoli, S., & Boyajian, J. (2014). Linear and nonlinear growth models: Describing a Bayesian perspective. Journal of Consulting and Clinical Psychology, 82, 784-802. http://dx.doi.org/10.1037/a0035147
19. Depaoli, S., & Clifton, J. (2015). A Bayesian approach to multilevel structural equation modeling with continuous and dichotomous outcomes. Structural Equation Modeling, 22, 327-351. http://dx.doi.org/10 .1080/10705511.2014.937849
20. Depaoli, S., & van de Schoot, R. (2016). Improving transparency and replication in Bayesian statistics: The WAMBS-checklist. Psychological Methods.
21. Depaoli, S., van de Schoot, R., van Loey, N., & Sijbrandij, M. (2015). Using Bayesian statistics for modeling PTSD through Latent Growth Mixture Modeling: Implementation and discussion. European Journal of Psychotraumatology, 6, 27516. http://dx.doi.org/10.3402/ejpt.v6.27516
22. Dienes, Z. (2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science, 6, 274-290. http://dx.doi .org/10.1177/1745691611406920
23. Fransman, W., Van Tongeren, M., Cherrie, J. W., Tischer, M., Schneider, T., Schinkel, J., Tielemans, E. (2011). Advanced Reach Tool (ART): Development of the mechanistic model. The Annals of Occupational Hygiene, 55, 957-979. http://dx.doi.org/10.1093/annhyg/mer083
24. Gelman, A. (2006a). Prior distributions for variance parameters in hierarchical models. Bayesian Analysis, 1, 515-533. http://dx.doi.org/10.1214/ 06-BA117A
25. Gelman, A. (2006b). Modeling the group-level covariance matrix for varying-intercept, varying-slope multilevel models: Updated paper by O'Malley and Zaslavsky. Retrieved from http://andrewgelman.com/ 2006/09/01/modeling_the_gr/
26. Gelman, A., Bois, F., & Jiang, J. (1996). Physiological pharmacokinetic analysis using population modeling and informative prior distributions. Journal of the American Statistical Association, 91, 1400-1412. http:// dx.doi.org/10.1080/01621459.1996.10476708
27. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2nd ed.). London, UK: Chapman & Hall.
28. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/ hierarchical models. New York, NY: Cambridge University Press.
29. Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008). A weakly informative default prior distribution for logistic and other regression models. The Annals of Applied Statistics, 2, 1360-1383. http://dx.doi .org/10.1214/08-AOAS191
30. Gelman, A., & Rubin, D. B. (1992a). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-472. http://dx.doi .org/10.1214/ss/1177011136
31. Gelman, A., & Rubin, D. B. (1992b). A single series from the Gibbs sampler provides a false sense of security. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4 (pp. 625-631). Oxford, NY: Oxford University Press.
32. Gelman, A., & Shalizi, C. R. (2013). Philosophy and the practice of Bayesian statistics. British Journal of Mathematical and Statistical Psychology, 66, 8-38. http://dx.doi.org/10.1111/j.2044-8317.2011.02037.x
33. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. Pattern Analysis and Machine Intelligence, 6, 721-741.
34. Geweke, J. (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4 (pp. 169-193). Oxford, UK: Oxford University Press.
35. Geyer, C. J. (1991). Markov chain Monte Carlo maximum likelihood (Tech. Rep.). Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, University of Minnesota, Minneapolis, MN. http://www.stat.umn.edu/geyer/f05/8931/c.pdf
36. Gill, J. (2008). Bayesian methods: A social and behavioral sciences approach. Boca Raton, FL: CRC Press.
37. Hamra, G. B., MacLehose, R. F., & Cole, S. R. (2013). Sensitivity analyses for sparse-data problems-using weakly informative Bayesian priors. Epidemiology, 24, 233-239. http://dx.doi.org/10.1097/EDE .0b013e318280db1d
38. Heidelberger, P., & Welch, P. D. (1983). Simulation run length control in the presence of an initial transient. Operations Research, 31, 1109- 1144. http://dx.doi.org/10.1287/opre.31.6.1109
39. Heydari, S., Miranda-Moreno, L. F., Lord, D., & Fu, L. (2014). Bayesian methodology to estimate and update safety performance functions under limited data conditions: A sensitivity analysis. Accident Analysis and Prevention, 64, 41-51. http://dx.doi.org/10.1016/j.aap.2013.11.001
40. Howard, G. S., Maxwell, S. E., & Fleming, K. J. (2000). The proof of the pudding: An illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. Psychological Methods, 5, 315- 332. http://dx.doi.org/10.1037/1082-989X.5.3.315
41. Hox, J., van de Schoot, R., & Matthijsse, S. (2012). How few countries will do? Comparative survey analysis from a Bayesian perspective. Survey Research Methods, 6, 87-93.
42. Ibrahim, J. G., Chen, M. H., & Sinha, D. (2005). Bayesian survival analysis. New York, NY: Wiley. http://dx.doi.org/10.1002/0470011815 .b2a11006
43. Jackman, S. (2009). Bayesian analysis for the social sciences (Vol. 846). New York, NY: Wiley. http://dx.doi.org/10.1002/9780470686621
44. Jeffreys, H. (1961). Theory of probability, 3rd ed. New York: Oxford University Press.
45. Johnson, V. E. (2013). Uniformly most powerful Bayesian tests. Annals of Statistics, 41, 1716-1741. http://dx.doi.org/10.1214/13-AOS1123
46. Kaplan, D. (2002). Methodological advances in the analysis of individual growth with relevance to education policy. Peabody Journal of Education, 77, 189-215. http://dx.doi.org/10.1207/S15327930PJE7704_9
47. Kaplan, D. (2014). Bayesian statistics for the social sciences. New York, NY: Guilford Press.
48. Kaplan, D., & Depaoli, S. (2012). Bayesian structural equation modeling. In R. Hoyle (Ed.), Handbook of structural equation modeling (pp. 650-673). New York, NY: Guilford Press.
49. Kaplan, D., & Depaoli, S. (2013). Bayesian statistical methods. In T. D. Little (Ed.), Oxford handbook of quantitative methods (pp. 407-437). Oxford, UK: Oxford University Press.
50. Kim, J. S., & Bolt, D. M. (2007). Estimating item response theory models using Markov Chain Monte Carlo methods. Educational Measurement: Issues and Practice, 26, 38-51. http://dx.doi.org/10.1111/j.1745-3992 .2007.00107.x
51. Kim, S. Y., Suh, Y., Kim, J. S., Albanese, M. A., & Langer, M. M. (2013). Single and multiple ability estimation in the SEM framework: A noninformative Bayesian estimation approach. Multivariate Behavioral Research, 48, 563-591. http://dx.doi.org/10.1080/00273171.2013.802647
52. Kruschke, J. K. (2010). Doing Bayesian analysis. Burlington, MA: Academic Press.
53. Kruschke, J. K. (2011). Introduction to special section on Bayesian data analysis. Perspectives on Psychological Science, 6, 272-273. http://dx .doi.org/10.1177/1745691611406926
54. Lambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005). How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Statistics in Medicine, 24, 2401-2428. http://dx.doi.org/10.1002/sim.2112
55. Lee, S.-Y. (2007). Structural equation modeling: A Bayesian approach. West Sussex, UK: Wiley and Sons. http://dx.doi.org/10.1002/ 9780470024737
56. Link, W. A., & Eaton, M. J. (2012). On thinning of chains in MCMC. Methods in Ecology and Evolution, 3, 112-115. http://dx.doi.org/10 .1111/j.2041-210X.2011.00131.x
57. Lopes, H. F., & Tobias, J. L. (2011). Confronting prior convictions: On issues of prior sensitivity and likelihood robustness in Bayesian analysis. Annual Review of Economics, 3, 107-131. http://dx.doi.org/10.1146/ annurev-economics-111809-125134
58. Love, J., Selker, R., Marsman, M., Jamil, T., Verhagen, A. J., Ly, A., Wagenmakers, E.-J. (2015). JASP (Version 0.6.6) [Computer software].
59. Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000). Win- BUGS-A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325-337. http://dx.doi.org/ 10.1023/A:1008929526011
60. Lynch, S. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists (Vol. 2). New York, NY: Springer. http://dx.doi.org/10.1007/978-0-387-71265-9
61. Martin, T. G., Burgman, M. A., Fidler, F., Kuhnert, P. M., Low-Choy, S., McBride, M., & Mengersen, K. (2012). Eliciting expert knowledge in conservation science. Conservation Biology, 26, 29-38. http://dx.doi .org/10.1111/j.1523-1739.2011.01806.x
62. Matzke, D., Dolan, C. V., Logan, G. D., Brown, S. D., & Wagenmakers, E. J. (2013). Bayesian parametric estimation of stop-signal reaction time distributions. Journal of Experimental Psychology: General, 142, 1047- 1073. http://dx.doi.org/10.1037/a0030543
63. Millar, R. B. (2004). Sensitivity of Bayes estimators to hyper-parameters with an application to maximum yield from fisheries. Biometrics, 60, 536-542. http://dx.doi.org/10.1111/j.0006-341X.2004.00201.x
64. Moore, T. M., Reise, S. P., Depaoli, S., & Haviland, M. G. (2015). Iteration of partially specified target matrices: Applications in exploratory and Bayesian confirmatory factor analysis. Multivariate Behavioral Research, 50, 149-161. http://dx.doi.org/10.1080/00273171.2014.973990
65. Morey, R., Rouder, J., & Jamil, T. (2015). Bayes factor: Computation of Bayes factors for common designs. R package version 3.0.2. https://cran .r-project.org/web/packages/BayesFactor/BayesFactor.pdf
66. Morris, D. E., Oakley, J. E., & Crowe, J. A. (2014). A web-based tool for eliciting probability distributions from experts. Environmental Modelling & Software, 52, 1-4. http://dx.doi.org/10.1016/j.envsoft.2013.10 .010
67. Mulder, J., Hoijtink, H., & de Leeuw, C. (2012). BIEMS: A Fortran 90 program for calculating Bayes factors for inequality and equality constrained models. Journal of Statistical Software, 46, 1-39. http://dx.doi .org/10.18637/jss.v046.i02
68. Muthén, B., & Asparouhov, T. (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17, 313-335. http://dx.doi.org/10.1037/a0026802
69. Muthén, L., & Muthén, B. (1998 -2015). Mplus user's guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
70. NCES. (2001). Early childhood longitudinal study: Kindergarten class of 1998-99: Base year public-use data files user's manual (Tech. Rep. No. NCES 2001-029). Washington, DC: U.S. Government Printing Office.
71. Ntzoufras, I. (2009). Bayesian modeling using WinBUGS. Hoboken, NJ: Wiley. http://dx.doi.org/10.1002/9780470434567
72. O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Rakow, T. (2006). Uncertain judgements: Eliciting experts' probabilities. West Sussex, UK: Wiley. http://dx.doi.org/10 .1002/0470033312
73. O'Malley, A. J., & Zaslavsky, A. M. (2005). Cluster-level covariance analysis for survey data with structured nonresponse. Tech. Rep. No. Cambridge, MA: Department of Health Care Policy, Harvard Medical School.
74. Plummer, M. (2003). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. Retrieved from http://www-fis.iarc.fr/ ~martyn/software/jags/
75. Press, S. J. (2003). Subjective and objective Bayesian statistics: Principles, models, and applications (2nd ed.). New York, NY: Wiley.
76. Raftery, A. E. (1996). Hypothesis testing and model selection. In W. R. Gilks, S. Richardson, & D. J. Spiegelhalter (Eds.), Markov chain Monte Carlo in practice (pp. 163-187). New York, NY: Chapman & Hall.
77. Raftery, A. E., & Lewis, S. (1992). How many iterations in the Gibbs sampler. Bayesian statistics, 4, 763-773.
78. Richardson, S., & Green, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society Series A, 59, 731-792. http://dx.doi.org/10.1111/1467-9868 .00095
79. Rietbergen, C., Klugkist, I., Janssen, K. J., Moons, K. G., & Hoijtink, H. J. (2011). Incorporation of historical data in the analysis of randomized therapeutic trials. Contemporary Clinical Trials, 32, 848-855. http://dx .doi.org/10.1016/j.cct.2011.06.002
80. SAS Institute Inc. (2012-2013). SAS 9 help and documentation, Cary, NC: SAS Institute Inc.
81. Schuurman, N. K., Grasman, R. P. P. P., & Hamaker, E. L. (in press). A comparison of Wishart prior specifications for variance-covariance matrices in multilevel autoregressive models. Multivariate Behavioral Research.
82. Seaman, J. W., III, Seaman, J. W., Jr., & Stamey, J. D. (2012). Hidden dangers of specifying noninformative priors. The American Statistician, 66, 77-84. http://dx.doi.org/10.1080/00031305.2012.695938
83. Sinharay, S. (2004). Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics, 29, 461- 488. http://dx.doi.org/10.3102/ 10769986029004461
84. Skrondal, A., & Rabe-Hesketh, S. (2012). Multilevel and longitudinal modeling using Stata. College Station, TX: Stata Press.
85. Smith, B. J. (2005, March 23). Bayesian Output Analysis program (BOA), version 1.1.5. Retrieved from http://www.public-health.uiowa.edu/boa
86. Stan Development Team. (2014). STAN Modeling Language Users Guide and Reference Manual, Version 2.2. http://mc-stan.org/citations/
87. StataCorp. (2013). Stata 13 base reference manual. College Station, TX: Stata Press.
88. van der Linden, W. J. (2008). Using response times for item selection in adaptive testing. Journal of Educational and Behavioral Statistics, 33, 5-20. http://dx.doi.org/10.3102/1076998607302626
89. van de Schoot, R., Broere, J. J., Perryck, K. H., Zondervan-Zwijnenburg, M., & van Loey, N. E. (2015). Analyzing small data sets using Bayesian estimation: The case of posttraumatic stress symptoms following mechanical ventilation in burn survivors. European Journal of Psychotraumatology, 6, 25216. http://dx.doi.org/10.3402/ejpt.v6.25216
90. van de Schoot, R., & Depaoli, S. (2014). Bayesian analyses: Where to start and what to report. The European Health Psychologist, 16, 73-82.
91. van de Schoot, R., Hoijtink, H., Mulder, J., Van Aken, M. A., de Castro, B. O., Meeus, W., & Romeijn, J. W. (2011). Evaluating expectations about negative emotional states of aggressive boys using Bayesian model selection. Developmental Psychology, 47, 203-212. http://dx.doi .org/10.1037/a0020957
92. van de Schoot, R., Ryan, O., Winter, S., Zondervan-Zwijenburg, M. A. J., & Depaoli, S. (under review). A systematic review of empirical Bayesian applications in psychology.
93. van Loey, N. E. E., Maas, C. J. M., Faber, A. W., & Taal, L. A. (2003). Predictors of chronic posttraumatic stress symptoms following burn injury: Results of a longitudinal study. Journal of Traumatic Stress, 16, 361-369. http://dx.doi.org/10.1023/A:1024465902416
94. Van Wesel, F., Hoijtink, H., & Klugkist, I. (2011). Choosing priors for constrained analysis of variance: Methods based on training data. Scandinavian Journal of Statistics, 38, 666-690. http://dx.doi.org/10.1111/j .1467-9469.2010.00719.x
95. Wasserman, L. (2000). Asymptotic inference for mixture models using datadependent priors. Journal of the Royal Statistical Society Series B, Statistical Methodology, 62, 159-180. http://dx.doi.org/10.1111/1467-9868.00226
96. Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E. J. (2011). Statistical evidence in experimental psychology an empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291-298. http://dx.doi.org/10.1177/ 1745691611406923
97. Zhang, Z., Hamagami, F., Wang, L., Grimm, K. J., & Nesselroade, J. R. (2007). Bayesian analysis of longitudinal data using growth curve models. International Journal of Behavioral Development, 31, 374-383. http://dx.doi.org/10.1177/0165025407077764