Bayesian statistics in educational research: a look at the current state of affairs

Educational Review

Volumn 70, Issue 4, 2018, Pages 486-509

  König, Christoph ^a   van de Schoot, Rens ^b  

^a FRIEDRICH SCHILLER UNIVERSITY JENA   (Germany)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Bayesian statistics; educational methods; educational research; research methodology; statistical inference; synthesis

Indexed keywords

EID: 85038239686     PISSN: 00131911     EISSN: 14653397     Source Type: Journal    
DOI: 10.1080/00131911.2017.1350636     Document Type: Review

References (78)

1. *Ageyi-Baffour, Peter, Sarah, Rominski, Emmanuel, Nakua, Mawuli, Gyakobo, and Jody R., Lori. 2013. “Factors That Influence Midwifery Students in Ghana When Deciding Where to Practice: A Discrete Choice Experiment.” BMC Medical Education 13: 64–70. doi:10.1186/1472-6920-13-64.
2. Ahn, Soyeon, Allison J., Ames, and Nicholas D., Myers. 2012. “A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses.” Review of Educational Research 82: 436–476. doi:10.3102/0034654312458162.
3. Albert, James H., 1992. “Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling.” Journal of Educational Statistics 17: 251–269. doi:10.2307/1165149.
4. Andrews, Mark, and Thom, Baguley. 2013. “Prior Approval: The Growth of Bayesian Methods in Psychology.” British Journal of Mathematical and Statistical Psychology 66: 1–7. doi:10.1111/bmsp.12004.
5. Ashby, Deborah. 2006. “Bayesian Statistics in Medicine: A 25 Year Review.” Statistics in Medicine 25: 3589–3631. doi:10.1002/sim.2672.
6. *Bekele, Rahel, and Maggie, McPherson. 2011. “A Bayesian Performance Prediction Model for Mathematics Education: A Prototypical Approach for Effective Group Composition.” British Journal of Educational Technology 42: 395–416. doi:10.1111/j.1467-8535.2009.01042.x.
7. Berger, James. 2006. “The Case for Objective Bayesian Analysis.” Bayesian Analysis 3: 385–402. doi:10.1214/06-BA115.
8. Berlin, Jesse A., and Davina, Ghersi. 2005. “Preventing Publication Bias: Registries and Prospective Meta-Analysis.” In Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments, edited by Hanna R., Rothstein, Alexander J., Sutton and Michael, Borenstein, 35–48. Chichester, UK: Wiley. doi:10.1002/0470870168.ch3.
9. *Boyd, Donald, Pamela, Grossman, Karen, Hammerness, Hamilton, Lankford, Susanna, Loeb, Matthew, Ronfeldt, and James, Wyckoff. 2012. “Recruiting Effective Math Teachers: Evidence from New York City.” American Educational Research Journal 49: 1008–1047. doi:10.3102/0002831211434579.
10. *Buckley, Jack, and Mark, Schneider. 2005. “Are Charter Schools Harder to Educate? Evidence from Washington, D.C.” Educational Evaluation and Policy Analysis 27: 365–380. doi:10.3102/01623737027004365.
11. *Clewley, Natalie, Sherry Y., Chen, and Xiaohui, Liu. 2011. “Mining Learning Preferences in Web-Based Instruction: Holists Vs. Serialists.” Educational Technology & Society 14: 266–277.
12. Cumming, Goeff. 2014. “The New Statistics: Why and How.” Psychological Science 25: 7–29. doi:10.117/0956797613504966.
13. *Cummings, Kelli D., Michael L., Stoolmiller, Scott K., Baker, Hank, Fien, and Edward, Kame’enui. 2015. “Using School-Level Student Achievement to Engage in Formative Evaluation: Comparative School-Level Rates of Oral Reading Fluency Growth Conditioned by Initial Skill for Second Grade Students.” Reading and Writing 28: 105–130. doi:10.1007/s11145-014-9512-5.
14. Darnieder, William. 2011. “Bayesian Methods for Data-Dependent Priors.” Electronic Thesis or diss., Ohio State University. https://etd.ohiolink.edu/.
15. Depaoli, Sarah, and Rens, van de Schoot. 2017. “Improving Transparency and Replication in Bayesian Statistics: The WAMBS-Checklist.” Psychological Methods 22: 240–261. doi:10.1037/met0000065.
16. *Doyle, William R., 2010. “U.S. Senator’s Ideal Points for Higher Education: Documenting Partisanship, 1965-2004.” The Journal of Higher Education 81: 619–644. doi:10.1353/jhe.2010.0006.
17. *Doyle, William R., and Alexander V., Gorbunov. 2011. “The Growth of Community Colleges in the American States: An Application of Count Models to Institutional Growth.” Teachers College Record 113: 1794–1826.
18. *Fraile, Ruben, and Francisco, Bosch-Morell. 2015. “Considering Teaching History and Calculating Confidence Intervals in Student Evaluations of Teaching Quality.” Higher Education 70: 55–72. doi:10.1007/s10734-014-9823-0.
19. *Galbraith, Craig S., and Gregory B., Merrill. 2012. “Faculty Research Productivity and Standardized Student Learning Outcomes in a University Teaching Environment: A Bayesian Analysis of Relationships.” Studies in Higher Education 37: 469–480. doi:10.1080/03075079.2010.523782.
20. *Galbraith, Craig S., Gregory B., Merrill, and Doug M., Kline. 2012. “Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses.” Research in Higher Education 53: 353–374. doi:10.1007/s11162-011-9229-0.
21. Garcia, Patricio, Silvia, Schiaffino, and Analia, Amandi. 2008. “An Enhanced Bayesian Model to Detect Students’ Learning Styles in Web-Based Courses.” Journal of Computer Assisted Learning 24: 305–315. doi:10.1111/j.1365-2729.2007.00262.x.
22. Gelman, Andrew, and Cosma Rohilla, Shalizi. 2013. “Philosophy and the Practice of Bayesian Statistics.” British Journal of Mathematical and Statistical Psychology 66: 8–38. doi:10.1111/j.2044-8317.2011.02037.x.
23. Gilger, Jeffrey W., Bruce F., Pennington, and J. C., Defries. 1991. “Risk for Reading Disability as a Function of Parental History in Three Family Studies.” Reading and Writing 3: 205–217. doi:10.1007/BF00354958.
24. *Gudmestad, Aarnes, Leanna, House, and Kimberly L., Geeslin. 2013. “What a Bayesian Analysis Can Do for SLA: New Tools for the Sociolinguistic Study of Subject Expression in L2 Spanish.” Language Learning 63: 371–399. doi:10.1111/lang.12006.
25. *Heck, Ronald H., 2000. “Examining the Impact of School Quality on School Outcomes and Improvement: A Value-Added Approach.” Educational Administration Quarterly 36: 513–552. doi:10.1177/00131610021969092.
26. Henson, Robin K., Darrell M., Hull, and Cynthia S., Williams. 2010. “Methodology in Our Education Research Culture: Toward a Stronger Collective Quantitative Proficiency.” Educational Researcher 39: 229–240. doi:10.3102/0013189X10365102.
27. *Hoogerheide, Lennnart, Joern H., Block, and Roy, Thurik. 2012. “Family Background Variables as Instruments for Education in Income Regressions: A Bayesian Analysis.” Economics of Education Review 31: 515–523. doi:10.1016/j.econedurev.2012.03.001.
28. Ibrahim, Joseph G., Ming-Hui, Chen, Yeongjin, Gwon, and Fang, Chen. 2015. “The Power Prior: Theory and Applications.” Statistics in Medicine 34: 3724–3749. doi:10.1002/sim.6728.
29. *Jin, Hui, and Donald B., Rubin. 2009. “Public Schools versus Private Schools: Causal Inference with Partial Compliance.” Journal of Educational and Behavioral Statistics 34: 24–45. doi:10.3102/1076998607307475.
30. Kadane, Joseph B., 2011. Principles of Uncertainty. Boca Raton: Chapman & Hall.10.1201/CHTEXSTASCI
31. Kaplan, David. 2014. Bayesian Statistics for the Social Sciences. London: Guilford.
32. Kaplan, David, and Sarah, Depaoli. 2013. “Bayesian Statistical Methods.” In The Oxford Handbook of Quantitative Methods Volume 1: Foundations, edited by Todd D., Little, 407–437. New York: Oxford University Press. doi:10.1093/oxfordhb/9780199934874.013.0020.
33. *Karpudewan, Mageswary, Zurida, Ismail, and Wolff-Michael, Roth. 2012. “Promoting pro-Environmental Attitudes and Reported Behaviors of Malaysian Pre-Service Teachers Using Green Chemistry Experiments.” Environmental Education Research 18: 375–389. doi:10.1080/13504622.2011.622841.
34. *Karpudewan, Mageswary, Wolff-Michael, Roth, and Zurida, Ismail. 2015. “The Effects of ‘Green Chemistry’ on Secondary School Students’ Understanding and Motivation.” The Asia-Pacific Education Researcher 24: 35–43. doi:10.1007/s40299-013-0156-z.
35. Kirk, Roger E., 2003. “The Importance of Effect Magnitude.” In Handbook of Research Methods in Experimental Psychology, edited by Stephen F., Davis, 83–105. Malden, MA: Blackwell. doi:10.1002/9780470756973.ch5.
36. Kirkham, Jamie J., Richard D., Riley, and Paula R., Williamson. 2012. “A Multivariate Meta-Analysis Approach for Reducing the Impact of Outcome Reporting Bias in Systematic Reviews.” Statistics in Medicine 31: 2179–2195. doi:10.1002/sim.5356.
37. Kruschke, John K., 2013a. “Posterior Predictive Checks Can and Should Be Bayesian: Comment on Gelman and Shalizi, ‘Philosophy and the Practice of Bayesian Statistics’.” British Journal of Mathematical and Statistical Psychology 66: 45–56. doi:10.1111/j.2044-8317.2012.02063.x.
38. Kruschke, John K., 2013b. “Bayesian Estimation Supersedes the T-Test.” Journal of Experimental Psychology: General 142: 573–603. doi:10.1037/a0029146.
39. Kruschke, John K., 2015. Doing Bayesian Data Analysis. 2nd ed. London: Academic Press.
40. Kruschke, John K., and Torrin M., Liddell. 2016. “The Bayesian New Statistics: Two Historical Trends Converge.” https://ssrn.com/abstract=2606016. doi:10.2139/ssrn.2606016.
41. Kruschke, John K., Herman, Aguinis, and Harry, Joo. 2012. “The Time Has Come: Bayesian Methods for Data Analysis in the Organizational Sciences.” Organizational Research Methods 15: 722–752. doi:10.1177/0956797613504966.
42. Lambdin, Charles. 2012. “Significance Tests as Sorcery: Science is Empirical–Significance Tests Are Not.” Theory & Psychology 22: 67–90. doi:10.1177/0959354311429854.
43. *Laru, Jari, Piia, Näykki, and Sanna, Järvelä. 2012. “Supporting Small-Group Learning Using Multiple Web 2.0 Tools: A Case Study in the Higher Education Context.” Internet and Higher Education 15: 29–38. doi:10.1016/j.iheduc.2011.08.004.
44. *Li, Xingshan, and Wei, Shen. 2013. “Joint Effect of Insertion of Spaces and Word Length in Saccade Target Selection in Chinese Reading.” Journal of Research in Reading 36: 64–77. doi:10.1111/j.1467-9817.2012.01552.x.
45. Mackel, Matthew C., and Jonathan A., Plucker. 2014. “Facts Are More Important than Novelty. Replication in the Educational Sciences.” Educational Researcher 43: 304–316. doi:10.3102/0013189X14545513.
46. Maxwell, Scott E., Ken, Kelley, and Joseph R., Rausch. 2008. “Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation.” Annual Review of Psychology 59: 537–563. doi:10.1146/annurev.psych.59.103006.093735.
47. *May, Henry, and Jonathan A., Supovitz. 2006. “Capturing the Cumulative Effects of School Reform: An 11-Year Study of the Impacts of America’s Choice on Student Achievement.” Educational Evaluation and Policy Analysis 28: 231–257. doi:10.3102/01623737028003231.
48. *McDermott, Paul A., Marley W., Watkins, Michael J., Rovine, and Samuel H., Rikoon. 2014. “Informing Context and Change in Young Children’s Sociobehavioral Development–The National Adjustment Scales for Early Transition in Schooling (ASETS).” Early Childhood Research Quarterly 29: 255–267. doi:10.1016/j.ecresq.2014.02.004.
49. Merkle, Edgar C., and Yves, Rosseel. 2016. “Blavaan: Bayesian Structural Equation Models via Parameter Expansion.” arXiv1511.05604. https://arxiv.org/abs/1511.05604.
50. *Meyer, Katrina A., and Yonghong Jade, Xu. 2007. “A Bayesian Analysis of the Institutional and Individual Factors Influencing Faculty Technology Use.” Internet and Higher Education 10: 184–195. doi:10.1016/j.iheduc.2007.06.001.
51. Muthén, Linda K., and Bengt, Muthén. 1998-2017. Mplus User’s Guide. 7th ed. Los Angeles, CA: Muthén & Muthén.
52. *Notenboom, Annelise, and Pieter, Reitsma. 2007. “Spelling Dutch Doublets: Children’s Learning of a Phonological and Morphological Spelling Rule.” Scientific Studies of Reading 11: 133–150. doi:10.1080/10888430709336556.
53. *Petscher, Yaacov. 2010. “A Meta-Analysis of the Relationship between Student Attitudes towards Reading and Achievement in Reading.” Journal of Research in Reading 33: 335–355. doi:10.1111/j.1467-9817.2009.01418.x.
54. Plummer, Martyn. 2016. “Rjags: Bayesian Graphical Models Using MCMC. R Package Version 4-6.” https://CRAN.R-project.org/package=rjags.
55. Press, S. James. 2003. Subjective and Objective Bayesian Statistics: Principles, Models, and Applications. 2nd ed. Hoboken, NJ: Wiley. doi:10.1002/9780470317105.
56. Price, Larry R., 2012. “Small Sample Properties of Bayesian Multivariate Autoregressive Time Series Models.” Structural Equation Modeling 19: 51–64. doi:10.1080/10705511.2012.634712.
57. Reuters, Thomson. 2015. Journal Citation Report, Social Sciences Edition 2014. Rochester, NY: Thomson Reuters.
58. *Rowan, Brian, and Robert J., Miller. 2007. “Organizational Strategies for Promoting Instructional Change: Implementation Dynamics in Schools Working with Comprehensive School Reform Providers.” American Educational Research Journal 44: 252–297. doi:10.3102/0002831207302498.
59. Savage, Leonard. 1962. The Foundations of Statistical Inference. New York: Wiley.
60. *Scarpino, Shelley E., Frank R., Lawrence, Megan D., Davison, and Carol S., Hammer. 2011. “Predicting Bilingual Spanish-English Children’s Phonological Awareness Abilities from Their Preschool English and Spanish Oral Language.” Journal of Research in Reading 34: 77–93. doi:10.1111/j.1467-9817.2010.01488.x.
61. Schmidt, Frank L., 1996. “Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers.” Psychological Methods 1: 115–129. doi:10.1037/1082-989X.1.2.115.
62. Segawa, Eisuke. 2005. “A Growth Model for Multilevel Ordinal Data.” Journal of Educational and Behavioral Statistics 30: 369–396. doi:10.3102/10769986030004369.
63. *Seltzer, Michael H., Ken A., Frank, and Anthony S., Bryk. 1994. “The Metric Matters: The Sensitivity of Conclusions about Growth in Student Achievement to Choice of Metric.” Educational Evaluation and Policy Analysis 16: 41–49. doi:10.3102/01623737016001041.
64. Smithson, Michael. 2010. “A Review of Six Introductory Texts on Bayesian Methods.” Journal of Educational and Behavioral Statistics 35: 371–374. doi:10.3102/1076998610367814.
65. Stan Development Team. 2017. “RStan: The R Interface to Stan. R Package Version 2.15.1.” https://mc-stan.org/.
66. *Suchodoletz, Antje von, and Catherine, Gunzenhauser. 2013. “Behavior Regulation and Early Math and Vocabulary Knowledge in German Preschool Children.” Early Education and Development 24: 310–331. doi:10.1080/10409289.2012.693428.
67. Sun, Shuyan, Wei, Pan, and Lihshing Leigh, Wang. 2010. “A Comprehensive Review of Effect Size Reporting and Interpreting Practices in Academic Journals in Education and Psychology.” Journal of Educational Psychology 102: 989–1004. doi:10.1037/a0019507.
68. Taleb, Nassim Nicholas. 2007. Black Swan: The Impact of the Highly Improbable. New York: Random House.
69. *Tammets, Kairit, Kai, Pata, and Mart, Laanpere. 2013. “Promoting Teachers’ Learning and Knowledge Building in a Socio-Technical System.” The International Review of Research in Open and Distance Learning 14: 251–272. doi:10.19173/irrodl.v14i3.1478.
70. Thompson, Bruce. 2002. “‘Statistical’, ‘Practical’, and ‘Clinical’: How Many Kinds of Significance Do Counselors Need to Consider?” Journal of Counseling and Development 80: 64–71. doi:10.1002/j.1556-6678.2002.tb00167.x.
71. *Tobias, Justin L., 2002. “Model Uncertainty and Race and Gender Heterogeneity in the College Entry Decision.” Economics of Education Review 21: 211–219. doi:10.1016/S0272-7757(01)00002-4.
72. van de Schoot, Rens, David, Kaplan, Jaap, Denissen, Jens B., Asendorpf, Franz J., Neyer, and Marcel A. G., van Aken. 2014. “A Gentle Introduction to Bayesian Analysis: Applications to Developmental Research.” Child Development 85: 842–860. doi:10.1111/cdev.12169.
73. van de Schoot, Rens, Joris J., Broere, Koen H., Perryck, Marielle, Zondervan-Zwijnenburg, and Nance E., van Loey. 2015. “Analyzing Small Data Sets Using Bayesian Estimation: The Case of Posttraumatic Stress Symptoms following Mechanical Ventilation in Burn Survivors.” European Journal of Psychotraumatology 6: 25216. doi:10.3402/ejpt.v6.2521.
74. van de Schoot, Rens, Sonya D., Winter, Oisin, Ryan, Marielle, Zondervan-Zwijnenburg, and Sarah, Depaoli. 2017. “A Systematic Review of Bayesian Papers in Psychology: The Last 25 Years.” Psychological Methods 22: 217–239. doi:10.1037/met0000100.
75. Vanpaemel, Wolf. 2010. “Prior Sensitivity in Theory Testing: An Apologia for the Bayes Factor.” Journal of Mathematical Psychology 54: 491–498. doi:10.1016/j.jmp.2010.07.003.
76. Wagenmakers, Eric-Jan, Richard D., Morey, and Michael D., Lee. 2016. “Bayesian Benefits for the Pragmatic Researcher.” Current Directions in Psychological Science 25: 169–176. doi:10.1177/0963721416643289.
77. *Wheadon, Christopher. 2013. “Using Modern Test Theory to Maintain Standards in Public Qualifications in England.” Research Papers in Education 28: 628–647. doi:10.1080/02671522.2012.706631.
78. *Zwick, Rebecca. 1993. “The Validity of the GMAT for the Prediction of Grades in Doctoral Study in Business and Management: An Empirical Bayes Approach.” Journal of Educational Statistics 18: 91–107. doi:10.3102/10769986018001091.