Causal inference with large-scale assessments in education from a Bayesian perspective: a review and synthesis

Large-Scale Assessments in Education

Volumn 4, Issue 1, 2016, Pages

  Kaplan, David ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Bayesian Model Average; Causal Inference; Propensity Score; Propensity Score Analysis

Indexed keywords

EID: 85041169696     PISSN: None     EISSN: 21960739     Source Type: Journal    
DOI: 10.1186/s40536-016-0022-6     Document Type: Review

References (60)

1. An, W. H. (2010). Bayesian propensity score estimators: Incorporating uncertainties in propensity scores into causal inference. Sociological Methodology, 40, 151–189.
2. Berger, J. (2006). The case for objective Bayesian analysis. Bayesian Analysis, 3, 385–402.
3. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
4. Cartwright, N. (2007). Hunting causes and using them: Approaches in philosophy and economics. Cambridge: Cambridge University Press.
5. Chen, J., & Kaplan, D. (2015). Covariate balance in a two-step bayesian propensity score approach for observational studies. Journal of Research on Educational Effectiveness, 8, 280–302.
6. Cochran, W. G. (1968). The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics, 24, 295–313.
7. Dehejia, R. H., & Wahba, S. (1999). Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, 94, 1053–1062.
8. Evans, M., Hastings, N. A. J., & Peacock, J. B. (2000). Statistical distributions (3rd ed.). New York: Wiley.
9. Gelman, A., Carlin, J. B., Stern, H. S., Rubin, D. B., & Vehtari, A. (2013). Bayesian data analysis (3rd ed.). London: Chapman and Hall.
10. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (Eds.). (1996). Markov chain Monte Carlo in practice. London: Chapman and Hall.
11. Gonzalez, E., & Rutkowski, L. (2010). Principles of multiple matrix booklet designs and parameter recovery in large-scale assessments. IEA-ETS Research Institute Monograph, 3, 125–156.
12. Guo, S., & Fraser, M. W. (2010). Propensity score analysis: Statistical methods and applications. Thousand Oaks: Sage.
13. Hansen, B. B. (2004). Full matching in an observational study of coaching for the SAT. Journal of the American Statistical Association, 99, 609–618.
14. Hansen, B. B., & Klopfer, S. O. (2006). Optimal full matching and related designs via network flow. Journal of Computational and Graphical Statistics, 15, 609–627.
15. Hirano, K., & Imbens, G. W. (2001a). Estimation of causal effects using propensity score weighting: An application to data on right heart catheterization. Health Services and Outcomes Research Methodology, 2, 259–278.
16. Hirano, K., & Imbens, G. W. (2001b). Estimation of causal effects using propensity score weigting: An application to data on right heart catheterization. Health Services & Outcomes Research Methodology, 2, 259–278.
17. Hirano, K., Imbens, G. W., & Ridder, G. (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica, 71, 1169–1189.
18. Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999). Bayesian model averaging: A tutorial. Statistical Science, 14, 382–417.
19. Hoeting, J. A., Raftery, A. E., & Madigan, D. (1996). A method for simultaneous variable selection and outlier identification in linear regression. Computational Statistics & Data Analysis, 22, 251–270.
20. Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945–960.
21. Horvitz, D. G., & Thompson, D. J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47, 663–685.
22. Hoshino, T. (2008). A Bayesian propensity score adjustment for latent variable modeling and MCMC algorithm. Computational Statistics & Data Analysis, 52, 1413–1429.
23. Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334.
24. Imai, K., Keele, L., Tingley, D., & Yamamoto, T. (2011). Unpacking the black box of causality: Learning about causal mechanisms from experimental and observational studies. American Political Science Review, 105, 765–789.
25. Imai, K., Keele, L., & Yamamoto, T. (2010). Identification, inference and sensitivity analysis for causal mediation effects. Statistical Science, 25, 51–71.
26. Kaplan, D. (2009). Causal inference in non-experimental educational policy research. In G. Sykes, B. Schneider, & D. N. Plank (Eds.), Handbook on education policy research (pp. 139–153). New York: Taylor and Francis.
27. Kaplan, D. (2014). Bayesian statistics for the social sciences. New York: Guilford Press.
28. Kaplan, D., & Chen, J. (2012). A two-step Bayesian approach for propensity score analysis: Simulations and case study. Psychometrika, 77, 581–609.
29. Kaplan, D., & Chen, J. (2014). Bayesian model averaging for propensity score analysis. Multivariate Behavioral Research, 49, 505–517.
30. Kaplan, D., & Su, D. (2016). On matrix sampling and imputation of context questionnaires with implications for the generation of plausible values in large-scale assessments. Journal of Educational and Behavioral Statistics, 41, 57–80.
31. Kim, J.-S., & Steiner, P. M. (2015). Multilevel propensity score methods for estimating causal effects: A latent class modeling strategy. In L. van der Ark, D. Bolt, W.-C. Wang, J. Douglas, & S.-M. Chow (Eds.), Quantitative psychology research: Proceedings of the 79th annual meeting of the psychometric society. New York: Springer.
32. Lewis, D. (1973). Counterfactuals. Malden, MA: Blackwell.
33. Leamer, E. E. (1983). Model choice and specification analysis. In Z. Griliches & M. Intriligator (Eds.), Handbook of econometrics (Vol. 1). Amsterdam: North Holland.
34. Mackie, J. L. (1974). The cement of the universe: A study of causation. Oxford: Oxford University Press.
35. Madigan, D., & Raftery, A. E. (1994). Model selection and accounting for model uncertainly in graphical models using Occam’s window. Journal of the American Statistical Association, 89, 1535–1546.
36. Martin, A. D., Quinn, K. M., & Park, J. H. (2010). Markov chain Monte Carlo (MCMC) Package. http://www.mcmcpack.wustl.edu/
37. McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004). Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychological Methods, 9, 403–425.
38. McCandless, L. C., Gustafson, P., & Austin, P. C. (2009). Bayesian propensity score analysis for observational data. Statistics in Medicine, 28, 94–112.
39. McLachlan, G., & Peel, D. (2000). Finite mixture models. New York: John Wiley and Sons.
40. Morgan, S. L., & Winship, C. (2007). Counterfactuals and causal inference: Methods and principles for social research. Cambridge: Cambridge University Press.
41. National Center for Education Statistics. (2001). Early childhood longitudinal study: Kindergarten class of 1998–99: Kindergarten - fifth grade public-use data files user’s manual (Tech. Rep. Nos. NCES 2001–029). Washington, DC: U.S. Government Printing Office.
42. Neyman, J. (1923). Statistical problems in agriculture experiments. Journal of the Royal Statistical Society, Series B, 2, 107–180.
43. O’Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., & Jenkinson, D. (2006). Uncertain judgements: Eliciting experts’ probabilities. West Sussex: Wiley.
44. Park, S., & Kaplan, D. (2015). Bayesian causal mediation analysis for group randomized designs with homogenous and heterogenous treatment effects: Simulation and case study. Multivariate Behavioral Research, 50, 316–333.
45. Press, S. J. (2003). Subjective and objective Bayesian statistics: Principles, models, and applications (2nd ed.). New York: Wiley.
46. Raftery, A. E., Madigan, D., & Hoeting, J. A. (1997). Bayesian model averaging for linear regression models. Journal of the American Statistical Association, 92, 179–191.
47. Rässler, S. (2002). Statistical matching: A frequentist theory, practical applications, and alternative Bayesian approaches. New York: Springer.
48. Rosenbaum, P. R. (1987). Model-based direct adjustment. Journal of the American Statistical Association, 82, 387–394.
49. Rosenbaum, P. R. (1989). Optimal matching for observational studies. Journal of the American Statistical Association, 84, 1024–1032.
50. Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.
51. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688–701.
52. Rubin, D. B. (1985). The use of propensity scores in applied Bayesian inference Bayesian. Statistics, 2, 463–472.
53. Rubin, D. B., et al. (2006). Matched sampling for causal effects. Cambridge: Cambridge University Press.
54. Rutkowski, L. (2011). The impact of missing background data on sub-population estimation. Journal of Educational Measurement, 48, 293–312.
55. Steiner, P. M., & Cook, D. (2013). Matching and propensity scores. In T. Little (Ed.), Oxford handbook of quantitative methods. Oxford: Oxford University Press.
56. Thoemmes, F. J., & Kim, E. (2011). A systematic review of propensity score methods in the social sciences. Multivariate Behavioral Research, 46, 90–118.
57. Tierney, L., & Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81, 82–86.
58. van Buuren, S., & Groothuis-Oudshoorn, K. (2011). Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software.
59. von Davier, M. (2013). Imputing proficiency data under planned missingness in population models. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis. Boca Raton: Chapman Hall/CRC.
60. Woodward, J. (2003). Making things happen: A theory of causal explanation. Oxford: Oxford University Press.