Standardized effect size measures for mediation analysis in cluster-randomized trials

Journal of Experimental Education

Volumn 83, Issue 4, 2015, Pages 547-582

  Stapleton, Laura M ^a   Pituch, Keenan A ^b   Dion, Eric ^c  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

Author keywords

effect size; experiment; hierarchical linear modeling (HLM); intervention; mediation

Indexed keywords

EID: 84938968883     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220973.2014.919569     Document Type: Article

References (41)

1. Alwin, D. F., & Hauser, R. M. (1975). The decomposition of effects in path analysis. American Sociological Review, 40, 37-47. doi:10.2307/2094445
2. Bauer, D. J., Preacher, K. J., & Gil, K. M. (2006). Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations. Psychological Methods, 11, 142-63. doi:10.1037/1082-989X.11.2.142
3. Browne, W. J., & Draper, D. (2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1, 473-514. doi:10.1214/06-BA117
4. Clements, D. H., Sarama, J., Spitler, M. E., Lange, A. A., & Wolfe, C. B. (2011).Mathematics learned by young children in an intervention based on learning trajectories: A large-scale cluster randomized trial. Journal for Research in Mathematics Education, 42, 127-166.
5. Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509. doi:10.1037/0033-2909.114.3.494
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
7. Dion, E., Roux, C., Landry, D., Fuchs, D., Wehby, J., & Dupéré, V. (2011). Improving attention and preventing reading difficulties among low-income first-graders:Arandomized study. Prevention Science, 12, 70-79. doi:10.1007/s11121-010-0182-5
8. Ditlevsen, S., Christensen, U., Lynch, J., Damsgaard, M. T., & Keiding, N. (2005). The mediation proportion: A structural equation approach for estimating the proportion of exposure effect on outcome explained by an intermediate variable. Epidemiology, 16, 114-120. Retrieved from http://www.jstor.org/stable/20486008
9. Efron, B. (1979). Computers and statistics: Thinking the unthinkable. SIAM Review, 21, 460-480.
10. Enders, C. K., & Tofigi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138. doi:10.1037/1082-989X.12.2.121
11. Fairchild, A. J., MacKinnon, D. P., Taborga, M. P., & Taylor, A. B. (2009). R2 effect-size measures for mediation analysis. Behavior Research Methods, 41, 486-498. doi:10.3758/BRM.41.2.486
12. Freedman, L. S. (2001). Confidence intervals and statistical power of the "validation" ratio for surrogate or intermediate endpoints. Journal of Statistical Planning and Inference, 96, 143-153. doi:10.1016/S0378-3758(00)00330-X
13. Fuchs, L. S., Fuchs, D., & Maxwell, L. (1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9, 20-28.
14. Graham, J. W., & Hofer, S. M. (2000). Multiple imputation in multivariate research. In T. D. Little, K. U. Schnabel, & J. Baumert (Eds.), Modeling longitudinal and multilevel data (pp. 201-218). Mahwah, NJ: Erlbaum.
15. Hedges, L. V. (2007). Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32, 341-370. Retrieved from http://www.jstor.org/stable/20172092
16. Institute for Education Sciences. (2013). Request for applications: Education research grants. Retrieved from http://ies.ed.gov/funding/pdf/2014 84305A.pdf
17. Kenny, D. A., Kashy, D. A., & Bolger, N. (1998). Data analysis in social psychology. In D. Gilbert, S. T. Fiske, & G. Lindzey (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 223-265). New York, NY: McGraw-Hill.
18. Krull, J. L., & MacKinnon, D. P. (2001).Multilevel modeling of individual and group level mediated effects. Multivariate Behavioral Research, 36, 249-77. doi:10.1207/S15327906MBR3602 06
19. Lewis, K. M., DuBois, D. L, Bavarian, N., Acock, A., Silverthorn, N., Day, J., . . . Flay, B. (2013). Effects of positive action on the emotional health of urban youth: A cluster-randomized trial. Journal of Adolescent Health, 53, 706-711.
20. Maas, C. J., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1, 86-92. doi:10.1027/1614-2241.1.3.86
21. MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York, NY: Erlbaum.
22. MacKinnon, D. P., Lockwood, C. M., & Williams, J. (2004). Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behavioral Research, 39, 99-128. doi:10.1207/s15327906mbr3901 4
23. MacKinnon, D. P., Warsi, G., & Dwyer, J. H. (1995). A simulation study of mediated effect measures. Multivariate Behavioral Research, 30, 41-62. doi:10.1207/s15327906mbr3001 3
24. Murnane, R. J., & Willett, J. B. (2011). Methods matter: Improving causal inference in educational and social science research. New York, NY: Oxford University Press.
25. Peng, C.-Y. J., & Chen, L.-T. (2013). Beyond Cohen's d: Alternative effect size measures for between-subject designs. Journal of Experimental Education, 82, 22-50. doi:10.1080/00220973.2012.745471
26. Peng, C.-Y. J., Chen, L.-T., Chiang, H.-M., & Chiang, Y.-C. (2013). The impact of APA and AERA guidelines on effect size reporting. Educational Psychology Review, 25, 157-209. doi:10.1007/s10648-013-9218-2
27. Pituch, K. A., Murphy, D. L., & Tate, R. L. (2010). Three-levelmodels for indirect effects in school- and class-randomized experiments in education. Journal of Experimental Education, 78, 60-95.
28. Pituch, K. A., & Stapleton, L. M. (2008). The performance of methods to test upper-level mediation in the presence of nonnormal data. Multivariate Behavioral Research, 43, 237-267. doi:10.1080/00273170802034844
29. Pituch, K. A., & Stapleton, L. M. (2011). Hierarchical linear and structural equation modeling approaches to mediation analysis in randomized field experiments, multilevel analysis and tests of mediation. In P. Vogt & M.Williams (Eds.), Handbook on methodological innovations in the social sciences (pp. 590-619). London, UK: Sage.
30. Pituch, K. A, & Stapleton, L. M. (2012). Distinguishing between cross- and cluster-level mediation processes in the cluster randomized trial. Sociological Methods & Research, 41, 630-670. doi:10.1177/0049124112460380
31. Pituch, K. A., Stapleton, L. M., & Kang, J.Y. (2006).Acomparison of single sample and bootstrapmethods to assess mediation in cluster-randomized trials. Multivariate Behavioral Research, 41, 367-400. doi:10.1207/s15327906mbr41035
32. Preacher, K. J. (2011). Multilevel SEM strategies for evaluating mediation in three-level data. Multivariate Behavioral Research, 46, 691-731. doi:10.1080/00273171.2011.589280
33. Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879-891. doi:10.3758/BRM.40.3.879
34. Preacher, K. J., & Kelley, K. (2011). Effect size measures formediationmodels:Quantitative strategies for communicating indirect effects. Psychological Methods, 16, 93-115. doi:10.1037/a0022658
35. Preacher, K. J., Zhang, Z., & Zyphur, M. J. (2011). Alternative methods for assessing mediation in multilevel data: The advantages of multilevel SEM. Structural Equation Modeling, 18, 161-182. doi:10.1080/10705511.2011.557329
36. Raudenbush, S.W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
37. Rooney, B. L., & Murray, D. M. (1996). A meta-analysis of smoking prevention programs after adjustment for errors in the unit of analysis. Health Education Quarterly, 23, 48-64.
38. Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis (2nd ed., pp. 6-13). London, UK: Sage.
39. VanderWeele, T. (2010). Direct and indirect effects for neighborhood-based clustered and longitudinal data. Sociological Methods & Research, 38, 515-544. doi:10.1177/0049124110366236
40. West, S. G. (2011). Editorial: Introduction to the special section on causal inference in cross sectional and longitudinal mediational models. Multivariate Behavioral Research, 46, 812-815. doi:10.1080/00273171.2011.60671
41. Williams, J., & MacKinnon, D. P. (2008). Resampling and distribution of the product methods for testing indirect effects in complex models. Structural Equation Modeling: A Multidisciplinary Journal, 15, 23-51. doi:10.1080/10705510701758166