Analyzing indirect effects in cluster randomized trials. The effect of estimation method, number of groups and group sizes on accuracy and power

Frontiers in Psychology

Volumn 5, Issue FEB, 2014, Pages

  Hox, Joop J ^a   Moerbeek, Mirjam ^a   Kluytmans, Anouck ^a   van de Schoot, Rens ^a,b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b NORTH WEST UNIVERSITY   (South Africa)

Author keywords

Bayesian estimation; Cluster randomized trial; Mediation; Multilevel sem; Sample size

Indexed keywords

EID: 84897590826     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00078     Document Type: Article

References (47)

1. Ajzen, I. (1991). The theory of planned behavior. Organ. Hum. Dec. Process. 50, 179-211. doi: 10.1016/0749-5978(91)90020-T.
2. Barnett, V. (2008). Comparative Statistical Inference. Chicester: Wiley.
3. Baron, R. M., and Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J. Pers. Soc. Psychol. 51, 1173-1182. doi: 10.1037/0022-3514.51.6.1173.
4. Bauer, D. J., Preacher, K. J., and Gil, K. M. (2006). Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: new procedures and recommendations. Psychol. Methods 11, 142-163. doi: 10.1037/1082-989X.11.2.142.
5. Conner, M., and Armitage, C. J. (1998). Extending the theory of planned behavior: a review and avenues for further research. J. Appl. Soc. Psychol. 28, 1429-464. doi: 10.1111/j.1559-1816.1998.tb01685.x.
6. Dagne, G. A., Hendricks Brown, C., and Howe, G. W. (2007). Hierarchical modeling of sequential behavioral data: examining complex association patterns in mediation models. Psychol. Methods 12, 298-316. doi: 10.1037/1082-989X.12.3.298.
7. Donner, A., and Klar, N. (2000). Design and Analysis of Cluster Randomization Trials in Health Research. London: Edward Arnold.
8. Eldridge, M., and Kerry, S. (2012). A Practical Guide to Cluster Randomized Trials in Health Services Research. Chichester: Wiley. doi: 10.1002/9781119966241.
9. Fahrmeir, L., Kneib, T., and Lang, S. (2013). "Bayesian multilevel models," in The Sage Handbook of Multilevel Modeling, eds M. A. Scott, J. S. Simonoff, and B. D. Marx (Los Angeles, CA: Sage), 53-72. doi: 10.4135/9781446247600.n4.
10. Gail, M., Mark, S., Carroll, R., and Green, S. (1996). On design considerations and randomization-based inference for community intervention trials. Stat. Med. 15, 1069-1092. doi: 10.1002/(SICI)1097-0258(19960615)15:11<1069::AID-SIM220>3.0.CO;2-Q.
11. Gelman, A., Carlin, J. B., Stern, H. S., and Rubin, D. B. (2004). Bayesian Data Analysis, 2nd Edn. Boca Raton, FL: Chapman and Hall/CRC.
12. Gelman, A., and Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Stat. Sci. 7, 457-511. doi: 10.1214/ss/1177011136.
13. Glen, A. G., Leemis, L. M., and Drew, J. H. (2004). Computing the distribution of the product of two continuous random variables. Comput. Stat. Data Anal. 44, 451-464. doi: 10.1016/S0167-9473(02)00234-7.
14. Hamaker, E. L., and Klugkist, I. (2011). "Bayesian estimation of multilevel models," in Handbook of Advanced Multilevel Analysis, eds J. J. Hox and J. K. Roberts (New York, NY: Routledge), 137-162.
15. Hayes, R. J., and Moulton, L. H. (2009). Cluster Randomised Trials. Boca Rotan, FL: CRC Press. doi: 10.1201/9781584888178.
16. Hox, J. J. (2010). Multilevel Analysis. Techniques and Applications, 2nd Edn. New York, NY: Routledge.
17. Hox, J. J., Maas, C. J. M., and Brinkhuis, M. J. S. (2010). The effect of estimation method and sample size in multilevel structural equation modelling. Stat. Neerl. 64, 157-170. doi: 10.1111/j.1467-9574.2009.00445.x.
18. Hox, J., van de Schoot, R., and Matthijsse, S. (2012). How few countries will do? Comparative survey analysis from a Bayesian perspective. Surv. Res. Methods 6, 87-93.
19. Kruschke, J. K. (2011). Doing Bayesian Data Analysis. Burlingon, MA: Academic Press.
20. Krull, J. L., and MacKinnon, D. P. (2001). Multilevel modelling of individual and group level mediated effects. Multivariate Behav. Res. 36, 249-277. doi: 10.1207/S15327906MBR3602_06.
21. Lynch, S. (2007). Introduction to Applied Bayesian Statistics and Estimation for Social Scientists. New York, NY: Springer. doi: 10.1007/978-0-387-71265-9.
22. Maas, C. J. M., and Hox, J. J. (2005). Sufficient sample sizes for multilevel modelling. Methodology 1, 86-92. doi: 10.1027/1614-2241.1.3.85.
23. MacKinnon, D. P. (2008). Statistical Mediation Analysis. New York, NY: Lawrence Erlbaum Associates.
24. MacKinnon, D. P., Fairchild, A. J., and Fritz, M. S. (2007). Mediation analysis. Annu. Rev. Psychol. 58, 593-614. doi: 10.1146/annurev.psych.58.110405.085542.
25. MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., and Sheets, V. (2002a). A comparison to test mediation and other intervening variable effects. Psychol. Methods 7, 83-104. doi: 10.1037/1082-989X.7.1.83.
26. MacKinnon, D. P., Taborga M. P., and Morgan-Lopez, A. A. (2002b). Mediation designs for tobacco prevention research. Drug Alcohol Depend. 68, 569-583. doi: 10.1016/S0376-8716(02)00216-8.
27. Mehta, P. D., and Neale, M. C. (2005), People are variables too: multilevel structural equations modeling. Psychol. Methods 10, 259-284. doi: 10.1037/1082-989X.10.3.259.
28. Meuleman, B., and Billiet, J. (2009). A Monte Carlo sample size study: how many countries are needed for accurate multilevel SEM? Surv. Res. Methods 3, 45-58.
29. Moerbeek, M. (2005). Randomization of clusters versus randomization of persons within clusters: which is preferable? Am. Stat. 59, 72-78. doi: 10.1198/000313005X20727.
30. Moerbeek, M., Van Breukelen, G. J. P., and Berger, M. P. F. (2003). A comparison between traditional methods and multilevel regression for the analysis of multi-center intervention studies. J. Clin. Epidemiol. 56, 341-350. doi: 10.1016/S0895-4356(03)00007-6.
31. Murray, D. M. (1998). Design and Analysis of Group-Randomized Trials. New York, NY: Oxford University Press.
32. Muthén, L. K., and Muthén, B. O. (2012). Mplus User's Guide, 7th Edn. Los Angeles, CA: Muthén and Muthén.
33. Pituch, K. A., Murphy, D. L. and Tate, R. L. (2010). Three-level models for indirect effects in school-and class-randomized experiments in education. J. Exp. Educ. 78, 60-95. doi: 10.1080/00220970903224685.
34. Pituch, K. A., and Stapleton, L. M. (2012). Distinguishing between cross-and cluster-level mediation processes in the cluster randomized trial. Sociol. Methods Res. 41, 630-670. doi: 10.1177/0049124112460380.
35. Pituch, K. A., Whittaker, T. A., and Stapleton, L. A. (2005). A comparison of methods to test for mediation in multisite experiments. Multivariate Behav. Res. 40, 1-23. doi: 10.1207/s15327906mbr4001_1.
36. Preacher, K. J., Zhang, Z., and Zyphur, M. J. (2011). Alternative methods for assessing mediation in multilevel data: the advantages of multilevel SEM. Struct. Equ. Model. 18, 161-182. doi: 10.1080/10705511.2011.557329.
37. Raudenbush, S. W., and Bryk, A. (2002). Hierarchical Linear Models. Applications and Data Analysis Methods. Thousand Oaks, CA: Sage Publications.
38. Raudenbush, S. W., and Sampson, R. (1999). Assessing direct and indirect effects in multilevel designs with latent variables. Sociol. Methods Res. 28, 123-153. doi: 10.1177/0049124199028002001.
39. Raykov, T., and Mels, G. (2007). Lower level mediation effect analysis in two-level multilevel structural equation modeling approach. Struct. Equ. Model. 14, 636-648. doi: 10.1080/10705510701575511.
40. van de Schoot, R., Kaplan, D., Denissen, J., Asendorpf, J. B., Neyer, F. J., and van Aken, M. A. G. (2013). A gentle introduction to bayesian analysis: applications to research in child development. Child Dev. doi: org/10.1111/cdev.12169. [Epub ahead of print].
41. Sheppard, B. H., Hartwick, J., and Warshaw, P. R. (1988). The theory of reasoned action: a meta-analysis of past research with recommendations for modifications and future research. J. Consum. Res. 15, 325-343. doi: 10.1086/209170.
42. Shrout, P. E., and Bolger, N. (2002). Mediation in experimental and nonexperimental studies: new procedures and recommendations. Psychol. Methods 7, 422-445. doi: 10.1037/1082-989X.7.4.422.
43. Snijders, T. A. B., and Bosker, R. J. (2012). Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. London: Sage.
44. Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural Equation models. Sociol. Methodol. 13, 290-312. doi: 10.2307/270723.
45. Taylor, A. B., MacKinnon, D. P., and Tein, J.-Y. (2007). Test of the three-path mediated effect. Organ. Res. Methods 11, 241-269. doi: 10.1177/1094428107300344.
46. Yuan, Y., and MacKinnon, D. P. (2009). Bayesian mediation analysis. Psychol. Methods 14, 301-322. doi: 10.1037/a0016972.
47. Zhang, Z., Zyphur, M. J., and Preacher, K. J. (2009). Testing multilevel mediation using hierarchical linear models. Problems and solutions. Organ. Res. Methods 12, 695-719. doi: 10.1177/1094428108327450.