Three-level meta-analysis of dependent effect sizes

Behavior Research Methods

Volumn 45, Issue 2, 2013, Pages 576-594

  Van den Noortgate, Wim ^a   López López, José Antonio ^b   Marín Martínez, Fulgencio ^b   Sánchez Meca, Julio ^b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF MURCIA   (Spain)

Author keywords

Dependence; Meta analysis; Multilevel; Multiple outcomes

Indexed keywords

ARTICLE; EPIDEMIOLOGY; EVALUATION; META ANALYSIS (TOPIC); MULTIVARIATE ANALYSIS; PSYCHOLOGICAL MODEL; STATISTICAL MODEL; THEORETICAL MODEL;

META-ANALYSIS AS TOPIC; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; MODELS, THEORETICAL; MULTIVARIATE ANALYSIS; SAMPLING STUDIES;

EID: 84878224348     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-012-0261-6     Document Type: Article

References (40)

1. Becker, B. J. (2000). Multivariate meta-analysis. In H. E. A. Tinsley & E. D. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 499-525). Orlando: Academic Press.
2. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. (2009). Introduction to meta-analysis. Chichester: Wiley.
3. Box, G. E. P., & Draper, N. R. (1987). Empirical model-building and response surfaces. Hoboken, NJ: Wiley.
4. Cheung, S. F., & Chan, D. K. S. (2008). Dependent correlations in meta-analysis: The case of heterogeneous dependence. Educational and Psychological Measurement, 68, 760-777.
5. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
6. Cooper, H. (2009). Research synthesis and meta-analysis (4th ed.). London: Sage.
7. DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177-188.
8. Geeraert, L., van den Noortgate, W., Grietens, H., & Onghena, P. (2004). The effects of early prevention programs for families with young children at risk for physical child abuse and neglect. A meta-analysis. Child Maltreatment, 9, 277-291.
9. Gleser, L. J., & Olkin, I. (1994). Stochastically dependent effect sizes. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 339-355). New York: Russell Sage Foundation.
10. Gleser, L. J., & Olkin, I. (2009). Stochastically dependent effect sizes. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 357-376). New York: The Russell Sage Foundation.
11. Goldstein, H. (1987). Multilevel models in educational and social research. London: Griffin.
12. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando: Academic Press.
13. Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation of meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39-65.
14. Higgins, J. P. T., Whitehead, A., Turner, R. M., Omar, R. Z., & Thompson, S. G. (2001). Meta-analysis of continuous outcome data from individual patients. Statistics in Medicine, 20, 2219-2241.
15. Hox, J. (2002). Multilevel analysis. Techniques and applications. Mahwah, NJ: Erlbaum.
16. Kalaian, H. A., & Raudenbush, S. W. (1996). A multivariate mixed linear model for meta-analysis. Psychological Methods, 1, 227-235.
17. Kish, L. (1965). Survey sampling. New York: Wiley.
18. Kreft, I. G. G., & De Leeuw, J. (1998). Introducing multilevel modeling. Newbury Park, CA: Sage.
19. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
20. Littell, J. H., Corcoran, J., & Pillai, V. (2008). Systematic reviews and meta-analysis. New York: Oxford University Press.
21. Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS® system for mixed models (2nd ed.). Cary, NC: SAS Institute Inc.
22. López-lópez, J. A., Viechtbauer, W., Sánchez-Meca, J., & Marín-Martínez, F. (2010). Comparing the performance of alternative statistical tests for moderators in mixed-effects meta-regression models. Paper presented at the 5th Annual meeting of the Society for Research Synthesis Methodology. Cartagena, Spain.
23. Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1, 85-91.
24. Marsh, H. W., Bornmann, L., Mutz, R., Daniel, H., & O'Mara, A. (2009). Gender effects in the peer reviews of grant proposals: A comprehensive meta-analysis comparing traditional and multilevel approaches. Review of Educational Research, 79, 1290-1326.
25. Raudenbush, S. W. (1988). Educational applications of hierarchical linear models: A review. Journal of Educational Statistics, 13, 85-116.
26. Raudenbush, S. W., Becker, B. J., & Kalaian, H. A. (1988). Modeling multivariate effect sizes. Psychological Bulletin, 103, 111-120.
27. Raudenbush, S. W., & Bryk, A. S. (1985). Empirical Bayes meta-analysis. Journal of Educational Statistics, 10, 75-98.
28. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). London: Sage Publications.
29. Riley, R. D. (2009). Multivariate meta-analysis: The effect of ignoring within-study correlation. Journal of the Royal Statistical Society, Series A, 172, 789-811.
30. Rosa-Alcázar, A. I., Sánchez-Meca, J., Gómez-Conesa, A., & Marín-Martínez, F. (2008). Psychological treatment of obsessive-compulsive disorder: A meta-analysis. Clinical Psychology Review, 28, 1310-1325.
31. Shogren, K. A., Fagella-Luby, M. N., Bae, J. S., & Wehmeyer, M. L. (2004). The effect of choice-making as an intervention for problem behavior. Journal of Positive Behavior Interventions, 6, 228-237.
32. Snijders, T. A. B. (2003). Multilevel analysis. In M. Lewis-Beck, A. E. Bryman, & T. F. Liao (Eds.), The SAGE Encyclopedia of Social Science Research Methods (Volume II) (pp. 673-677). London: Sage.
33. Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis. An introduction to basic and advanced multilevel modeling. London: Sage.
34. Stevens, J. R., & Taylor, A. M. (2009). Hierarchical dependence in meta-analysis. Journal of Educational and Behavioral Statistics, 34, 46-73.
35. Thompson, S. G., Turner, R. M., & Warn, D. E. (2001). Multilevel models for meta-analysis, and their application to absolute risk differences. Statistical Methods in Medical Research, 10, 375-392.
36. van den Bussche, E., van den Noortgate, W., & Reynvoet, B. (2009). Mechanisms of masked priming: A meta-analysis. Psychological Bulletin, 135, 452-477.
37. van den Noortgate, W., & Onghena, P. (2003a). Combining single-case experimental studies using hierarchical linear models. School Psychology Quarterly, 18, 325-346.
38. van den Noortgate, W., & Onghena, P. (2003b). Multilevel meta-analysis: A comparison with traditional meta-analytical procedures. Educational and Psychological Measurement, 63, 765-790.
39. van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 2, 142-151.
40. Viechtbauer, W. (2005). Bias and efficiency of meta-analytic variance estimators in the random-effects model. Journal of Educational and Behavioral Statistics, 30, 261-293.