Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS

Research Synthesis Methods

Volumn 5, Issue 1, 2014, Pages 13-30

  Tanner Smith, Emily E ^a   Tipton, Elizabeth ^b  

^a VANDERBILT UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Dependent effect sizes; Robust variance estimation; Software tutorial

Indexed keywords

ALGORITHM; ANALYSIS OF VARIANCE; COMPUTER LANGUAGE; META ANALYSIS (TOPIC); METHODOLOGY; SAMPLE SIZE; SOFTWARE; STATISTICAL ANALYSIS;

ALGORITHMS; ANALYSIS OF VARIANCE; DATA INTERPRETATION, STATISTICAL; META-ANALYSIS AS TOPIC; PROGRAMMING LANGUAGES; RESEARCH DESIGN; SAMPLE SIZE; SOFTWARE;

EID: 84959324926     PISSN: 17592879     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1091     Document Type: Article

References (24)

1. de Vibe M, Bjørndal A, Tipton E, Hammerstrøm K, Kowalski K. 2012. Mindfulness based stress reduction (MBSR) for improving health, quality of life, and social functioning in results. Campbell Systematic Reviews 3.
2. nd ed.), pp. 357-376, Russell Sage Foundation, New York.
3. Hedges LV, Tipton E, Johnson MC. 2010. Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods 1: 39-65.
4. th Berkeley Symposium on Mathematical Statistics and Probability 1, 221-223, University of California Press, Berkeley, CA.
5. Jackson D, Riley R, White IR. 2011. Multivariate meta-analysis: potential and promise. Stat Med 30: 2481-2498.
6. Konstantopoulos S. 2011. Fixed effects and variance components estimation in three-level meta-analysis. Research Synthesis Methods 2: 61-76.
7. Liang K, Zeger SL. 1986. Longitudinal data analysis using generalized linear models. Biometrika 73: 13-22.
8. López-López JA, Lipsey MW, Wilson SJ, Tanner-Smith EE, Van den Noortgate W. c. 2013. Assessing the influence of moderators in meta-analysis with dependent effect sizes: A Monte Carlo simulation', Unpublished Manuscript. University of Murcia, Spain.
9. Marín-Martínez F, Sánchez-Meca J. 2010. Weighting by inverse variance or by sample size in random-effects meta-analysis. Educational and Psychological Measurement 70: 56-73.
10. Mavridis D, Salanti G. 2012. A practical introduction to multivariate meta-analysis. Statistical Methods in Medical Research 22: 133-158.
11. Raudenbush SW, Bryk AS. 2002, Hierarchical linear models: Applications and data analysis methods, (2nd ed.), Sage Publications, London.
12. Riley R. 2009. Multivariate meta-analysis: the effect of ignoring within-study correlation. Journal of the Royal Statistical Society, Series A 27: 670-686.
13. Riley RD, Thompson JR, Abrams KR. 2008. An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. Biostatistics 9: 172-186.
14. Samson JE, Ojanen T, Hollo A. 2012. Social goals and youth aggression: meta-analysis of prosocial and antisocial goals. Social Development 21: 645-666.
15. Stevens JR, Taylor AM. 2009. Hierarchical dependence in meta-analysis. J Educ Behav Stat 34: 46-73.
16. Tanner-Smith EE, Wilson SJ, Lipsey MW. 2013. The comparative effectiveness of outpatient treatment for adolescent substance abuse: a meta-analysis. Journal of Substance Abuse Treatment 44: 145-158.
17. Tipton E. 2013a. Robust variance estimation in meta-regression with binary dependent effects. Research Synthesis Methods 4(2): 169-187.
18. Tipton, E. c. 2013b. 'Small sample adjustments for robust variance estimation with meta-regression', Unpublished Manuscript. Teachers College, Columbia University.
19. Uttal DH, Meadow NG, Tipton E, Hand LL, Alden AR, Warren C, Newcombe NS. 2013. The malleability of spatial skills: a meta-analysis of training studies. Psychological Bulletin 139: 352-402.
20. Viechtbauer W. 2010. Conducting meta-analysis in R with the metafor package. Journal of Statistical Software 36: 1-48.
21. Wei Y, Higgins JPT. 2012. Estimating within-study covariances in multivariate meta-analysis with multiple outcomes. Statistics in Medicine 32: 1191-1205.
22. White H. 1980. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48: 817-838.
23. Williams R. 2012. 'Using robust standard errors to combine multiple regression estimates with meta-analysis', PhD thesis, Dept. of Research Methodology, Loyola University Chicago.
24. Wilson SJ, Tanner-Smith EE, Lipsey MW, Steinka-Fry, K, Morrison J. 2011. Dropout prevention and intervention programs: effects on school completion and dropout among school-aged children and youth. Campbell Systematic Reviews 8.