Multivariate Meta-Analysis as Structural Equation Models

Structural Equation Modeling

Volumn 20, Issue 3, 2013, Pages 429-454

  Cheung, Mike W L ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

mixed effects model; multivariate effect sizes; multivariate meta analysis; random effects model; structural equation model

Indexed keywords

EFFECT SIZE; META-ANALYSIS; MIXED-EFFECTS MODELS; RANDOM EFFECTS MODEL; STRUCTURAL EQUATION MODELS;

TELECOMMUNICATION SERVICES;

BEHAVIORAL RESEARCH;

EID: 84880963557     PISSN: 10705511     EISSN: 15328007     Source Type: Journal    
DOI: 10.1080/10705511.2013.797827     Document Type: Article

References (90)

1. Arbuckle, J. L. 1996. " Full information estimation in the presence of incomplete data. ". In Advanced structural equation modeling: Issues and techniques Edited by: Marcoulides, G. A. and Schumacker, R. E. 243 - 277. Mahwah, NJ: Erlbaum.
2. Arends, L. R., Vokó, Z. and Stijnen, T. 2003. Combining multiple outcome measures in a meta-analysis: An application. Statistics in Medicine, 22: 1335 - 1353.
3. Au, K. and Cheung, M. W. L. 2004. Intra-cultural variation and job autonomy in 42 countries. Organization Studies, 25: 1339 - 1362.
4. Bauer, D. J. 2003. Estimating multilevel linear models as structural equation models. Journal of Educational and Behavioral Statistics, 28: 135 - 167.
5. Becker, B. J. 1992. Using results from replicated studies to estimate linear models. Journal of Educational Statistics, 17: 341 - 362.
6. Becker, B. J. 2000. " Multivariate meta-analysis. ". In Handbook of applied multivariate statistics and mathematical modeling Edited by: Tinsley, H. E. A. and Brown, S. D. 499 - 525. San Diego, CA: Academic.
7. Becker, B. J. 2009. " Model-based meta-analysis. ". In The handbook of research synthesis and meta-analysis, 2nd ed. Edited by: Cooper, H., Hedges, L. V. and Valentine, J. C. 377 - 395. New York, NY: Russell Sage Foundation.
8. Becker, B. J. and Schram, C. M. 1994. " Examining explanatory models through research synthesis. ". In The handbook of research synthesis Edited by: Cooper, H. and Hedges, L. V. 357 - 381. New York, NY: Russell Sage Foundation.
9. Bentler, P. M. 2004. EQS 6 [Computer software] Encino, CA: Multivariate Software.
10. Beretvas, S. N. and Furlow, C. F. 2006. Evaluation of an approximate method for synthesizing covariance matrices for use in meta-analytic SEM. Structural Equation Modeling, 13: 153 - 185.
11. Berkey, C. S., Anderson, J. J. and Hoaglin, D. C. 1996. Multiple-outcome meta-analysis of clinical trials. Statistics in Medicine, 15: 537 - 557.
12. Berkey, C. S., Hoaglin, D. C., Antczak-Bouckoms, A., Mosteller, F. and Colditz, G. A. 1998. Meta-analysis of multiple outcomes by regression with random effects. Statistics in Medicine, 17: 2537 - 2550.
13. Berrington, A. and Cox, D. R. 2002. Generalized least squares for the synthesis of correlated information. Biostatistics, 4: 423 - 431.
14. Bipat, S. and Zwinderman, A. H. 2010. Multivariate fixed- and random-effects models for summarizing ordinal data in meta-analysis of diagnostic staging studies. Research Synthesis Methods, 1: 136 - 148.
15. Boker, S., Neale, M., Maes, H., Wilde, M., Spiegel, M., Brick, T., Spies, J., Estabrook, R., Kenny, S., Bates, T., Mehta, P. and Fox, J. 2011. OpenMx: An open source extended structural equation modeling framework. Psychometrika, 76: 306 - 317.
16. Bollen, K. A. 1989. Structural equations with latent variables. New York, NY: Wiley.
17. Bollen, K. A. 2002. Latent variables in psychology and the social sciences. Annual Review of Psychology, 53: 605 - 634.
18. Bonett, D. 2009. Meta-analytic interval estimation for standardized and unstandardized mean differences. Psychological Methods, 14: 225 - 238.
19. Borenstein, M. 2009. " Effect sizes for continuous data. ". In The handbook of research synthesis and meta-analysis, 2nd ed. Edited by: Cooper, H., Hedges, L. V. and Valentine, J. C. 221 - 235. New York, NY: Russell Sage Foundation.
20. Borenstein, M., Hedges, L. V., Higgins, J. P. T. and Rothstein, H. R. 2010. A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1: 97 - 111.
21. Chalmers, I., Hedges, L. V. and Cooper, H. 2002. A brief history of research synthesis. Evaluation & The Health Professions, 25: 12 - 37.
22. Cheung, M. W. L. 2008. A model for integrating fixed-, random-, and mixed-effects meta-analyses into structural equation modeling. Psychological Methods, 13: 182 - 202.
23. Cheung, M. W. L. 2009a. Constructing approximate confidence intervals for parameters with structural equation models. Structural Equation Modeling, 16: 267 - 294.
24. Cheung, M. W. L. Modeling multivariate effect sizes with structural equation models. Paper presented at the Association for Psychological Science 21st annual convention. San Francisco, CA. May.
25. Cheung, M. W. L. 2010. Fixed-effects meta-analyses as multiple-group structural equation models. Structural Equation Modeling, 17: 481 - 509.
26. Cheung, M. W. L. 2013a. Implementing restricted maximum likelihood estimation in structural equation models. Structural Equation Modeling, 20: 157 - 167.
27. Cheung, M. W. L. 2013b. metaSEM: Meta-analysis using structural equation modeling. Retrieved from http://courses.nus.edu.sg/course/psycwlm/Internet/metaSEM/R package version 0.8-4
28. Cheung, M. W. L. and Chan, W. 2005. Meta-analytic structural equation modeling: A two-stage approach. Psychological Methods, 10: 40 - 64.
29. Cheung, M. W. L. and Chan, W. 2009. A two-stage approach to synthesizing covariance matrices in meta-analytic structural equation modeling. Structural Equation Modeling, 16: 28 - 53.
30. Cook, T. D., Cooper, H., Cordray, D. S., Hartmann, H., Hedges, L. V., Light, R. J., Louis, T. A. and Mosteller, F. 1992. Meta-analysis for explanation: A casebook. New York, NY: Russell Sage Foundation.
31. Cooper, H. M. 2010. Research synthesis and meta-analysis: A step-by-step approach, 4th ed. Thousand Oaks, CA: Sage.
32. Curran, P. J. 2002. Have multilevel models been structural equation models all along?. Multivariate Behavioral Research, 38: 529 - 569.
33. Demidenko, E. 2004. Mixed models: Theory and applications. Hoboken, NJ: Wiley-Interscience.
34. Enders, C. K. 2010. Applied missing data analysis. New York, NY: Guilford.
35. Fleiss, J. L. and Berlin, J. A. 2009. " Effect sizes for dichotomous data. ". In The handbook of research synthesis and meta-analysis, 2nd ed. Edited by: Cooper, H., Hedges, L. V. and Valentine, J. C. 237 - 253. New York, NY: Russell Sage Foundation.
36. Furlow, C. F. and Beretvas, S. N. 2005. Meta-analytic methods of pooling correlation matrices for structural equation modeling under different patterns of missing data. Psychological Methods, 10: 227 - 254.
37. Glass, G. V. 1976. Primary, secondary, and meta-analysis of research. Educational Researcher, 5: 3 - 8.
38. Gleser, L. J. and Olkin, I. 1994. " Stochastically dependent effect sizes. ". In The handbook of research synthesis Edited by: Cooper, H. and Hedges, L. V. 339 - 355. New York, NY: Russell Sage Foundation.
39. Gleser, L. J. and Olkin, I. 2009. " Stochastically dependent effect sizes. ". In The handbook of research synthesis and meta-analysis, 2nd ed. Edited by: Cooper, H., Hedges, L. V. and Valentine, J. C. 357 - 376. New York, NY: Russell Sage Foundation.
40. Hafdahl, A. R. 2008. Combining heterogeneous correlation matrices: Simulation analysis of fixed-effects methods. Journal of Educational and Behavioral Statistics, 33: 507 - 533.
41. Hardy, R. J. and Thompson, S. G. 1996. A likelihood approach to meta-analysis with random effects. Statistics in Medicine, 15: 619 - 629.
42. Hedges, L. V. and Olkin, I. 1985. Statistical methods for meta-analysis. Orlando, FL: Academic.
43. Hedges, L. V. and Vevea, J. L. 1998. Fixed- and random-effects models in meta-analysis. Psychological Methods, 3: 486 - 504.
44. Hox, J. J. 2010. Multilevel analysis: Techniques and applications, 2nd ed. New York, NY: Routledge.
45. Hunter, J. E. and Schmidt, F. L. 2000. Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment, 8: 275 - 292.
46. Hunter, J. E. and Schmidt, F. L. 2004. Methods of meta-analysis: Correcting error and bias in research findings, 2nd ed. Thousand Oaks, CA: Sage.
47. Jackson, D., White, I. R. and Thompson, S. G. 2010. Extending DerSimonian and Laird's methodology to perform multivariate random effects meta-analyses. Statistics in Medicine, 29: 1282 - 1297.
48. Kalaian, H. A. and Raudenbush, S. W. 1996. A multivariate mixed linear model for meta-analysis. Psychological Methods, 1: 227 - 235.
49. Konstantopoulos, S. 2008. " An introduction to meta-analysis. ". In Best practices in quantitative methods Edited by: Osborne, J. W. 177 - 194. Thousand Oaks, CA: Sage.
50. Kutner, M. H., Nachtsheim, C. J., Neter, J. and Li, W. 2005. Applied linear statistical models, 5th ed. Boston, MA: McGraw-Hill Irwin.
51. Lee, S.-Y. 2007. Structural equation modeling: A Bayesian approach. Chichester, UK: Wiley.
52. Lubke, G. H. and Muthén, B. 2005. Investigating population heterogeneity with factor mixture models. Psychological Methods, 10: 21 - 39.
53. MacCallum, R. C. and Austin, J. T. 2000. Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51: 201 - 226.
54. Mehta, P. D. and Neale, M. C. 2005. People are variables too: Multilevel structural equation modeling. Psychological Methods, 10: 259 - 284.
55. Mosteller, F. and Colditz, G. A. 1996. Understanding research synthesis (meta-analysis). Annual Review of Public Health, 17: 1 - 23.
56. Muthén, B. 1978. Contributions to factor analysis of dichotomous variables. Psychometrika, 43: 551 - 560.
57. Muthén, B. 2008. " Latent variable hybrids: Overview of old and new models. ". In Advances in latent variable mixture models Edited by: Hancock, G. R. and Samuelsen, K. M. 1 - 24. Charlotte, NC: Information Age.
58. Muthén, B. and Asparouhov, T. 2009. " Growth mixture modeling: Analysis with non-Gaussian random effects. ". In Longitudinal data analysis Edited by: Fitzmaurice, G., Davidian, M., Verbeke, G. and Molenberghs, G. 143 - 165. Boca Raton, FL: Chapman & Hall/CRC Press.
59. Muthén, B. and Asparouhov, T. 2012. Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17: 313 - 335.
60. Muthén, B. and Shedden, K. 1999. Finite mixture modeling with mixture outcomes using the EM algorithm. Biometrics, 55: 463 - 469.
61. Muthén, L. K. and Muthén, B. O. 2010. Mplususer's guide, 6th ed. Los Angeles, CA: Muthén & Muthén.
62. Nam, I.-S., Mengersen, K. and Garthwaite, P. 2003. Multivariate meta-analysis. Statistics in Medicine, 22: 2309 - 2333.
63. National Research Council. 1992. Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy Press.
64. Neale, M. C. 2000. " Individual fit, heterogeneity, and missing data in multigroup structural equation modeling. ". In Modeling longitudinal and multilevel data: Practical issues, applied approaches and specific examples Edited by: Little, T. D., Schnabel, K. U. and Baumert, J. 249 - 267. Hillsdale, NJ: Erlbaum.
65. Neale, M. C., Boker, S. M., Xie, G. and Maes, H. H. 2006. Mx: Statistical modeling, 7th ed. Richmond, VA: VCU, Department of Psychiatry.
66. Neale, M. C. and Miller, M. B. 1997. The use of likelihood-based confidence intervals in genetic models. Behavior Genetics, 27: 113 - 120.
67. Prevost, A. T., Mason, D., Griffin, S., Kinmonth, A.-L., Sutton, S. and Spiegelhalter, D. 2007. Allowing for correlations between correlations in random-effects meta-analysis of correlation matrices. Psychological Methods, 12: 434 - 450.
68. R Development Core Team. 2013. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
69. Raudenbush, S. W. 2009. " Analyzing effect sizes: Random-effects models. ". In The handbook of research synthesis and meta-analysis, 2nd ed. Edited by: Cooper, H., Hedges, L. V. and Valentine, J. C. 295 - 315. New York, NY: Russell Sage Foundation.
70. Raudenbush, S. W., Becker, B. J. and Kalaian, H. 1988. Modeling multivariate effect sizes. Psychological Bulletin, 103: 111 - 120.
71. Raudenbush, S. W. and Bryk, A. S. 2002. Hierarchical linear models: Applications and data analysis methods, 2nd ed. Thousand Oaks, CA: Sage.
72. Riley, R. 2009. Multivariate meta-analysis: The effect of ignoring within-study correlation. Journal of the Royal Statistical Society Series A: Statistics in Society, 172: 789 - 811.
73. Riley, R. D., Abrams, K. R., Lambert, P. C., Sutton, A. J. and Thompson, J. R. 2007. An evaluation of bivariate random-effects meta-analysis for the joint synthesis of two correlated outcomes. Statistics in Medicine, 26: 78 - 97.
74. Riley, R., Abrams, K., Sutton, A., Lambert, P. and Thompson, J. 2007. Bivariate random-effects meta-analysis and the estimation of between-study correlation. BMC Medical Research Methodology, 7 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1800862/
75. Ritz, J., Demidenko, E. and Spiegelman, D. 2008. Multivariate meta-analysis for data consortia, individual patient meta-analysis, and pooling projects. Journal of Statistical Planning and Inference, 138: 1919 - 1933.
76. Shadish, W. R. 1992. " Do family and marital psychotherapies change what people do? A meta-analysis of behavioral outcomes. ". In Meta-analysis for explanation: A casebook Edited by: Cook, T. D., Cooper, H., Cordray, D. S., Hartmann, H., Hedges, L. V., Light, R. J., Louis, T. A. and Mosteller, F. 129 - 208. New York, NY: Russell Sage Foundation.
77. Shadish, W. R. 1996. Meta-analysis and the exploration of causal mediating processes: A primer of examples, methods, and issues. Psychological Methods, 1: 47 - 65.
78. Shadish, W. R. and Sweeney, R. 1991. Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes. Journal of Consulting and Clinical Psychology, 59: 883 - 893.
79. Shuster, J. J. 2010. Empirical vs natural weighting in random effects meta-analysis. Statistics in Medicine, 29: 1259 - 1265.
80. Skrondal, A. and Rabe-Hesketh, S. 2004. Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Boca Raton, FL: Chapman & Hall.
81. Spitzer, W. O. 1995. The challenge of meta-analysis. Journal of Clinical Epidemiology, 48: 1 - 4.
82. Stram, D. O. 1996. Meta-analysis of published data using a linear mixed-effects model. Biometrics, 52: 536 - 544.
83. Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A. and Song, F. 2000. Methods for meta-analysis in medical research. Chichester, UK: Wiley.
84. Sutton, A. J. and Higgins, J. P. T. 2008. Recent developments in meta-analysis. Statistics in Medicine, 27: 625 - 650.
85. Tomarken, A. J. and Waller, N. G. 2005. Structural equation modeling: Strengths, limitations, and misconceptions. Annual Review of Clinical Psychology, 1: 31 - 65.
86. van Houwelingen, H. C., Arends, L. R. and Stijnen, T. 2002. Advanced methods in meta-analysis: Multivariate approach and meta-regression. Statistics in Medicine, 21: 589 - 624.
87. Viechtbauer, W. 2005. Bias and efficiency of meta-analytic variance estimators in the random-effects model. Journal of Educational and Behavioral Statistics, 30: 261 - 293.
88. Whitehead, A. 2002. Meta-analysis of controlled clinical trials. Chichester, UK: Wiley.
89. World Values Study Group. 1994. World Values Survey, 1981-1984 and 1990-1993 [Computer file] Ann Arbor, MI: Inter-university Consortium for Political and Social Research.
90. Yung, Y.-F. 1997. Finite mixtures in confirmatory factor-analysis models. Psychometrika, 62: 297 - 330.