Introduction to meta-analysis

Introduction to Meta-Analysis

Volumn , Issue , 2009, Pages 1-421

  Borenstein, Michael ^a   Hedges, Larry V ^b   Higgins, Julian P T ^c   Rothstein, Hannah R ^d  

^a Biostat Inc ^*  (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c MEDICAL RESEARCH COUNCIL   (United Kingdom)

^d CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84889351499     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470743386     Document Type: Book

References (111)

1. Abelson, R.P. (1997). A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented). In L.L. Harlow, S.A. Mulaik & J.H. Steiger (eds), What if There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum Associates.
2. Arthur Jr., W., Bennett Jr., W. & Huffcutt, A. I. (2001). Conducting Meta-Analysis Using SAS. Mahwah, NJ: Lawrence Erlbaum Associates.
3. Bailar, J.C., 3rd. (1997). The promise and problems of meta-analysis. New England Journal of Medicine, 337, 559–561.
4. Becker, B.J. (2005). Failsafe N or file-drawer number. In H.R. Rothstein, A.J. Sutton & M. Borenstein (eds), Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester, UK: John Wiley & Sons, Ltd.
5. Begg, C.B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50, 1088–1101.
6. Berkey, C.S., Hoaglin, D.C., Mosteller, F., & Colditz, G.A. (1995). A random-effects regression model for meta-analysis. Statistics in Medicine, 14, 395–411.
7. Birge, R.T. (1941). The general physical constants. Reports on Progress in Physics, 8, 90–101.
8. Boccia, S., Hung, R., Ricciardi, G., et al. (2008). Meta-and pooled analyses of the methylenetetrahydrofolate reductase C677T and A1298C polymorphisms and gastric cancer risk: a huge-GSEC review. American Journal of Epidemiology, 167, 505–516.
9. Borenstein, M. (1994). The case for confidence intervals in controlled clinical trials. Controlled Clinical Trials, 15, 411–428.
10. Borenstein, M. (2000). The shift from significance testing to effect size estimation. In A.S. Bellack &M. Hersen (eds), Comprehensive Clinical Psychology (Volume 3, pp. 313–349) Oxford, UK: Pergamon.
11. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. R. (2009). Computing Effect Sizes for Meta-analysis. Chichester: John Wiley & Sons, Ltd.
12. Butler, T.L. (1988). The relationship of passive smoking to various health outcomes among Seventh-Day Adventists in California. University of California: Los Angeles (Dissertation).
13. Cannon, C.P., Steinberg, B.A., Murphy, S.A., Mega, J.L., & Braunwald, E. (2006). Meta-analysis of cardiovascular outcomes trials comparing intensive versus moderate statin therapy. Journal of the American College Cardiology, 48, 438–445.
14. Chalmers, I. (2006). The scandalous failure of scientists to cumulate scientifically. Abstract to paper presented at: Ninth World Congress on Health Information and Libraries; 2005 Sep 20–23; Salvador, Brazil. (Available online: http://www.icml9.org/program/activity.php?lang= pt&id=21. Accessed on February 3, 2009.
15. Chalmers, I. (2007). The lethal consequences of failing to make use of all relevant evidence about the effects of medical treatments: the need for systematic reviews. In P. Rothwell (ed.), Treating Individuals: From Randomized Trials to Personalised Medicine (pp. 37–58). London, UK: Elsevier.
16. Chan, A.W., Hróbjartsson, A., Haahr, M.T., Gøtzsche, P.C., & Altman, D.G. (2004). Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457–2465.
17. Chan, W.C., & Fung, S.C. (1982). Lung cancer in non-smokers in Hong Kong. In: E. Grundmann (ed.), Cancer Campaign. (Vol 6. Cancer Epidemiology, pp. 199–202). New York, NY: Gustav Fischer.
18. Clarke, M., & Chalmers, I. (1998). Discussion sections in reports of controlled trials published in general medical journals: islands in search of continents? Journal of the American Medical Association, 280, 280–282.
19. Clarke, M., & Clarke, T. (2000). A study of the references used in Cochrane protocols and reviews. Three bibles, three dictionaries, and nearly 25,000 other things. International Journal of Technology Assessment in Health Care, 16, 907–909.
20. Cohen, J. (1962). The statistical power of abnormal-social psychological research: a review. Journal of Abnormal and Social Psychology, 65, 145–153.
21. Cohen, J. (1969). Statistical Power Analysis for the Behavioral Sciences. New York, NY: Academic Press.
22. Cohen, J. (1987). Statistical Power Analysis for the Behavioral Sciences. Hillside, NJ: Lawrence Erlbaum Associates.
23. Colditz, G.A., Brewer, T.F., Berkey, C.S., et al. (1994). Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature. Journal of the American Medical Association, 271, 698–702.
24. Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. New York, NY: Holt, Rinehart, & Winston.
25. Devereaux, P.J., Beattie, W.S., Choi, P.T., et al. (2005). How strong is the evidence for the use of perioperative beta blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials. BMJ, 331, 313–321.
26. Dickersin, K., & Min, Y.I. (1993a). NIH clinical trials and publication bias. Online Journal of Current Clinical Trials, Doc No 50.
27. Dickersin, K., & Min, Y. I. (1993b). Publication bias: the problem that won’t go away. Annals of the New York Academy of Sciences, 703, 135–146; discussion 146–148.
28. Dickersin, K., Min, Y.I., & Meinert, C.L. (1992). Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. Journal of the American Medical Association, 267, 374–378.
29. Duval, S., & Tweedie, R. (2000a). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98.
30. Duval, S., & Tweedie, R. (2000b). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463.
31. Easterbrook, P.J., Berlin, J.A., Gopalan, R., & Matthews, D.R. (1991). Publication bias in clinical research. Lancet, 337, 867–872.
32. Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315, 629–634.
33. Egger, M., Smith, G.W., & Altman, D.G. (2001). Systematic Reviews in Health Care: Meta-analysis in Context (2nd edn). London, UK: BMJ Books.
34. Eysenck, H.J. (1978). An exercise in mega-silliness. American Psychologist, 33, 517–519.
35. Feinstein, A.R. (1995). Meta-analysis: statistical alchemy for the 21st century. Journal of Clinical Epidemiology, 48, 71–79.
36. Freiman, J.A., Chalmers, T.C., Smith, Jr., H., & Kuebler, R.R. (1978). The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 ‘negative’ trials. New England Journal of Medicine, 299, 690–694.
37. Gilbert, R., Salanti, G., Harden, M., & See, S. (2005). Infant sleeping position and the sudden infant death syndrome: systematic review of observational studies and historical review of recommendations from 1940 to 2002. International Journal of Epidemiology, 34, 874–887.
38. Goodman, S.N. (1991). Have you ever meta-analysis you didn’t like? Annals Internal Medicine, 114, 244–246.
39. Gøtzsche, P.C. (1987). Reference bias in reports of drug trials. BMJ, 295, 654–656.
40. Grissom, R.J., & Kim, J.J. (2005). Effect Sizes for Research: A Broad Practical Approach. Mahwah, NJ: Lawrence Erlbaum Associates.
41. Hackshaw, A.K., Law, M.R., & Wald, N.J. (1997). The accumulated evidence on lung cancer and environmental tobacco smoke. BMJ, 315, 980–988.
42. Halpern, S.D., & Berlin, J.A. (2005). Beyond conventional publication bias: other determinants of data suppression. In H.R. Rothstein, A.J. Sutton & M. Borenstein (eds), Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments. Chichester, UK: John Wiley & Sons, Ltd.
43. Hartung, J., Cottrell, J.E., & Giffin, J.P. (1983). Absence of evidence is not evidence of absence. Anesthesiology, 58, 298–300.
44. Hasselblad, V., & Hedges, L.V. (1995). Meta-analysis of screening and diagnostic tests. Psychological Bulletin, 117, 167–178.
45. Hedges, L. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107–128.
46. Hedges, L. (1984) Estimation of effect size under nonrandom sampling: The effects of censoring studies yielding statistically insignificant mean differences. Journal of Educational Statistics, 9, 61–85.
47. Hedges, L. (1989) Estimating the normal mean and variance under a selection model. In L. Gleser, M.D. Perlman, S.J. Press, A.R. Sampson. Contributions to Probability and Statistics: Essays in Honor of Ingram Olkin (pp. 447–458). New York, NY: Springer Verlag.
48. Hedges, L., & Olkin, I. (1980). Vote-counting methods in research synthesis. Psychological Bulletin. 88:359–369.
49. Hedges, L., & Olkin, I. (1985). Statistical Methods for Meta-analysis. San Diego, CA: Academic Press.
50. Hedges, L. and Pigott, T.D. (2001). The power of statistical tests in meta-analysis, Psychological Methods, 6, 203–17.
51. Hedges, L. & Pigott, T.D. (2004). The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426–445.
52. Hedges, L., Gurevitch, J., & Curtis, P. (1999). The meta-analysis of response ratios in experimental ecology. Ecology, 80, 1150–1156.
53. Higgins, J. P. T. & Green S. (2008). Cochrane Handbook for Systematic Reviews of Interventions. Chichester, UK: John Wiley & Sons, Ltd.
54. Higgins, J., & Thompson, S.G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539–1558.
55. Higgins, J., Thompson, S.G., Deeks, J.J., & Altman, D.G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327, 557–560.
56. Higgins, J., & Thompson, S.G. (2004). Controlling the risk of spurious findings from meta-regression. Statistics in Medicine, 23: 1663–1682.
57. Hopewell, S., Clarke, M., & Mallett, S. (2005). Grey literature and systematic reviews. In H.R. Rothstein, A. J. Sutton & M. Bornstein (Eds). Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester, UK: John Wiley & Sons, Ltd.
58. Hunter, J.E., & Schmidt, F.L. (1990). Methods of Meta-analysis: Correcting Error and Bias in Research Findings. Newbury Park, CA: Sage Publications.
59. Hunter, J.E., & Schmidt, F.L. (2004). Methods of Meta-analysis: Correcting Error and Bias in Research Findings (2nd edn). Newbury Park, CA: Sage Publications.
60. Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002). Direction and impact of language bias in meta-analyses of controlled trials: empirical study. International Journal of Epidemiology, 31, 115–123.
61. Kane, J.M., & Borenstein, M. (1985). Compliance in the long-term treatment of schizophrenia. Psychopharmacology Bulletin, 21, 23–27.
62. Knapp, G. & Hartung, J. (2003). Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine, 22, 2693–2710.
63. Lacasaña-Navarro, M., Galvan-Portillo, M., Chen, J., Lopez-Cervantes, M., & Lopez-Carrillo, L. (2006). Methylenetetrahydrofolate reductase 677C > T polymorphism and gastric cancer susceptibility in Mexico. European Journal of Cancer, 42, 528–533.
64. Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992). Cumulative meta-analysis of therapeutic trials for myocardial infarction. New England Journal of Medicine, 327, 248–254.
65. Lau, J., & Chalmers, T. C. (1995). The rational use of therapeutic drugs in the 21st century. Important lessons from cumulative meta-analyses of randomized control trials. International Journal of Technology Assessment in Health Care, 11, 509–522.
66. Lau, J., Schmid, C.H., & Chalmers, T.C. (1995). Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. Journal of Clinical Epidemiology, 48, 45–57; discussion 59–60.
67. LeLorier, J., Gregoire, G., Benhaddad, A., Lapierre, J., & Derderian, F. (1997). Discrepancies between meta-analyses and subsequent large randomized, controlled trials. New England Journal of Medicine, 337, 536–542.
68. Lewis, S., & Clarke, M. (2001). Forest plots: trying to see the wood and the trees. BMJ, 322(7300), 1479–1480.
69. Light, R.J., & Pillemer, D.B. (1984). Summing up: The Science of Reviewing Research. Cambridge, MA: Harvard University Press.
70. Light, R.J., Singer, J.D., & Willett, J.B. (1994). The visual presentation and interpretation of meta-analyses. In M. Cooper & L.V. Hedges (eds), The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation.
71. Lord, F.M., & Novick, M.R. (1968). Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.
72. Mallet, S., Hopewell, S., & Clarke, M. (2002). The use of grey literature in the first 1000 Cochrane reviews. Paper presented at the Fourth Symposium on Systematic Reviews: Pushing the Boundaries; 2002 Jul 2-4; Oxford, UK.
73. Mann, C. (1990). Meta-analysis in the breech, Science, 249, 476–480.
74. Meehl, P.E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psycholoy. Journal of Consulting and Clinical Psychology, 46, 806–834.
75. Meehl, P.E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195–244.
76. Normand, S. L. (1999). Meta-analysis: formulating, evaluating, combining, and reporting. Statistics in Medicine, 18: 321–59.
77. O’Farrell, N., & Egger, M. (2000). Circumcision in men and the prevention of HIV infection: a ‘meta-analysis’ revisited. International Journal of STD and AIDS, 11, 137–142.
78. Orwin, R.G., & Boruch, R.F. (1983). RRT meets RDD: statistical strategies for assuring response privacy in telephone surveys. Public Opinion Quarterly, 46, 560–571.
79. Phillips, W.C., Scott, J.A., & Blasczcynski, G. (1983). Statistics for diagnostic procedures. II. The significance of ‘no significance’: what a negative statistical test really means. American Journal of Roentgenology, 141, 203–206.
80. Pogue, J., & Yusuf, S. (1998). Overcoming the limitations of current meta-analysis of randomised controlled trials. Lancet, 351, 47–52.
81. Ravnskov, U. (1992). Frequency of citation and outcome of cholesterol lowering trials. BMJ, 305, 717.
82. Reed, J.F., 3rd, & Slaichert, W. (1981). Statistical proof in inconclusive ‘negative’ trials. Archives of Internal Medicine, 141, 1307–1310.
83. Reed, J.G., & Baxter, P.M. (2009). Using reference databases. In H. Cooper, L.V. Hedges & J. Valentine (eds), The Handbook of Research Synthesis (2nd edn). New York, NY: Sage Publications.
84. Reynolds, T.B. (1980). Type II error in clinical trials (editor’s reply to letter). Gastroenterology, 79, 180.
85. Rona, R.J., Keil, T., Summers, C., et al. (2007). The prevalence of food allergy: a meta-analysis. Journal of Allergy and Clinical Immunology, 120, 638–646.
86. Rosenthal, R. (1979). The File drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641.
87. Rossi, J. (1997). A case study in the failure of psychology as a cumulative science: The spontaneous recovery of verbal learning. In L.L. Harlow, S.A. Mulaik & J.H. Steiger (eds), What if There Were No Significance Tests? (pp. 175–198). Mahwah, NJ: Laurence Erlbaum Associates.
88. Rossi, J.S. (1990). Statistical power of psychological research: what have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646–656.
89. Rothstein, H.R. (2006). Use of unpublished data in systematic reviews in the Psychological Bulletin 1995–2005. Unpublished manuscript.
90. Rothstein, H.R., & Hopewell, S. (2009). The Grey literature. In H. Cooper, L. V. Hedges & J. Valentine (eds), The Handbook of Research Synthesis (2nd edn). New York, NY: Sage Publications.
91. Sanchez-Meca, J., Marin-Martinez, F., & Chacon-Moscoso, S. (2003). Effect-size indices for dichotomized outcomes in meta-analysis. Psychological Methods, 8, 448–467.
92. Schmidt, F.L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115–129.
93. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309–316.
94. Shapiro, S. (1994). Meta-analysis/shmeta-analysis. American Journal of Epidemiology, 140, 771–778.
95. Sirmans, G.S., Macdonald, L., Macpherson, D.A., & Zietz, E.N. (2006). The value of housing characteristics: a meta analysis. Journal of Real Estate Finance and Economics, 33, 215–240.
96. Sterne, J.A., & Egger, M. (2001). Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. Journal of Clinical Epidemiology, 54, 1046–1055.
97. Sterne, J.A., Egger, M., & Smith, G.D. (2001). Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. BMJ, 323, 101–105.
98. Sterne, J.A., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology, 53, 1119–1129.
99. Stewart, L.A., & Tierney, J.F. (2002). To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Evaluation and the Health Professions, 25, 76–97.
100. Sutton, A.J., Abrams, K.R., Jones, D.R., & Song, F. (2000). Methods for Meta-analysis in Medical Research. Chichester, UK: John Wiley & Sons, Ltd.
101. Tramer, M.R., Reynolds, D.J., Moore, R.A., & McQuay, H.J. (1997). Impact of covert duplicate publication on meta-analysis: a case study. BMJ, 315, 635–640.
102. van Houwelingen, H. C., Arends, L.R., Stijnen, T. (2002). Advanced methods in meta-analysis: multivariate approach and meta-regression. Statistics in Medicine, 21: 589–624.
103. Van Howe, R.S. (1999). Circumcision and HIV infection: review of the literature and meta-analysis. International Journal of STD and AIDS, 10, 8–16.
104. Wade, A., Turner, H.M., Rothstein, H.R., & Lavenberg, J. (2006). Information retrieval and the role of the information specialist in producing high quality systematic reviews in the social, behavioral, and education sciences. Evidence and Policy, 2, 89–108.
105. Wang, M.C. and Bushman, B.J. (1999). Integrating results through Meta-Analytic Review Using SAS Software. Cart, NC: SAS Institute.
106. Weisz, J.R., Weiss, B., Han, S.S., Granger, D.A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: a meta-analysis of treatment outcome studies. Psychological Bulletin, 117, 450–468.
107. Whitehead, A. (2002). Meta-analysis of Controlled Clinical Trials. Chichester, UK: John Wiley & Sons, Ltd.
108. Whitehead, J. (1997). The Design and Analysis of Sequential Clinical Trials (rev. 2nd edn). NY: Chichester, UK: John Wiley & Sons, Inc.
109. Williams, J., Brayne, C., & Higgins, J.P.T. (2006). Systematic review of prevalence studies of autism spectrum disorders. Archives of Disease in Childhood, 91, 8–15.
110. Wilson, S.J., Lipsey, M.W., & Derzon, J. H. (2003a). The effects of school-based intervention programs on aggressive behavior: A meta-analysis. Journal of Consulting and Clinical Psychology, 71, 136–149.
111. Wilson, S. J., Lipsey, M. W., & Soydan, H. (2003b). Are mainstream programs for juvenile delinquency less effective with minority youth than majority youth? A meta-analysis of outcomes research. Research on Social Work Practice, 13, 3–26.