Understanding research synthesis (meta-analysis)

Annual Review of Public Health

Volumn 17, Issue , 1996, Pages 1-23

  Mosteller, Frederick ^a   Colditz, Graham A ^a  

^a HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

heterogeneity; meta analysis; overview; research synthesis; review; study design

Indexed keywords

DATA ANALYSIS; DECISION MAKING; MEDICAL RESEARCH; META ANALYSIS; PRIORITY JOURNAL; PUBLIC HEALTH; REVIEW;

EID: 0029979270     PISSN: 01637525     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.pu.17.050196.000245     Document Type: Review

References (92)

1. Beecher HK. 1955. The powerful placebo. JAMA 159:1602-6
2. Begg CB, Berlin JA. 1988. Publication bias: a problem in interpreting medical data. J. R. Stat. Soc. A 151:419-63
3. Berkey C, Anderson J, Hoaglin D. 1995. Multiple-outcome meta-analysis of clinical trials. Stat. Med. In press
4. Berkey C, Antczak-Bouckoms A, Hoaglin D, Mosteller F, Pihlstrom B. 1995. Multiple-outcomes meta-analysis of treatments for periodontal disease. J. Dent. Res. 74:1030-39
5. Berkey C, Hoaglin D, Mosteller F, Colditz G. 1995. A random-effects regression model for meta-analysis. Stat. Med. 14:395-411
6. Berlin JA, Colditz GA. 1990. A meta-analysis of physical activity in the prevention of coronary heart disease. Am. J. Epidemiol. 132:612-28
7. Berlin JA. 1995. The benefits of heterogeneity in meta-analysis of data from epidemiologic studies. Invited commentary. Am. J. Epidemiol. 142:383-87
8. Berlin JA, Antman E. 1994. Advantages and limitations of metaanalytic regressions of clinical trials data. Online J. Curr. Clin. Trials, Vol. 3
9. Berlin JA, Longnecker MP, Greenland S. 1993. Meta-analysis of epidemiologic dose-response data. Epidemiology 4:218-28
10. Campbell DT, Stanley JC. 1966. Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally
11. Can. Task Force Period. Health Exam. 1979. The periodic health examination. Can. Med. Assoc. J. 121:1194-254
12. Chalmers I, Enkin M, Keirse MJNC. 1989. Effective Care in Pregnancy and Childbirth. Oxford: Oxford Univ. Press
13. Chalmers TC, Berner J, Sacks HS, Levin H, Reitman D, Nagalingham R. 1987. Meta-analysis of clinical trials as a scientific discipline. II. Replicate variability and comparison of studies that agree and disagree. Stat. Med. 6:733-44
14. Chalmers TC, Lau J, Cappelleri JC, Schmid CH. 1994. Comparing results from the largest studies with meta-analyses of smaller studies. Abstr. 44A. Meet. Cochrane Collab. Hamilton, Ontario. Control. Clin. Trials 15(3S):63S
15. Chalmers TC, Smith H Jr., Blackburn B, Silverman B, Schroeder B, et al. 1981. A method for assessing the quality of a randomized control trial. Control. Clin. Trials 2:31-49
16. Charlton BG. 1994. Practice guidelines and practical judgement: the role of mega-trials, meta-analysis and consensus. Br. J. Gen. Pract. 44:290-91
17. Cochran WG. 1937. Problems arising in the analysis of a series of similar experiments. J. R. Stat. Soc. Suppl. 4: 102-18
18. Cochran WG. 1954. The combination of estimates from different experiments. Biometrics 10:101-29
19. Colditz GA, Berkey CS, Mosteller F, Brewer TF, Wilson ME, et al. 1995. The efficacy of Bacillus Calmette-Guerin in vaccination of newborn and infants in the prevention of tuberculosis: meta-analysis of the published literature. Pediatrics 96:29-35
20. Colditz GA, Brewer TF, Berkey CS, Wilson ME, Burdick E, et al. 1994. The efficacy of bacillus calmette-guerin vaccination in the prevention of tuberculosis: meta-analysis of the published literature. JAMA 271:698-702
21. Colditz GA, Burdick E, Mosteller F. 1995. Commentary on heterogeneity in meta-analysis of data from epidemiologic studies. Am. J. Epidemiol. 142: 371-82
22. Colditz GA, Egan KM, Stampfer MJ. 1993. Hormone replacement therapy and risk of breast cancer: Results from epidemiologic studies. Am. J. Obstet. Gyn. 168:1473-80
23. Colditz GA, Miller JN, Mosteller F. 1988. Measuring gain in the evaluation of medical technology: The probability of a better outcome. Int. J. Technol. Assess. Health Care 4:637-42
24. Colditz GA, Miller JN, Mosteller F. 1989. How study design affects outcomes in comparisons of therapy. 1. Medical. Stat. Med. 8:441-54
25. Cook DJ, Sackett DL, Spitzer WO. 1995. Methodologic guidelines for systematic reviews of randomized control trials in health care from the Potsdam consultation on meta-analysis. J. Clin. Epidemiol. 48:161-71
26. Cook TD, Campbell DT. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Boston: Houghton Mifflin
27. Cook TD, Cooper H, Cordray DS, Hartmann H, Hedges LV, et al. 1992. Meta-Analysis for Explanation: A Casebook. New York: Russell Sage Found.
28. Cooper H, Hedges LV, eds. 1994. The Handbook of Research Synthesis. New York: Russell Sage Found.
29. Dear KBG. 1994. Iterative generalized least squares for meta-analysis of survival data at multiple times. Biometrics 50:989-1002
30. DerSimonian R, Charette LJ, McPeek B, Mosteller F. 1982. Reporting on methods in clinical trials. N. Engl. J. Med. 306:1332-37
31. DerSimonian R, Laird N. 1986. Meta-analysis in clinical trials. Control. Clin. Trials 7:177-88
32. Detsky AS, Naylor CD, O'Rourke K, McGreer A, L'Abbe KA. 1992. Incorporating variations in the quality of individual randomized trials into meta-analysis. J. Clin. Epidemiol. 45: 255-65
33. DuMouchel W. 1990. Bayesian meta-analysis. In Statistical Methodology in Pharmaceutical Sciences, ed. D Berry, pp. 509-29. New York: Marcel Dekker
34. Egger M, Smith GD. 1995. Misleading meta-analysis. Lessons from "an effective, safe, simple" intervention that wasn't. Br. Med. J. 310:752-54
35. Emerson JD, Burdick E, Hoaglin DC, Mosteller F, Chalmers TC. 1990. An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials. Control. Clin. Trials 11:339-52
36. Emerson JH, Hoaglin DC, Mosteller F. 1993. A modified random-effects procedure for combining risk difference in sets of 2 x 2 tables from clinical trials. J. Ital. Stat. Soc. 2:269-290
37. 36a. Emerson JH, Hoaglin DC, Mosteller F. 1996. Simple robust procedures for combining risk differences in sets of 2 x 2 tables. Stat. Med. In press
38. Enkin MW, Keirse MHNC, Renfrew MJ, Neilson JP, eds. 1993. Pregnancy and Childbirth Module: Cochrane Database of Systematic Reviews (Cochrane updates on disk). Oxford: Update Software: Disk issue 2.
39. Fahey MT, Irwig L, Macaskill P. 1995. Meta-analysis of pap test accuracy. Am. J. Epidemiol. 141:680-89
40. Fisher RA. 1932. Statistical Methods for Research Workers, p. 39. Edinburgh: Oliver & Body.
41. Flournoy N, Olkin I. 1995. Do small trials square with large ones? Lancet 345:741-42
42. Garder P, Leden L, Thedeen T. 1994. Safety implications of bicycle paths at signalized intersections. Accid. Anal. Prev. 26:429-39
43. Gilbert JP, McPeek B, Mosteller F. 1977. Progress in surgery and anesthesia: benefits and risks of innovative therapy. In Costs Risk and Benefits of Surgery, ed. JP Bunker, BA Barnes, F Mosteller, pp. 130-38; App. 9-II, pp. 156-58 (classical ANOVA); App. 9-III, pp. 158-61 (Bayesian inference); data analysis App. 9-IV, pp. 161-63). Oxford: Oxford Univ. Press
44. Gleser L, Olkin I. 1994. Stochastically dependent effect sizes. In The Handbook of Research Synthesis, ed. H Cooper, L Hedges, pp. 339-55. New York: Russell Sage Found.
45. Greenland S. 1994. Invited commentary: A critical look at some popular meta-analytic methods. Am. J. Epidemiol. 140:290-96
46. Hankinson SE, Colditz GA, Hunter DJ, Spencer TL, Rosner B, Stampfer MJ. 1992. A quantitative assessment of oral contraceptive use and risk of ovarian cancer. Obstet. Gynecol. 80:708-14
47. Hedges LV, Olkin I. 1985. Statistical Methods for Meta-Analysis. Orlando, Fl: Academic
48. Hertz-Piccotto I, Neutra RR. 1994. Resolving discrepancies among studies: the influence of dose on effect size. Epidemiology 5:156-63
49. Howe GR, Hirohata T, Hislop TG, Iscovich JM, Yuan JM, et al. 1990. Dietary factors and risk of breast cancer: combined analysis of 12 case-control studies. J. Natl. Cancer Inst.. 82:561-69
50. Hunter JE, Schmidt FL. 1990. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Newbury Park, CA: Sage
51. Iyengar S, Greenhouse JB. 1988. Selection models and the file drawer problem. Stat. Sci. 3:109-35
52. Inst. Med. 1991. Committee to review the adverse effects of Pertussis and Rubella vaccines. Adverse Effects of Pertussis and Rubella Vaccines. Washington, DC: Natl. Acad. Press
53. Inst. Med. 1994. Committee to review the health effects in Vietnam veterans of exposure to herbicides. Veterans and Agent Orange: Health Effects of Herbicides used in Vietnam. Washington, DC: Natl. Acad. Press
54. Irwig L, Gatsonis C, Lau J, Colditz G, Chalmers T, Mosteller F. 1994. Guidelines for meta-analyses evaluating diagnostic tests. Ann. Intern. Med. 120; 667-76
55. ISIS-4 Collaborative Group. 1995. ISIS-4: a randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58050 patients with suspected cute myocardial infarction. Lancet 345:669-85
56. Johnston JJ, Hendricks SA, Fike JM. 1994. Effectiveness of behavioral safety belt interventions. Accid. Anal. Prev. 26:315-23
57. Kardaun JWPF, Kardaun OJWF. 1990. Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Methods Info. Med. 29:12-22
58. Laird NM, Mosteller F. 1990. Some statistical methods for combining experimental results. Int. J. Technol. Assess. Health Care 6:5-30
59. Law MR, Wald NJ, Thompson SG. 1994. By how much and how quickly does reduction in serum cholesterol concentration lower risk of ischemic heart disease? Br. Med. J. 308:367-73
60. Letzel H. 1995. "Best evidence synthesis: An intelligent alternative to meta-analysis": Discussion. A case of "Either-Or" or "As well". J. Clin. Epidemiol. 48:19-21
61. Light RJ, Pillemer DB. 1984. Summing Up: The Science of Reviewing Research. Cambridge, MA: Harvard Univ. Press
62. Lipsey MW, Wilson DB. 1993. The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. Am. Psychol. 48: 1181-209
63. Longnecker MP, Berlin JA, Orza MJ, Chalmers TC. 1988. A meta-analysis of alcohol consumption in relation to risk of breast cancer. JAMA 260:652-65
64. Louis TA, Fineberg HV, Mosteller F. 1985. Findings for public health from meta-analysis. Annu. Rev. Public Health 6:1-20
65. MacMahon B, Hutchison GB. 1964. Prenatal X-ray and children's cancer: A review. Acta Unio Internationalis Contra Cancrum 20:1172-74
66. Miller JN, Colditz GA, Mosteller F. 1989. How study design affects outcomes in comparisons of therapy. II. Surgical. Stat. Med 8:455-66
67. Morris CN, Normand SL. 1992. Hierarchical models for combining information and for meta-analysis. In Bayesian Statistics, 4:321-44. Oxford: Oxford Univ. Press
68. Moses LE, Shapiro D, Littenberg B. 1993. Combining independent studies of a diagnostic test into a summary (ROC) curve: data-analytic approaches and some additional considerations. Stat. Med. 12:1293-316
69. Natl. Res. Counc. 1992. On combining information: statistical issues and opportunities for research. Washington, DC: Natl. Acad. Sci. Press
70. Olkin I. 1995. Statistical and theoretical considerations in meta-analysis. J. Clin. Epidemiol. 48:133-46
71. Orwin R. 1983. A fail-safe N for effect size in meta-analysis. J. Educ. Stat. 8: 157-59
72. Petitti DB. 1994. Of babies and bathwater. Am. J. Epidemiol. 140:779-82
73. Petitti DB. 1994. Meta-Analysis, Decision Analysis and Cost-Effectiveness Analysis in Medicine: Methods for Quantitative Synthesis in Medicine. Oxford: Oxford Univ. Press
74. Raudenbush S, Becker B, Kalaian H. 1988. Modeling multivariate effect sizes. Psychol. Bull. 103:111-20
75. Rep. US Prev. Serv. Task Force. 1989. Guide to clinical preventive services. Baltimore: Williams & Wilkins
76. Rosenthal R. 1979. The "file drawer problem" and tolerance for null results. Psychol. Bull. 86:638-41
77. Rutter CM, Gatsonis CA. 1995. Regression methods for meta-analysis of diagnostic test data. Acad. Radiol. 2: S48-S56
78. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. 1987. Meta-analysis of randomized controlled studies. N. Engl. J. Med. 316:450-55
79. Shapiro DE. 1995. Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test. Acad. Radiol. 2:S37-S47
80. Shapiro S. 1994. Meta-analysis/Shmeta-analysis. Am. J. Epidemiol. 140:771-78
81. Shinton R, Beevers G. 1989. Meta-analysis of relation between cigarette smoking and stroke. Br. Med. J. 298: 789-94
82. Simes RJ. 1986. Publication bias: the case for an international registry of clinical trials. J. Clin. Oncol. 4:1529-41
83. Slavin RE. 1995. Best evidence synthesis: An intelligent alternative to meta-analysis. J. Clin. Epidemiol. 48: 9-18
84. Spitzer WO, ed. 1995. The Potsdam International Consultation on meta-analysis. J. Clin. Epidemiol. 48:1-171
85. Stampfer MJ, Colditz GA. 1991. Estrogen replacement therapy and coronary heart disease: a quantitative assessment of the epidemiologic evidence. Prev. Med. 20:47-63
86. Teo KK, Yusuf S, Collins R, Held PH, Peto R. 1991. Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomized trials. Br. Med. J. 303: 1499-503
87. US Congr. Off. Technol. Assess. 1995. Tools for evaluating health technologies: Five background papers. BP-H-142. Washington, DC: US GPO
88. Villar V, Carroli G, Belizn JM. 1995. Predictive ability of meta-analyses of randomized controlled trials. Lancet 345: 772-76
89. Wortman PM. 1994. Judging research quality. In The Handbook of Research Synthesis, ed. H Cooper, L Hedges, pp. 97-109. New York: Russell Sage Found.
90. Wortman PM. 1983. Evaluation research: A methodological perspective. Annu. Rev. Psychol. 34:223-60
91. Yusuf S, Collins R, MacMahon S, Peto R. 1988. Effect of intravenous nitrates on mortality in acute myocardial infarction: overview of the randomised trials. Lancet 1:1088-92
92. Yusuf S, Flather M. 1995. Magnesium in acute myocardial infarction. Br. Med. J. 310:751-52