The Use of Meta-analysis in Pharmacoepidemiology

Pharmacoepidemiology, Fourth Edition

Volumn , Issue , 2007, Pages 681-707

  Berlin, Jesse A ^a,b   Kim, Carin J ^b  

^a JOHNSON AND JOHNSON PHARMACEUTICAL RESEARCH AND DEVELOPMENT   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Bayesian statistical methods; Cumulative meta analysis; Mantel Haenszel procedure; Meta analysis application case study; Meta analysis "garbage in=garbage out" phenomenon; Pharmacoepidemiology meta analysis; Publication bias; Study characteristics and study design; Study design heterogeneity

Indexed keywords

EID: 80054731445     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470059876.ch44     Document Type: Chapter

References (229)

1. DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clin Trials 1986; 7: 177-88.
2. Last JM. A Dictionary of Epidemiology, 2nd edn. New York: Oxford University Press, 1988.
3. Berlin JA, Longnecker MP, Greenland S. Meta-analysis of epidemiologic dose-response data. Epidemiology 1993; 4: 218-28.
4. Feinstein AR. Para-analysis, faute de mieux, and the perils of riding on a data barge. J Clin Epidemiol 1989; 42: 929-35.
5. Shapiro S. Is meta-analysis a valid approach to the evaluation of small effects in observational studies? J Clin Epidemiol 1997; 50: 223-9.
6. Egger M, Schneider M, Davey Smith G. Spurious precision? Meta-analysis of observational studies. BMJ 1998; 316: 140-4.
7. Thacker SB. Meta-analysis. A quantitative approach to research integration. JAMA 1988; 259: 1685-9.
8. Buffler PA. The evaluation of negative epidemiologic studies: the importance of all available evidence in risk characterization. Regul Toxicol Pharmacol 1989; 9: 34-43.
9. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med 1987; 316: 450-5.
10. L'Abbe KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Ann Intern Med 1987; 107: 224-33.
11. Colditz GA, Burdick E, Mosteller F. Heterogeneity in metaanalysis of data from epidemiologic studies: a commentary. Am J Epidemiol 1995; 142: 371-82.
12. Berlin JA. Invited commentary: benefits of heterogeneity in meta-analysis of data from epidemiologic studies. Am J Epidemiol 1995; 142: 383-7.
13. Bero LA, Rennie D. The Cochrane Collaboration-preparing, maintaining, and disseminating systematic reviews of the effects of health care. JAMA 1995; 274: 1935-38.
14. Davies P, Boruch R. The Campbell Collaboration does for public policy what Cochrane does for health. BMJ 2001; 323: 294-5.
15. Dickersin K, Berlin JA. Meta-analysis: state-of-the-science. Epidemiol Rev 1992; 14: 154-76.
16. Mulrow CD. The medical review article: state of the science. Ann Intern Med 1987; 106: 485-8.
17. Oxman AD, Guyatt GH. Guidelines for reading literature reviews. Can Med Assoc J 1988; 138: 697-703.
18. Chalmers I. Improving the quality and dissemination of clinical research. In: Lock S, ed., The Future of Medical Journals: In Commemoration of 150 Years of the British Medical Journal. London: British Medical Society, 1991; pp. 127-46.
19. Kass EH. Reviewing reviews. In: Warren KS, ed., Coping with the Biomedical Literature: A Primer for the Scientist and the Clinician. New York: Praeger, 1981; pp. 71-91.
20. Huth EJ. Needed: review articles with more scientific rigor. Ann Intern Med 1987; 106: 470-1.
21. Canner PL. An overview of six clinical trials of aspirin in coronary heart disease. Stat Med 1987; 6: 255-67.
22. Longnecker MP, Berlin JA, Orza MJ, Chalmers TC. A metaanalysis of alcohol consumption in relation to risk of breast cancer. JAMA 1988; 260: 652-6.
23. Romieu I, Berlin JA, Colditz G. Oral contraceptives and breast cancer. Review and meta-analysis. Cancer 1990; 66: 2253-63.
24. Frumkin H, Berlin J. Asbestos exposure and gastrointestinal malignancy: review and meta-analysis. Am J Ind Med 1988; 14: 79-95 (published erratum appears in Am J Ind Med 1988; 14: 493).
25. Berlin JA, Colditz GA. A meta-analysis of physical activity in the prevention of coronary heart disease. Am J Epidemiol 1990; 132: 612-28.
26. Gray A, Berlin JA, McKinlay JB, Longcope C. An examination of research design effects on the association of testosterone and male aging: results of a meta-analysis. J Clin Epidemiol 1991; 44: 671-84.
27. Longnecker MP, Orza MJ, Adams ME, Vioque J, Chalmers TC. A meta-analysis of alcoholic beverage consumption in relation to risk of colorectal cancer. Cancer Causes Control 1990; 1: 59-68.
28. Wong O, Raabe GK. Critical review of cancer epidemiology in petroleum industry employees, with a quantitative metaanalysis by cancer site. Am J Ind Med 1989; 15: 283-310.
29. Booth-Kewley S, Friedman HS. Psychological predictors of heart disease: a quantitative review. Psychol Bull 1987; 101: 343-62.
30. Morgenstern H, Glazer WM, Niedzwiecki D, Nourjah P. The impact of neuroleptic medication on tardive dyskinesia: a meta-analysis of published studies. Am J Pub Health 1987; 77: 717-24.
31. Hennessy S, Berlin J, Kinman JL, Margolis DJ, Marcus SM, Strom BL. Risk of venous thromboembolism from oral contraceptives containing gestodene and desogestrel versus levonorgestrel: a meta-analysis and formal sensitivity analysis. Contraception 2001; 64: 125-33.
32. Berlin JA, Colditz GA. The role of meta-analysis in the regulatory process for foods, drugs, and devices. JAMA 1999; 281: 830-4.
33. Greenland S, Longnecker MP. Methods for trend estimation from summarized dose-response data, with applications to meta-analysis. Am J Epidemiol 1992; 135: 1301-9.
34. Greenland S, Salvan A. Bias in the one-step method for pooling study results. Stat Med 1990; 9: 247-52.
35. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiol Rev 1987; 9: 1-30.
36. Fleiss JL, Gross AJ. Meta-analysis in epidemiology, with special reference to studies of the association between exposure to environmental tobacco smoke and lung cancer: a critique. J Clin Epidemiol 1991; 44: 127-39.
37. O'Neill RT, Anello C. Does research synthesis have a place in drug regulatory policy? Synopsis of issues: assessment of efficacy and drug approval. Clin Res Reg Aff 1996; 13: 23-9.
38. Poole C, Greenland S. Random-effects meta-analyses are not always conservative. Am J Epidemiol 1999; 150: 469-75.
39. Jones DR. Meta-analysis of observational epidemiological studies: a review. J R Soc Med 1992; 85: 165-8.
40. Einarson TR, Leeder JS, Koren G. A method for meta-analysis of epidemiological studies. Drug Intell Clin Pharm 1988; 22: 813-24.
41. Greenland S. Invited commentary: a critical look at some popular meta-analytic methods. Am J Epidemiol 1994; 140: 290-6.
42. Stroup D, Berlin J, Morton S, Olkin I, Williamson G, Rennie D et al. Meta-analysis of observational studies in epidemiology-a proposal for reporting. JAMA 2000; 283: 2008-12.
43. Chalmers TC, Berrier J, Hewitt P, Berlin J, Reitman D, Nagalingam R et al. Meta-analysis of randomized controlled trials as a method of estimating rare complications of nonsteroidal anti-inflammatory drug therapy. Aliment Pharmacol Ther 1988; 2 (suppl 25): 9-26.
44. MacLean CH, Morton SC, Ofman JJ, Roth EA, Shekelle PG. How useful are unpublished data from the Food and Drug Administration in meta-analysis? J Clin Epidemiol 2003; 56: 44-51.
45. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA 1992; 268: 240-8.
46. Begg CB, Berlin JA. Publication bias and dissemination of clinical research. J Natl Cancer Inst 1989; 81: 107-15.
47. Andrews TC, Reimold SC, Berlin JA, Antman EM. Prevention of supraventricular arrhythmias after coronary artery bypass surgery. A meta-analysis of randomized control trials. Circulation 1991; 84 (suppl 5): 236-44.
48. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991; 337: 867-72.
49. Moher D, Berlin J. Improving the reporting of randomised controlled trials. In: Maynard A, Chalmers I, eds, Non-Random Reflections on Health Services Research. London: BMJ Publishing Group, 1997; pp. 250-71.
50. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA 1992; 267: 374-8.
51. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA 1990; 263: 1385-9.
52. Dickersin K, Min YI. NIH clinical trials and publication bias. Online J Curr Clin Trials 1993; doc. no. 50.
53. Chalmers I. Underreporting research is scientific misconduct. JAMA 1990; 263: 1405-8.
54. Chalmers TC, Frank CS, Reitman D. Minimizing the three stages of publication bias. JAMA 1990; 263: 1392-5.
55. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ 1997; 315: 640-5.
56. Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998; 279: 281-6.
57. Berlin JA, Begg CB, Louis TA. An assessment of publication bias using a sample of published clinical trials. J Am Stat Assoc 1989; 84: 381-92.
58. Sutton AJ, Abrams KR, Jones DR. Generalized synthesis of evidence and the threat of dissemination bias: the example of electronic fetal heart rate monitoring (EFM). J Clin Epidemiol 2002; 55: 1013-24.
59. Chalmers TC, Berrier J, Sacks HS, Levin H, Reitman D, Nagalingam R. Meta-analysis of clinical trials as a scientific discipline. II: Replicate variability and comparison of studies that agree and disagree. Stat Med 1987; 6: 733-44.
60. Early Breast Cancer Trialists' Collaborative Group. Treatment of Early Breast Cancer, vol. I: Worldwide Evidence. New York: Oxford University Press, 1990.
61. Sutton AJ, Duval S, Tweedie R, Abrams KR, Jones DR. Empirical assessment of effect of publication bias on meta-analyses. BMJ 2000; 320: 1574-7.
62. Hetherington J, Dickersin K, Chalmers I, Meinert CL. Retrospective and prospective identification of unpublished controlled trials: lessons from a survey of obstetricians and pediatricians. Pediatrics 1989; 84: 374-80.
63. Gotzsche PC. Reference bias in reports of drug trials. BMJ (Clin Res Ed) 1987; 295: 654-6.
64. Egger M, Zellweger-Zahner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet 1997; 350: 326-9.
65. Moher D, Fortin P, Jadad AR, Juni P, Klassen T, Le Lorier J et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet 1996; 347: 363-6.
66. Davidson RA. Source of funding and outcome of clinical trials. J Gen Intern Med 1986; 1: 155-8.
67. Hemminki E. Study of information submitted by drug companies to licensing authorities. BMJ 1980; 280: 833-6.
68. Cho MK, Bero LA. The quality of drug studies published in symposium proceedings. Ann Intern Med 1996; 124: 485-9.
69. Chalmers TC. Problems induced by meta-analyses. Stat Med 1991; 10: 971-9.
70. Conn HO, Blitzer BL. Nonassociation of adrenocorticosteroid therapy and peptic ulcer. N Engl J Med 1976; 294: 473-9.
71. Messer J, Reitman D, Sacks HS, Smith H, Jr, Chalmers TC. Association of adrenocorticosteroid therapy and peptic-ulcer disease. N Engl J Med 1983; 309: 21-4.
72. Conn HO, Poynard T. Adrenocorticosteroid administration and peptic ulcer: a critical analysis. J Chronic Dis 1985; 38: 457-68.
73. Chalmers TC. Meta-analysis in clinical medicine. Trans Am Clin Climatol Assoc 1987; 99: 144-50.
74. DerSimonian R. Parenteral nutrition with branched-chain amino acids in hepatic encephalopathy: meta analysis. Hepatology 1990; 11: 1083-4.
75. Erikkson LS, Conn HO. Branched-chain amino acids in hepatic encephalopathy. Gastroenterology 1990; 99: 604-7 (published erratum appears in Gastroenterology 1990; 99: 1547).
76. Naylor CD, O'Rourke K, Detsky AS, Baker JP. Parenteral nutrition with branched-chain amino acids in hepatic encephalopathy. A meta-analysis. Gastroenterology 1989; 97: 1033-42.
77. Dickersin K, Hewitt P, Mutch L, Chalmers I, Chalmers TC. Perusing the literature: comparison of MEDLINE searching with a perinatal trials database. Control Clin Trials 1985; 6: 306-17.
78. Poynard T, Conn HO. The retrieval of randomized clinical trials in liver disease from the medical literature. A comparison of MEDLARS and manual methods. Control Clin Trials 1985; 6: 271-9.
79. Bernstein F. The retrieval of randomized clinical trials in liver diseases from the medical literature: manual versus MEDLARS searches. Control Clin Trials 1988; 9: 23-31.
80. Chalmers I. Oxford Database of Perinatal Trials. Oxford: Oxford University Press, 1988.
81. Huston P, Moher D. Redundancy, disaggregation, and the integrity of medical research. Lancet 1996; 347: 1024-6.
82. Detsky AS, Naylor CD, O'Rourke K, McGeer AJ, L'Abbe KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol 1992; 45: 255-65.
83. Berard A, Bravo G. Combining studies using effect sizes and quality scores: application to bone loss in postmenopausal women. J Clin Epidemiol 1998; 51: 801-7.
84. Chalmers TC, Smith H, Jr, Blackburn B, Silverman B, Schroeder B, Reitman D et al. A method for assessing the quality of a randomized control trial. Control Clin Trials 1981; 2: 31-49.
85. Imperiale TF, McCullough AJ. Do corticosteroids reduce mortality from alcoholic hepatitis? A meta-analysis of the randomized trials. Ann Intern Med 1990; 113: 299-307.
86. Prendiville W, Elbourne D, Chalmers I. The effects of routine oxytocic administration in the management of the third stage of labour: an overview of the evidence from controlled trials. Br J Obstet Gynaecol 1988; 95: 3-16.
87. Mahon WA, Daniel EE. A method for the assessment of reports of drug trials. Can Med Assoc J 1964; 90: 565-9.
88. Verhagen AP, de Vet HCW, de Bie RA, Kessels AGH, Boers M, Bouter LM et al. The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol 1998; 51: 1235-41.
89. Moher D, Jadad AR, Tugwell P. Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care 1996; 12: 195-208.
90. Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials 1995; 16: 62-73.
91. Greenland S. Quality scores are useless and potentially misleading. Am J Epidemiol 1994; 140: 300-1.
92. Jüni P, Witschi A, Block R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 1999; 282: 1054-60.
93. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408-12.
94. Greenland S, O'Rourke K. On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics 2001; 2: 463-71.
95. Berlin JA, Miles CG, Cirigliano MD, Conill AM, Goldmann DR, Horowitz DA et al. Does blinding of readers affect the results of metaanalyses? Results of a randomized trial. Online J Curr Clin Trials 1997; doc. no. 205.
96. Kleinbaum DG, Kupper LL, Morgenstern H. Epidemiologic Research: Principles and Quantitative Methods. New York: Van Nostrand Reinhold, 1982.
97. Rothman KJ, Greenland S. Modern Epidemiology, 2nd edn. Philadelphia, PA: Lippincott, Williams and Wilkins, 1998.
98. Yusuf S, Peto R, Lewis J, Collins R, Sleight P. Beta blockade during and after myocardial infarction: an overview of the randomized trials. Prog Cardiovasc Dis 1985; 27: 335-71.
99. Tang J-L. Weighting bias in meta-analysis of binary outcomes. J Clin Epidemiol 2000; 53: 1130-6.
100. Chang B-H, Waternaux C, Lipsitz S. Meta-analysis of binary data: which within study variance estimate to use? Stat Med 2001; 20: 1947-56.
101. Deeks J, Bradburn M, Localio R, Berlin J. Much ado about nothing: statistical models for meta-analysis with rare events. 6th International Cochrane Colloquium, Baltimore, MD, 1998.
102. Berlin JA, Laird NM, Sacks HS, Chalmers TC. A comparison of statistical methods for combining event rates from clinical trials. Stat Med 1989; 8: 141-51.
103. Fleiss JL. The statistical basis of meta-analysis. Stat Methods Med Res 1993; 2: 121-45.
104. Follmann DA, Proschan MA. Valid inference in random effects meta-analysis. Biometrics 1999; 55: 732-7.
105. Aitkin M. Meta-analysis by random effect modelling in generalized linear models. Stat Med 1999; 18: 2343-51.
106. Frost C, Clarke R, Beacon H. Use of hierarchical models for meta-analysis: experience in the metabolic ward studies of diet and blood cholesterol. Stat Med 1999; 18: 1657-76.
107. Senn SJ. The many modes of META. Drug Inf J 2000; 34: 535-49.
108. Sidek K, Jonkman J. A simple confidence interval for metaanalysis. Stat Med 2002; 21: 3153-9.
109. Hedges LV, Vevea JL. Fixed-and random-effects models in meta-analysis. Psychol Meth 1998; 3: 486-504.
110. Villar J, Mackey ME, Carroli G, Donner A. Meta-analyses in systematic reviews of randomized controlled trials in perinatal medicine; comparison of fixed and random effects models. Stat Med 2001; 20: 3635-47.
111. Carlin JB. Meta-analysis for 2 × 2 tables: a Bayesian approach. Stat Med 1992; 11: 141-58.
112. Whitehead A, Whitehead J. A general parametric approach to the meta-analysis of randomized clinical trials. Stat Med 1991; 10: 1665-77.
113. Thompson SG, Smith TC, Sharp SJ. Investigating underlying risk as a source of heterogeneity in meta-analysis. Stat Med 1997; 16: 2741-58.
114. McIntosh MW. The population risk as an explanatory variable in research synthesis of clinical trials. Stat Med 1996; 15: 1713-28.
115. Larose DT, Dey DK. Grouped random effects models for Bayesian meta-analysis. Stat Med 1997; 16: 1817-29.
116. Smith TC, Spiegelhalter DJ, Thomas A. Bayesian approaches to random-effects meta-analysis: a comparative study. Stat Med 1995; 14: 2685-99.
117. Normand S-LT. Tutorial in biostatistics. Meta-analysis: formulating, evaluating, combining, and reporting. Stat Med 1999; 18: 321-59.
118. Eddy DM, Hasselblad V, Shachter R. Meta-Analysis by the Confidence Profile Method: The Statistical Synthesis of Evidence. Boston, MA: Academic Press, 1990.
119. Eddy DM, Hasselblad V, Shachter R. An introduction to a Bayesian method for meta-analysis: the confidence profile method. Med Decis Making 1990; 10: 15-23.
120. Goodman SN. Meta-analysis and evidence. Control Clin Trials 1989; 10: 188-204 (published erratum appears in Control Clin Trials 1989; 10: 435).
121. Curtin F, Altman DG, Elbourne D. Meta-analysis combining parallel and cross-over clinical trials. I: Continuous outcomes. Stat Med 2002; 21: 2131-44.
122. Curtin F, Elbourne D, Altman DG. Meta-analysis combining parallel and cross-over clinical trials, II: Binary outcomes. Stat Med 2002; 21: 2145-59.
123. Curtin F, Elbourne D, Altman DG. Meta-analysis combining parallel and cross-over clinical trials. III: The issue of carry-over. Stat Med 2002; 21: 2161-73.
124. Elbourne D, Altman DG, Higgins J, Curtin F, Worthington H, Vail A. Meta-analysis involving cross-over trials: methodological issues. Int J Epidemiol 2002; 31: 140-9.
125. Donner A, Klar N. Issues in the meta-analysis of cluster randomized trials. Stat Med 2002; 21: 2971-80.
126. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat Med 2000; 19: 3127-31.
127. Zucker D, Schmid CH, McIntosh MW, D'Agostino RB, Selker HP, Lau J. Combining single patient (N-of-1) trials to estimate population treatment effects and to evaluate individual patient responses to treatment. J Clin Epidemiol 1997; 50: 401-10.
128. Nam I-S, Mengersen KL, Garthwaite P. Multivariate metaanalysis. Stat Med 2003; 22: 2309-33.
129. Cook R, Brumback BA, Wigg M, Ryan L. Synthesis of evidence from epidemiological studies with interval-censored exposure due to grouping. Biometrics 2001; 57: 671-80.
130. Shi J, Copas J. Meta-analysis for trend estimation. Stat Med 2004; 23: 3-19.
131. Brumback BA, Holmes LB, Ryan LM. Adverse effects of chorionic villus sampling: a meta-analysis. Stat Med 1999; 18: 2163-75.
132. Martin DO, Austin H. An exact method for meta-analysis of case-control and follow-up studies. Epidemiology 2000; 11: 255-60.
133. Fleiss JL. Analysis of data from multiclinic trials. Control Clin Trials 1986; 7: 267-75.
134. Takkouche B, Cadarso-Suarez C, Spiegelman D. Evaluation of old and new tests of heterogeneity in epidemiologic metaanalysis. Am J Epidemiol 1999; 150: 206-15.
135. Higgins J, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002; 21: 1539-58.
136. Higgins J, Thompson SG, Deeks J, Altman DG. Measuring inconsistency in meta-analysis. BMJ 2003; 327: 557-60.
137. Higgins J, Thompson SG, Deeks J, Altman DG. Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. J Health Serv Res Policy 2002; 7: 51-61.
138. Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Stat Med 1998; 17: 841-56.
139. Berlin JA, Antman EM. Advantages and limitations of metaanalytic regressions of clinical trials data. Online J Curr Clin Trials 1994; doc. no. 134.
140. Berkey CS, Hoaglin DC, Mosteller F, Colditz GA. A randomeffects regression model for meta-analysis. Stat Med 1995; 14: 395-411.
141. Vanhonacker WR. Meta-analysis and response surface extrapolation: a least squares approach. Amer Stat 1996; 50: 294-9.
142. Walker AM, Martin-Moreno JM, Artalejo FR. Odd man out: a graphical approach to meta-analysis. Am J Pub Health 1988; 78: 961-6.
143. Song F. Exploring heterogeneity in meta-analysis: is the L'Abbe plot useful? J Clin Epidemiol 1999; 52: 725-30.
144. Thompson SG, Sharp SJ. Explaining heterogeneity in metaanalysis: a comparison of methods. Stat Med 1999; 18: 2693-708.
145. Sharp SJ, Thompson SG. Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches. Stat Med 2000; 19: 3251-74.
146. Schmid C, Lau J, McIntosh M, Cappelleri J. An empirical study of the effect of the control rate as a predictor of treatment efficacy in meta-analysis of clinical trials. Stat Med 1998; 17: 1924-42.
147. Cook RJ, Walter SD. A logistic model for trend in 2 × 2 × kappa tables with applications to meta-analyses. Biometrics 1997; 53: 352-7.
148. Trikalinos T, Ioannidis JP. Predictive modeling and heterogeneity of baseline risk in meta-analysis of individual patient data. J Clin Epidemiol 2001; 54: 245-52.
149. Schmid CH. Exploring heterogeneity in randomized trials via meta-analysis. Drug Inf J 1999; 33: 211-24.
150. Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F. Methods for Meta-Analysis in Medical Research. Chichester: John Wiley & Sons, 2000.
151. Brockwell S, Gordon I. A comparison of statistical methods for meta-analysis. Stat Med 2001; 20: 825-40.
152. Sterne JAC, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in "meta-epidemiological" research. Stat Med 2002; 21: 1513-24.
153. Van Houwelingen HC, Arends LR, Stijnen T. Tutorial in biostatistics-advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med 2002; 21: 589-624.
154. Simon R. Overviews of randomized clinical trials. Cancer Treat Rep 1987; 71: 3-5.
155. Glasziou PP, Sanders SL. Investigating causes of heterogeneity in systematic reviews. Stat Med 2002; 21: 1503-11.
156. Davey Smith G, Egger M, Phillips AN. Meta-analysis. Beyond the grand mean? BMJ 1997; 315: 1610-14.
157. Light RJ, Pillemer DB. Summing Up: The Science of Reviewing Research. Cambridge, MA: Harvard University Press, 1984.
158. Devine EC, Cook TD. Effects of psycho-educational interventions on length of hospital stay: a meta-analytic review of 34 studies. In: Light RJ, ed., Evaluation Studies Review Annual, vol. 8. Beverly Hills, CA: Sage, 1983.
159. Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. J Clin Epidemiol 2001; 54: 1046-55.
160. Sterne JAC, Egger M, Smith GD. Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001; 323: 101-5.
161. Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Stat Med 2003; 22: 2113-26.
162. Rosenthal R. The file drawer problem and tolerance for null results. Psychol Bull 1979; 86: 638-41.
163. Iyengar S, Greenhouse JB. Selection models and the filedrawer problem. Stat Sci 1988; 3: 109-17.
164. Gleser LJ, Olkin I. Models for estimating the number of unpublished studies. Stat Med 1996; 15: 2493-507.
165. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629-34.
166. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50: 1088-101.
167. Dear KBG, Begg CB. An approach for assessing publication bias prior to performing a meta-analysis. Stat Sci 1992; 7: 237-45.
168. Hedges LV, Olkin I. Statistical Methods for Meta-Analysis. Orlando, FL: Academic Press, 1985.
169. Hedges LV, Vevea JL. Estimating effect size under publication bias: small sample properties and robustness of a random effects selection model. J Educational Behavioral Stat 1996; 21: 299-332.
170. Vevea JL, Hedges LV. A general linear model for estimating effect size in the presence of publication bias. Psychometrika 1995; 60: 419-35.
171. Givens GH, Smith DD, Tweedie RL. Publication bias in metaanalysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Stat Sci 1997; 12: 221-50.
172. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56: 455-63.
173. Meinert CL. Toward prospective registration of clinical trials. Control Clin Trials 1988; 9: 1-5.
174. Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 1986; 4: 1529-41.
175. Chalmers I, Dickersin K, Chalmers TC. Getting to grips with Archie Cochrane's agenda. BMJ 1992; 305: 786-8.
176. Dickersin K. Why register clinical trials?-Revisited. Control Clin Trials 1992; 13: 170-7.
177. Dickersin K. Report from the panel on the case for registers of clinical trials at the Eighth Annual Meeting of the Society for Clinical Trials. Control Clin Trials 1988; 9: 76-81.
178. Savulescu J, Chalmers I, Blunt J. Are research ethics committees behaving unethically? Some suggestions for improving performance and accountability. BMJ 1996; 313: 1390-3.
179. Anonymous. Making clinical trials register. Lancet 1992; 338: 244-5.
180. Dickersin K, Rennie D. Registering clinical trials. JAMA 2003; 290: 516-23.
181. Valsecchi MG, Masera G. A new challenge in clinical research in childhood ALL: the prospective meta-analysis strategy for intergroup collaboration. Ann Oncol 1996; 7: 1005-8.
182. Margitic SE, Morgan TM, Sager MA, Furberg CD. Lessons learned from a prospective meta-analysis. J Am Geriatr Soc 1995; 43: 435-9.
183. Simes RJ. Prospective meta-analysis of cholesterol-lowering studies: the Prospective Pravastatin Pooling (PPP) project and the cholesterol Treatment Trialists (CTT) collaboration. Am J Cardiol 1995; 76: 122C-6C.
184. Whitehead A. A prospectively planned cumulative metaanalysis applied to a series of concurrent clinical trials. Stat Med 1997; 16: 2901-13.
185. Temple RJ. The regulatory evolution of the integrated safety summary. Drug Inf J 1991; 25: 485-92.
186. Gabriel SE, Jaakkimainen L, Bombardier C. Risk for serious gastrointestinal complications related to use of nonsteroidal anti-inflammatory drugs. A meta-analysis. Ann Intern Med 1991; 115: 787-96.
187. Carson JL, Strom BL, Soper KA, West SL, Morse ML. The association of nonsteroidal anti-inflammatory drugs with upper gastrointestinal tract bleeding. Arch Intern Med 1987; 147: 85-8.
188. Bollini P, Garcia Rodriguez L, Perez Gutthann S, Walker AM. The impact of research quality and study design on epidemiologic estimates of the effect of nonsteroidal anti-inflammatory drugs on upper gastrointestinal tract disease. Arch Intern Med 1992; 152: 1289-95.
189. Henry D, Lim LL, Garcia Rodriguez LA, Perez GS, Carson JL, Griffin M et al. Variability in risk of gastrointestinal complications with individual non-steroidal anti-inflammatory drugs: results of a collaborative meta-analysis [see comments]. BMJ 1996; 312: 1563-6.
190. Taragin MI, Carson JL, Strom BL. Gastrointestinal side effects of the nonsteroidal anti-inflammatory drugs. Dig Dis 1990; 8: 269-80.
191. Carson JL, Strom BL. The gastrointestinal toxicity of the non-steroidal anti-inflammatory drugs. In: Rainsford KD, Velo GP, eds, Side-effects of Anti-inflammatory Drugs 3. Boston, MA: Kluwer, 1992; pp. 1-8.
192. Hine LK, Laird N, Hewitt P, Chalmers TC. Meta-analytic evidence against prophylactic use of lidocaine in acute myocardial infarction. Arch Intern Med 1989; 149: 2694-8.
193. Hine LK, Laird NM, Hewitt P, Chalmers TC. Meta-analysis of empirical long-term antiarrhythmic therapy after myocardial infarction. JAMA 1989; 262: 3037-40.
194. MacMahon S, Collins R, Peto R, Koster RW, Yusuf S. Effects of prophylactic lidocaine in suspected acute myocardial infarction. An overview of results from the randomized, controlled trials. JAMA 1988; 260: 1910-16.
195. Antman EM, Berlin JA. Declining incidence of ventricular fibrillation in myocardial infarction. Implications for the prophylactic use of lidocaine. Circulation 1992; 86: 764-73.
196. Coplen SE, Antman EM, Berlin JA, Hewitt P, Chalmers TC. Efficacy and safety of quinidine therapy for maintenance of sinus rhythm after cardioversion. A meta-analysis of randomized control trials. Circulation 1990; 82: 1106-16. (published erratum appears in Circulation 1991; 83: 714).
197. Reimold SC, Chalmers TC, Berlin JA, Antman EM. Assessment of the efficacy and safety of antiarrhythmic therapy for chronic atrial fibrillation: observations on the role of trial design and implications of drug-related mortality. Am Heart J 1992; 124: 924-32.
198. Szczech LA, Berlin JA, Aradhye S, Grossman RA, Feldman HI. Effect of anti-lymphocyte induction therapy on renal allograft survival: a meta-analysis. J Am Soc Nephrol 1997; 8: 1771-7.
199. Szczech LA, Berlin JA, Feldman HI. The effect of antilymphocyte induction therapy on renal allograft survival. A meta-analysis of individual patient-level data. Anti-Lymphocyte Antibody Induction Therapy Study Group. Ann Intern Med 1998; 128: 817-26.
200. Hommes DW, Bura A, Mazzolai L, Buller HR, ten Cate JW. Subcutaneous heparin compared with continuous intravenous heparin administration in the initial treatment of deep vein thrombosis. A meta-analysis. Ann Intern Med 1992; 116: 279-84.
201. Hull RD, Raskob GE, Hirsh J, Jay RM, Leclerc JR, Geerts WH et al. Continuous intravenous heparin compared with intermittent subcutaneous heparin in the initial treatment of proximal-vein thrombosis. N Engl J Med 1986; 315: 1109-14.
202. Webber DM, Montague TH, Bird NP. Meta-analysis of QTc interval-pooling data from heterogeneous trials. Pharmaceut Stat 2002; 1: 17-23.
203. Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med 1992; 327: 248-54.
204. Stampfer MJ, Goldhaber SZ, Yusuf S, Peto R, Hennekens CH. Effect of intravenous streptokinase on acute myocardial infarction: pooled results from randomized trials. N Engl J Med 1982; 307: 1180-2.
205. Berkey CS, Mosteller F, Lau J, Antman EM. Uncertainty of the time of first significance in random effects cumulative meta-analysis. Control Clin Trials 1996; 17: 357-71.
206. Lan KKG, Hu M, Cappelleri JC. Applying the law of iterated logarithm to cumulative meta-analysis of a continuous endpoint. Statistica Sinica 2003; 13: 1135-45.
207. Ziegler RG, Mayne ST, Swanson CA. Nutrition and lung cancer. Cancer Causes Control 1996; 7: 157-77.
208. Hennekens CH, Buring JE, Manson JE, Stampfer M, Rosner B, Cook NR et al. Lack of effect of long-term supplementation with beta carotene on the incidence of malignant neoplasms and cardiovascular disease. N Engl J Med 1996; 334: 1145-9.
209. Omenn GS, Goodman GE, Thornquist MD, Balmes J, Cullen MR, Glass A et al. Effects of a combination of beta carotene and vitamin A on lung cancer and cardiovascular disease. N Engl J Med 1996; 334: 1150-5.
210. Rossouw JE, Anderson GL. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results from the Women's Health Initiative randomized controlled trial. JAMA 2002; 288: 321-33.
211. Stewart LA, Clarke MJ. Practical methodology of metaanalyses (overviews) using updated individual patient data. Stat Med 1995; 14: 2057-79.
212. Stewart LA, Parmar MK. Meta-analysis of the literature or of individual patient data: is there a difference? Lancet 1993; 341: 418-22.
213. Duchateau L, Pignon JP, Bijnens L, Bertin S, Bourhis J, Sylvester R. Individual patient-versus literature-based meta-analysis of survival data: time to event and event rate at a particular time can make a difference, an example based on head and neck cancer. Control Clin Trials 2001; 22: 538-47.
214. Schmid CH, Landa M, Jafar TH, Giatras I, Karim T, Reddy M et al. Constructing a database of individual clinical trials for longitudinal analysis. Control Clin Trials 2003; 24: 324-40.
215. Berlin J, Santanna J, Schmid CH, Szczech LA, Feldman H. Individual patient-versus group-level data meta-regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head. Stat Med 2002; 21: 371-87.
216. LeLorier J, Gregoire G, Benhaddad A, Lapierre J, Derderian F. Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med 1997; 337: 536-42.
217. Ioannidis JP, Cappelleri JC, Lau J. Issues in comparisons between meta-analyses and large trials. JAMA 1998; 279: 1089-93.
218. Cappelleri JC, Ioannidis JP, Schmid CH, de Ferranti SD, Aubert M, Chalmers TC et al. Large trials vs meta-analysis of smaller trials: how do their results compare? JAMA 1996; 276: 1332-8.
219. Peto R, Collins R, Gray R. Large-scale randomized evidence: large, simple trials and overviews of trials. J Clin Epidemiol 1995; 48: 23-40.
220. Villar J, Piaggio G, Carroli G, Donner A. Factors affecting the comparability of meta-analyses and largest trials results in perinatology. J Clin Epidemiol 1997; 50: 997-1002.
221. Borzak S, Ridker PM. Discordance between meta-analyses and large-scale randomized, controlled trials. Examples from the management of acute myocardial infarction. Ann Intern Med 1995; 123: 873-7.
222. Colditz GA, Brewer TF, Berkey CS, Wilson ME, Burdick E, Fineberg HV et al. The efficacy of bacillus Calmette-Guerin vaccination in the prevention of tuberculosis: meta-analysis of the published literature. JAMA 1994; 271: 698-702.
223. Colditz GA, Berkey CS, Mosteller F, Brewer TF, Wilson ME, Burdick E et al. The efficacy of bacillus Calmette-Guerin vaccination of newborns and infants in the prevention of tuberculosis: meta-analyses of the published literature. Pediatrics 1995; 96: 29-35.
224. Furukawa T, Streiner D, Hori S. Discrepancies among megatrials. J Clin Epidemiol 2001; 53: 1193-9.
225. Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol 1997; 50: 683-91.
226. Lumley T. Network meta-analysis for indirect treatment comparisons. Stat Med 2002; 21: 2313-24.
227. Ades AE. A chain of evidence with mixed comparisons: models for multi-parameter synthesis and consistency of evidence. Stat Med 2003; 22: 2995-3016.
228. Psaty BM, Lumley T, Furberg CD, Schellenbaum G, Pahor M, Alderman MH et al. Health outcomes associated with various antihypertensive therapies used as first-line agents: a network meta-analysis. JAMA 2003; 289: 2534-44.
229. Song F, Glenny AM, Altman DG. Indirect comparison in evaluating relative efficacy illustrated by antimicrobial prophylaxis in colorectal surgery. Control Clin Trials 2000; 21: 488-97.