Promises and pitfalls of meta-analysis in vaccine research

Vaccine

Volumn 17, Issue 13-14, 1999, Pages 1628-1634

  Jacobson, Robert M ^a  

^a MAYO CLINIC   (United States)

Author keywords

Meta analysis; Methodology; Vaccine

Indexed keywords

BCG VACCINE; CYTOMEGALOVIRUS ANTIBODY; DIPHTHERIA PERTUSSIS TETANUS VACCINE; HEPATITIS B VACCINE; INFLUENZA VACCINE; MEASLES MUMPS RUBELLA VACCINE; PERTUSSIS VACCINE; PNEUMOCOCCUS VACCINE; ROTAVIRUS VACCINE; TYPHOID VACCINE;

BACTERIAL INFECTION; CLINICAL TRIAL; CONFERENCE PAPER; CYTOMEGALOVIRUS INFECTION; DRUG EFFICACY; DRUG INDUCED DISEASE; DRUG RESEARCH; HEPATITIS B; HUMAN; INFLUENZA; MEASLES; META ANALYSIS; MUMPS; PERTUSSIS; PRIORITY JOURNAL; ROTAVIRUS; RUBELLA; STREPTOCOCCUS INFECTION; SUDDEN INFANT DEATH SYNDROME; TETANUS; TUBERCULOSIS; TYPHOID FEVER; VACCINATION; VIRUS INFECTION;

ANIMALS; HUMANS; META-ANALYSIS; RESEARCH; VACCINES;

EID: 0345003934     PISSN: 0264410X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0264-410X(98)00425-3     Document Type: Conference Paper

References (85)

1. Clarke M.J., Stewart L.A. Meta-analyses using individual patient data. J. Eval. Clin. Pract. 3(3):1997;207-212.
2. Charlton B.G. The uses and abuses of meta-analysis (see comments). Fam. Pract. 13(4):1996;397-401.
3. Cook D.J., Levy M.M., Heyland D.K. How to use a review article: prophylactic endoscopic sclerotherapy for esophageal varices. Evidence Based Critical Care Medicine Group. Crit. Care Med. 26(4):1998;692-700.
4. Fagard R.H., Staessen J.A., Thijs L. Advantages and disadvantages of the meta-analysis approach. J. Hypertension Suppl. 14(2):1996;S9-12. (discussion S13).
5. Clarke M., Chalmers I. Discussion sections in reports of controlled trials published in general medical journals: islands in search of continents? JAMA. 280(3):1998;280-282.
6. Goldman L., Feinstein A. Anti-coagulants in myocardial infarction: the problems of pooling, drowning and floating. Ann. Int. Med. 90:1979;92-94.
7. Gardosi J. Systematic reviews: insufficient evidence on which to base medicine. Br. J. Obstet. Gynaecol. 105(1):1998;1-5.
8. Ioannidis J.P., Cappelleri J.C., Lau J. Issues in comparisons between meta-analyses and large trials. JAMA. 279(14):1998;1089-1093.
9. LeLorier J., Gregoire G., Benhaddad A., Lapierre J., Derderian F. Discrepancies between meta-analyses and subsequent large randomized, controlled trials (see comments). N. Engl. J. Med. 337(8):1997;536-542.
10. Villar J., Piaggio G., Carroli G., Donner A. Factors affecting the comparability of meta-analyses and largest trials results in perinatology. J. Clin. Epidemiol. 50(9):1997;997-1002.
11. Conn H.O. Interpretation of data from multiple trials: a critical review. J. Int. Med. 241(3):1997;177-183.
12. Greenhalgh T. Papers that summarise other papers (systematic reviews and meta-analyses). BMJ. 315(7109):1997;672-675.
13. Anonymous Protocol for prospective collaborative overviews of major randomized trials of blood-pressure-lowering treatments. World Health Organization-International Society of Hypertension Blood Pressure Lowering Treatment Trialists' Collaboration (see comments). J. Hypertension. 16(2):1998;127-137.
14. Atallah A.N. Systematic reviews of medical literature and metanalyses. Rev. Paul. Med. 114(5):1996;1285-1287.
15. Messeri P., Workman S., Saunders C., Francis C. The application of meta-analysis in assessing racial differences in the effects of antihypertensive medication. J. Natl. Med. Assoc. 89(7):1997;477-485.
16. Shadish W.R., Ragsdale K. Random versus nonrandom assignment in controlled experiments: do you get the same answer? J. Consult. Clin. Psychol. 64(6):1996;1290-1305.
17. Egger M., Davey Smith G., Schneider M., Minder C. Bias in meta-analysis detected by a simple, graphical test (see comments). BMJ. 315(7109):1997;629-634.
18. Hasselblad V. Meta-analysis of multitreatment studies. Med. Decision Making. 18(1):1998;37-43.
19. Allison D.B., Heo M. Meta-analysis of linkage data under worst-case conditions: a demonstration using the human OB region. Genetics. 148(2):1998;859-865.
20. Cook R.J., Walter S.D. A logistic model for trend in 2×2×kappa tables with applications to meta-analyses. Biometrics. 53(1):1997;352-357.
21. Cucherat M., Boissel J.P., Leizorovicz A., Haugh M.C. EasyMA: a program for the meta-analysis of clinical trials. Comput. Methods Programs Biomed. 53(3):1997;187-190.
22. Nony P., Cucherat M., Haugh M.C., Boissel J.P. Standardization of terminology in meta-analysis: a proposal for working definitions. Fund. Clin. Pharmacol. 11(6):1997;481-493.
23. Bramwell V.H., Williams C.J. Do authors of review articles use systematic methods to identify, assess and synthesize information? Ann. Oncol. 8(12):1997;1185-1195.
24. Becker L. The Cochrane collaboration. Valuable resource for family physicians (editorial). Can. Fam. Phys. 1997;43:403-404 and 412-414.
25. Clarke C.E., Sampaio C. Movement Disorders Cochrane collaborative Review Group. Movement Disorders. 12(4):1997;477-482.
26. Cranney A., Tugwell P., Shea B., Wells G. Implications of OMERACT outcomes in arthritis and osteoporosis for cochrane meta-analysis. J. Rheumatol. 24(6):1997;1206-1207.
27. Jadad A., Cook D., Jones A., Klassen T., Tugwell P., Moher M., Moher D. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA. 280(3):1998;278-280.
28. Counsell C. Formulating questions and locating primary studies for inclusion in systematic reviews. Ann. Int. Med. 127(5):1997;380-387.
29. Elliott H.L. Post hoc analysis: use and dangers in perspective. J. Hypertens. Suppl. 14(2):1996;S21-4. (discussion S24-S25).
30. Austin H., Perkins L.L., Martin D.O. Estimating a relative risk across sparse case-control and follow-up studies: a method for meta-analysis. Stat. Med. 16(9):1997;1005-1015.
31. Beard M.T., Curry E.L., Edwards K., Adams B.N. Advances in meta-analysis as a research method. ABNF J. 8(5):1997;92-97.
32. Berkey C.S., Mosteller F., Lau J., Antman E.M. Uncertainty of the time of first significance in random effects cumulative meta-analysis. Contr. Clin. Trials. 17(5):1996;357-371.
33. Freeman C.D., Strayer A.H. Mega-analysis of meta-analysis: an examination of meta-analysis with an emphasis on once-daily aminoglycoside comparative trials. Pharmacotherapy. 16(6):1996;1093-1102.
34. Connis R.T., Evans R.L., Hendricks R.D. Meta-analysis with longitudinal studies: controlling for analytical bias. Psychol. Rep. 79(3 (Part 2)):1996;1383-1386.
35. Jadad A.R., Cook D.J., Browman G.P. A guide to interpreting discordant systematic reviews. CMAJ. 156(10):1997;1411-1416.
36. Menard J., Chatellier G. Integration of trial, meta-analysis and cohort results with treatment guidelines. J. Hypertension Suppl. 14(2):1996;S129-S133. (discussion S133-S134).
37. Lau J., Ioannidis J.P., Schmid C.H. Quantitative synthesis in systematic reviews. Ann. Int. Med. 127(9):1997;820-826.
38. Engels E.A., Falagas M.E., Lau J., Bennish M.L. Typhoid fever vaccines: a meta-analysis of studies on efficacy and toxicity. BMJ. 316(7125):1998;110-116.
39. Vesikari T. Trials of oral bovine and rhesus rotavirus vaccines in Finland: a historical account and present status. Arch. Virol. Suppl. 12:1996;177-186.
40. Brewer T.F., Colditz G.A. Bacille Calmette-Guerin vaccination for the prevention of tuberculosis in health care workers. Clin. Infect. Dis. 20(1):1995;136-142.
41. Brewer T.F., Colditz G.A. Relationship between bacille Calmette-Guerin (BCG) strains and the efficacy of BCG vaccine in the prevention of tuberculosis. Clin. Infect. Dis. 20(1):1995;126-135.
42. Colditz G.A., Brewer T.F., Berkey C.S., Wilson M.E., Burdick E., Fineberg H.V., Mosteller F. Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature (see comments). JAMA. 271(9):1994;698-702.
43. Rodrigues L.C., Diwan V.K., Wheeler J.G. Protective effect of BCG against tuberculous meningitis and miliary tuberculosis: a meta-analysis. Int. J. Epidemiol. 22(6):1993;1154-1158.
44. Fine M.J., Smith M.A., Carson C.A., Meffe F., Sankey S.S., Weissfeld L.A., Detsky A.S., Kapoor W.N. Efficacy of pneumococcal vaccination in adults. A meta-analysis of randomized controlled trials. Arch. Int. Med. 154(23):1994;2666-2677.
45. Gross P.A., Hermogenes A.W., Sacks H.S., Lau J., Levandowski R.A. The efficacy of influenza vaccine in elderly persons. A meta-analysis and review of the literature. Ann. Int. Med. 123(7):1995;518-527.
46. Wilson M.E., Fineberg H.V., Colditz G.A. Geographic latitude and the efficacy of bacillus Calmette-Guerin vaccine. Clin. Infect. Dis. 20(4):1995;982-991.
47. del Canho R., Grosheide P.M., Mazel J.A., Heijtink R.A., Hop W.C., Gerards L.J., de Gast G.C., Fetter W.P., Zwijneberg J., Schalm S.W. Ten-year neonatal hepatitis B vaccination program, The Netherlands, 1982-1992: protective efficacy and long-term immunogenicity. Vaccine. 15(15):1997;1624-1630.
48. Go E.S., Ballas Z.K. Anti-pneumococcal antibody response in normal subjects: a meta-analysis (see comments). J. Allergy Clin. Immunol. 98(1):1996;205-215.
49. Morales J.M., Jaqueti J., Vina C. A meta-analytical review of the response by sex to vaccination against hepatitis B in hospital personnel. Atencion Primaria. 12(2):1993;99-101.
50. Anders J.A., Jacobson R.M., Poland G.A., Jacobsen S.J., Wollan P.C. Secondary failure rates of measles vaccines: a meta-analysis of published studies. Pediatr. Infect. Dis. J. 15:1996;62-66.
51. Koch J, Jacobson R, Poland G, Wollan P. Intercurrent illness and antibody levels following measles, mumps and rubella vaccination. Presented at The First World Congress on Vaccines and Immunization: towards control of infectious diseases. Istanbul, Turkey: International Comparative Virology Organization, 1998.
52. Glass RI, Ing DJ, Stoll BJ, Ing RT. Immune response to rotavirus vaccines among breast-fed and nonbreast-fed children. In: e alias JM, editor. Immunology of milk and the neonate. New York: Plenum Press, 1991. p. 249-54.
53. Pichichero M. Effect of breast-feeding on oral rhesus rotavirus vaccine seroconversion: a meta-analysis. J. Infect. Dis. 162:1990;753-755.
54. Carvajal A., Caro-Paton T., Martin de Diego I., Martin Arias L.H., Alvarez Requejo A., Lobato A. DTP vaccine and infant sudden death syndrome meta-analysis. Med. Clin. 106(17):1996;649-652.
55. Beyer W.E., Palache A.M., Kerstens R., Masurel N. Gender differences in local and systemic reactions to inactivated influenza vaccine, established by a meta-analysis of fourteen independent studies. Eur. J. Clin. Microbiol. Infect. Dis. 15(1):1996;65-70.
56. Wittes J., Kelly A., Plante K. Meta-analysis of CMVIG studies for the prevention and treatment of CMV infection in transplant patients. Transplant. Proc. 28 (Suppl. 2)(6):1996;17-21.
57. Metselaar H., Weimar W. Prevention of cytemegalovirus infection after organ transplantation with passive immunization. Transfusionsmedizin. 30:1992;198-202.
58. Fraser E., Grimes D., Schulz K. Immunization as therapy for recurrent spontaneous abortion: a review and meta-analysis. Obstet. Gynecol. 82:1993;854-859.
59. Valsecchi M.G., Masera G. A new challenge in clinical research in childhood ALL: the prospective meta-analysis strategy for intergroup collaboration. Ann. Oncol. 7(10):1996;1005-1008.
60. Whitehead A. A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials. Stat. Med. 16(24):1997;2901-2913.
61. Flather M.D., Farkouh M.E., Pogue J.M., Yusuf S. Strengths and limitations of meta-analysis: larger studies may be more reliable. Control. Clin. Trials. 18(6):1997;568-579. (discussion 661-666).
62. Elvik R. Evaluating the statistical conclusion validity of weighted mean results in meta-analysis by analysing funnel graph diagrams. Accident Anal. Prevent. 30(2):1998;255-266.
63. Cucherat M., Cialdella P. Meta-analysis of therapeutic trials: applications in psychiatry. Encephale. 22(5):1996;378-387.
64. Misakian A., Bero L. Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA. 280(3):1998;250-253.
65. Callaham M., Wears R., Weber E., Barton C., Young G. Positive-outcome bias and other limitations in the outcome of research abstracts submitted to a scientific meeting. JAMA. 280(3):1998;254-257.
66. Weber E., Callaham M., Wears R., Barton C., Young G. Unpublished research from a medical specialty meeting: why investigators fail to publish. JAMA. 280(3):1998;257-259.
67. Gleser L.J., Olkin I. Models for estimating the number of unpublished studies. Stat. Med. 15(23):1996;2493-2507.
68. Tramer M.R., Reynolds D.J., Moore R.A., McQuay H.J. Impact of covert duplicate publication on meta-analysis: a case study. BMJ. 315(7109):1997;635-640.
69. Berlin J.A. Does blinding of readers affect the results of meta-analyses? University of Pennsylvania Meta-analysis Blinding Study Group (letter) (see comments). Lancet. 350(9072):1997;185-186.
70. Blettner M., Schlehofer B., Sauerbrei W. Limitations of meta-analysis from published data in epidemiological research. Soz. Praventivmed. 42(2):1997;95-104.
71. Sacks H., Berrier J., Reitman D., Ancona-Berk V., Chalmers T. Meta-analysis of randomized controlled trials. N. Engl. J. Med. 316:1987;450-455.
72. Abrams K., Sanso B. Approximate Bayesian inference for random effects meta-analysis. Stat. Med. 17(2):1998;201-218.
73. Biggerstaff B.J., Tweedie R.L. Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis. Stat. Med. 16(7):1997;753-768.
74. Berkey C.S., Hoaglin D.C., Mosteller F., Colditz G.A. A random-effects regression model for meta-analysis. Stat. Med. 14(4):1995;395-411.
75. Thompson S.G., Smith T.C., Sharp S.J. Investigating underlying risk as a source of heterogeneity in meta-analysis. Stat. Med. 16(23):1997;2741-2758.
76. Lecky F.E., Little R.A., Brennan P. The use and misuse of meta-analysis. J. Accident Emerg. Med. 13(6):1996;373-378.
77. Belsky J. Theory testing, effect-size evaluation, and differential susceptibility to rearing influence: the case of mothering and attachment (comment). Child Devel. 68(4):1997;598-600.
78. Bucher H.C., Guyatt G.H., Griffith L.E., Walter S.D. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J. Clin. Epidemiol. 50(6):1997;683-691.
79. Matt G.E., Navarro A.M. What meta-analyses have and have not taught us about psychotherapy effects: a review and future directions. Clin. Psychol. Rev. 17(1):1997;1-32.
80. Sharpe D. Of apples and oranges, file drawers and garbage: why validity issues in meta-analysis will not go away. Clin. Psychol. Rev. 17(8):1997;881-901.
81. Steinberg K.K., Smith S.J., Stroup D.F., Olkin I., Lee N.C., Williamson G.D., Thacker S.B. Comparison of effect estimates from a meta-analysis of summary data from published studies and from a meta-analysis using individual patient data for ovarian cancer studies. Am. J. Epidemiol. 145(10):1997;917-925.
82. Poirer M.K., Poland G.A., Jacobson R.M. Parameters potentially affecting interpretation of immunogenicity and efficacy data in vaccine trials: are they adequately reported? Vaccine. 14:1996;25-27.
83. Olin P. Acellular pertussis vaccines-a question of efficacy. J. Hospital Infect. 30 (Suppl.):1995;503-507.
84. Olin P. Defining surrogate serologic tests with respect to predicting protective vaccine efficacy: pertussis vaccination. Ann. N. Y. Acad. Sci. 754:1995;273-277.
85. Heininger U, Cherry JD, Stehr K, Schnitt-Grohé S, Überall M, Laussucq S, Eckhardt T, Meyer M, Gorben J, the Pertussis Vaccine group. Comparative efficacy of the Lederle/Takeda acellular pertussis component DTP (DTaP) vaccine and Lederle whole cell component DTP vaccine in German children after household exposure. Pediatrics 1998,102(3):546-53.