Publication bias in meta-analysis: Its causes and consequences

Journal of Clinical Epidemiology

Volumn 53, Issue 2, 2000, Pages 207-216

  Thornton, Alison ^a   Lee, Peter ^a  

^a PN Lee Statistics and Computing Ltd   (United Kingdom)

Author keywords

Publication bias

Indexed keywords

ARTICLE; MEDICAL LITERATURE; META ANALYSIS; METHODOLOGY; POLICY; PRIORITY JOURNAL; PUBLICATION; PUBLISHING; SCIENTIFIC LITERATURE; STATISTICAL ANALYSIS;

EPIDEMIOLOGIC RESEARCH DESIGN; HUMANS; META-ANALYSIS; PUBLICATION BIAS;

EID: 0034112926     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0895-4356(99)00161-4     Document Type: Article

References (75)

1. Last J.M. A Dictionary of Epidemiology. 1983;Oxford University Press, Oxford. p. 12.
2. Rosenthal R. The "file drawer problem" and tolerance for null results. Psychol Bull. 86:1979;638-641.
3. Smith M.B. Editorial. J Abnorm Social Psychol. 52:1956;1-4.
4. Sterling T. Publication decisions and their possible effects on inferences drawn from tests of significance - or vice versa. Am Stat Assoc J. 54:1959;30-34.
5. Smart R.G. The importance of negative results in psychological research. Can Psychol. 5:1964;225-232.
6. Tweedie R.L., Scott D.J., Biggerstaff B.J., Mengersen K.L. Bayesian meta-analysis, with application to studies of ETS and lung cancer. Lung Cancer. 14(suppl. 1):1996;S171-S194.
7. Angell M. Negative studies. N Engl J Med. 321:1989;464-466.
8. Newcombe R.G. Towards a reduction in publication bias. BMJ. 295:1987;656-659.
9. Pocock S.J., Hughes M.D., Lee R.J. Statistical problems in the reporting of clinical trials. a survey of three medical journals N Engl J Med. 317:1987;426-432.
10. Green S.J., Fleming T.R., Emerson S. Effects on overviews of early stopping rules for clinical trials. Stat Med. 6:1987;361-369.
11. Felson D.T. Bias in meta-analytic research. J Clin Epidemiol. 45:1992;885-892.
12. Lee P.N. Problems in interpreting epidemiological data. Mohr U., Bates D.V., Dungworth D.L., Lee P.N., McClellan R.O., Roe F.J.C. Assessment of Inhalation Hazards. 1989;49-50 Springer-Verlag, Berlin.
13. Begg C.B., Berlin J.A. Publication bias. a problem in interpreting medical data J R Stat Soc A. 151:1988;419-463.
14. Givens G.H., Smith D.D., Tweedie R.L. Publication bias in meta-analysis. A Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate Stat Sci. 12:1997;221-250.
15. Engler R.I., Covell J.W., Friedman P.J., Kitcher P.S., Peters R.M. Misrepresentation and responsibility in medical research. N Engl J Med. 317:1983;1383-1389.
16. Rosenthal R., Fode K.L. Psychology of the scientist. V. Three experiments in experimenter bias Psychol Rep. 12:1963;491-511.
17. Rosenthal R. Experimenter outcome-orientation and the results of the psychological experiment. Psychol Bull. 61:1964;405-412.
18. Chalmers T.C., Berrier J., Sacks H.S., Levin H., Reitman D., Nagalingam R. Meta-analysis of clinical trials as a scientific discipline. I. Control of bias and comparison with large co-operative trials Stat Med. 6:1987;315-328.
19. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 263:1990;1385-1389.
20. Kleijnen J., Knipschild P. Review articles and publication bias. Arzneimittelforschung. 42:1992;587-591.
21. Minerva Re publication bias. BMJ. 304:1992;264.
22. Light R.J. Accumulating evidence from independent studies. what we can win and what we can lose Stat Med. 6:1987;221-231.
23. Begg C.B. A measure to aid in the interpretation of published clinical trials. Stat Med. 4:1985;1-9.
24. Bulpitt C.J. Meta-analysis. Lancet. ii:1988;93-94.
25. Koren G., Shear H., Graham K., Einarson T. Bias against the null hypothesis. the reproductive hazards of cocaine Lancet. ii:1989;1440-1442.
26. Chalmers T.C., Frank C.S., Reitman D. Minimizing the three stages of publication bias. JAMA. 263:1990;1392-1395.
27. Charlton B. Think negative. science needs its failures New Scientist. 29Oct:1987;72.
28. Mahoney M.J. Publication prejudices. an experimental study of confirmatory bias in the peer review system Cog Ther Res. 1:1977;161-175.
29. LeVois M.E., Layard M.W. Publication bias in the environmental tobacco smoke/coronary heart disease epidemiologic literature. Regul Toxicol Pharmacol. 21:1995;184-191.
30. Bero L.A., Galbraith A., Rennie D. Sponsored symposia on environmental tobacco smoke. JAMA. 271:1994;612-617.
31. L'Abbé K.A., Detsky A.S., O'Rourke K. Meta-analysis in clinical research. Ann Intern Med. 107:1987;224-233.
32. Mosteller F., Colditz G.A. Understanding research synthesis (meta-analysis). Annu Rev Public Health. 17:1996;1-23.
33. Easterbrook P.J., Berlin J.A., Gopalan R., Matthews D.R. Publication bias in clinical research. Lancet. 337:1991;867-872.
34. Blair A., Burg J., Foran J., Gibb H., Greenland S., Morris R., Raabe G., Savitz D., Teta J., Wartenberg D., Wong O., Zimmerman R. Guidelines for application of meta-analysis in environmental epidemiology. Regul Toxicol Pharmacol. 22:1995;189-197.
35. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiol Rev. 9:1987;1-30.
36. Sacks H.S., Berrier J., Reitman D., Ancona-Berk V.A., Chalmers T.C. Meta-analyses of randomized controlled trials. N Engl J Med. 316:1987;450-455.
37. Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, McIlroy W, Oxman AD. Should unpublished data be included in meta-analyses? JAMA 1993;269:2749-53.
38. Kilpatrick S.J. The epidemiology of environmental tobacco smoke (ETS) and the weight of evidence argument. Int Surg. 77:1992;131-133.
39. Pignon J.-P., Arriagada R. Meta-analyses of randomized clinical trials. how to improve their quality? Lung Cancer. 10(suppl. 1):1994;S135-S141.
40. Wald N.J., Nanchahal K., Thompson S.G., Cuckle H.S. Does breathing other people's tobacco smoke cause lung cancer? BMJ. 293:1986;1217-1222.
41. Jones D.R. Meta-analysis of observational epidemiological studies. a review J R Soc Med. 85:1992;165-168.
42. DerSimonian R., Laird N. Meta-analysis in clinical trials. Controlled Clin Trials. 7:1986;177-188.
43. Moher D., Fortin P., Jadad A.R., Jüni P., Klassen T., Le Lorier J., Liberati A., Linde K., Penna A. Completeness of reporting trials published in languages other than English. implications for conduct and reporting of systematic reviews Lancet. 347:1996;363-366.
44. Egger M., Davey Smith G., Schneider M., Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 315:1997;629-634.
45. Grégoire G., Derderian F., Le Lorier J. Selecting the language of the publications included in a meta-analysis. is there a Tower of Babel bias? J Clin Epidemiol. 48:1995;159-163.
46. Vickers A., Goyal N., Harland R., Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Controlled Clin Trials. 19:1998;159-166.
47. Gøtzsche P.C. Reference bias in reports of drug trials. BMJ. 295:1987;654-656.
48. Tramèr M.R., Reynolds D.J.M., Moore R.A., McQuay H.J. Impact of covert duplicate publication on meta-analysis. a case study BMJ. 315:1997;635-640.
49. Morris R.D. Meta-analysis in cancer epidemiology. Environ Health Perspect. 102(suppl. 8):1994;61-66.
50. Cappelleri J.C., Ioannidis J.P.A., Schmid C.H., de Ferranti S.D., Aubert M., Chalmers T.C., Lau J. Large trials vs meta-analysis of smaller trials. how do their results compare? JAMA. 276:1996;1332-1338.
51. Helfenstein U., Steiner M. Fluoride varnishes (Duraphat). a meta-analysis Community Dent Oral Epidemiol. 22:1994;1-5.
52. Greenland S. Invited commentary. a critical look at some popular meta-analytic methods Am J Epidemiol. 140:1994;290-296.
53. Pocock S.J., Hughes M.D. Estimation issues in clinical trials and overviews. Stat Med. 9:1990;657-671.
54. Sterling T.D., Rosenbaum W.L., Weinkam J.J. Publication decisions revisited. the effect of the outcome of statistical tests on the decision to publish and vice versa Am Stat. 49:1995;108-112.
55. Chan W.C., Fung S.C. Lung cancer in non-smokers in Hong Kong. Grundmann E. Cancer Campaign Vol 6. Cancer Epidemiology. 1982;199-202 Gustav Fischer Verlag, Stuttgart/New York.
56. Vandenbroucke J.P. Passive smoking and lung cancer. a publication bias? BMJ. 296:1988;391-392.
57. Allison D.B.et al. Publication bias in obesity treatment trials? Int J Obes Relat Metab Disord. 20:1996;931-937.
58. Begg C.B., Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 50:1994;1088-1101.
59. Begg C.B. Publication bias. Cooper H., Hedges L.V. The Handbook of Research Synthesis. 1994;399-409 Russell Sage Foundation, New York.
60. Rust R.T., Lehmann D.R., Farley J.U. Estimating publication bias in meta-analysis. J Market Res. XXVII:1990;220-226.
61. Persaud R. Misleading meta-analysis. "fail-safe N" is a useful mathematical measure of the stability of results BMJ. 312:1996;125. [Letter].
62. Gleser L.J., Olkin I. Models for estimating the number of unpublished studies. Stat Med. 15:1996;2493-2507.
63. Hackshaw A.K., Law M.R., Wald N.J. The accumulated evidence on lung cancer and environmental tobacco smoke. BMJ. 315:1997;980-988.
64. Sugita M., Kanamori M., Izuno T., Miyakawa M. Estimating a summarized odds ratio whilst eliminating publication bias in meta-analysis. Jpn J Clin Oncol. 22:1992;354-358.
65. Sugita M., Yamaguchi N., Izuno T., Kanamori M., Kasuga H. Publication probability of a study on odds ratio value circumstantial evidence for publication bias in medical study areas. Tokai J Exp Clin Med. 19:1994;29-37.
66. Sugita M., Izuno T., Kanamori M. Recalculation of summarised odds ratios for the relationship between passive smoking and lung cancer based on data in the EPA report. Indoor Environment. 4:1995;177-181.
67. US Environmental Protection Agency. Respiratory health effects of passive smoking: lung cancer and other disorders. EPA/600/6-90-006F. Washington DC, 1992.
68. Easterbrook P. Reducing publication bias. BMJ. 295:1987;1347. [Letter].
69. Simes R.J. Confronting publication bias. a cohort design for meta-analysis Stat Med. 6:1987;11-29.
70. Smith R. Misconduct in research. editors respond. The Committee on Publication Ethics (COPE) is formed BMJ. 315:1997;201-202. [Editorial].
71. Naylor C.D. Meta-analysis and the meta-epidemiology of clinical research. BMJ. 315:1997;617-619. [Editorial].
72. Berlin J.A. Will publication bias vanish in the age of online journals? Online J Curr Clin Trials. Doc(No 12):1992;. [Editorial].
73. Irwig L., Macaskill P., Berry G., Glasziou P. Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased. BMJ. 316:1998;470. [Letter].
74. Vandenbroucke J.P. Bias in meta-analysis detected by a simple, graphical test. Expert's views are still needed. BMJ. 316:1998;469-470. [Letter].
75. Evans S. Misleading meta-analysis. statistician's comment BMJ. 312:1996;125.