Beyond conventional publication bias: Other determinants of data suppression

Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments

Volumn , Issue , 2006, Pages 303-317

  Halpern, Scott D ^a   Berlin, Jesse A ^b,c  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c Cochrane Collaboration’s Prospective Meta analysis Methods Group ^*  (United Kingdom)

Author keywords

Beyond conventional publication bias; Bias in omitted research; Conventional publication bias; Evaluating data suppression; Financial and non financial competing interests; Financial competing interests; Non financial motives; Suppressing drug efficacy data; Traditional publication bias

Indexed keywords

EID: 47749104760     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0470870168.ch16     Document Type: Chapter

References (70)

1. Anonymous (1997). A curious stopping rule from Hoechst Marion Roussel. Lancet, 350, 155.
2. Azimi, N.A. and Welch, H.G. (1998). The effectiveness of cost-effectiveness analysis in containing costs. Journal of General Internal Medicine, 13, 664-669.
3. Baird, P., Downie, J. and Thompson, J. (2002). Clinical trials and industry. Science, 287, 2211.
4. Barnes, D.E. and Bero, L.A. (1998). Why review articles on the health effects of passive smoking reach different conclusions. Journal of the American Medical Association, 279, 1566-1570.
5. Begg, C.B. and Berlin, J.A. (1988). Publication bias: A problem in interpreting medical data. Journal of the Royal Statistical Society, Series A, 151, 419-463.
6. Begg, C.B. and Berlin, J.A. (1989). Publication bias and the dissemination of clinical research. Journal of the National Cancer Institute, 81, 107-115.
7. Begg, C.B. and Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50, 1088-1101.
8. Bekelman, A.B., Li, Y. and Gross, C.P. (2003). Scope and impact of financial conflicts of interest in biomedical research. Journal of the American Medical Association, 289, 454-465.
9. Bero, L.A., Glantz, S.A. and Rennie, D. (1994). Publication bias and public health policy on environmental tobacco smoke. Journal of the American Medical Association, 272, 133-136.
10. Blumenthal, D., Campbell, E.G., Causino, N. and Louis, K.S. (1996a). Participation of life-science faculty in research relationships with industry. New England Journal of Medicine, 335, 1734-1739.
11. Blumenthal, D., Causino, N., Campbell, E.G. and Louis, K.S. (1996b). Relationships between academic institutions and industry in the life sciences -an industry survey. New England Journal of Medicine, 334, 368-373.
12. Blumenthal, D., Campbell, E.G., Anderson, M.S., Causino, N. and Louis, K.S. (1997). Withholding research results in academic life science: Evidence from a national survey of faculty. Journal of the American Medical Association, 277, 1224-1228.
13. Boyd, K. (2001). Early discontinuation violates Helsinki principles. British Medical Journal, 322, 605-606.
14. Campbell, E.G., Clarridge, B.R., Gokhale, M., Birenbaum, L., Hilgartner, S., Holtzman, N.A. and Blumenthal, D. (2002). Data withholding in academic genetics. Evidence from a national survey. Journal of the American Medical Association, 287, 473-480.
15. Cho, M.K. and Bero, L.A. (1996). The quality of drug studies published in symposium proceedings. Annals of Internal Medicine, 124, 485-489.
16. Cooper, H., DeNeve, K. and Charlton, K. (1997). Finding the missing science: The fate of studies submitted for review by a human subjects committee. Psychological Methods, 2, 447-452.
17. Davidoff, F., DeAngelis, C.D., Drazen, J.M., Nicholls, M.G., Hoey, J., Højgaard, L. et al. (2001). Sponsorship, authorship, accountability. Annals of Internal Medicine, 135, 463.
18. Davidson, R.A. (1986). Source of funding and outcome of clinical trials. Journal of General Internal Medicine, 1, 155-158.
19. DeAngelis, C.D. (2000). Conflict of interest and the public trust. Journal of the American Medical Association, 284, 2237-2238.
20. DeAngelis, C.D., Fontanarosa, P.B. and Flanagin, A. (2001). Reporting financial conflicts of interest and relationships between investigators and research sponsors. Journal of the American Medical Association, 286, 89-91.
21. Department of Health and Human Services (1991). Common Rule, 45 CFR 46. Federal policy for the protection of human subjects. http://www.hhs.gov/ohrp/humansubjects/guidance/45cfr46.htm (accessed 16 May 2005).
22. Dickersin, K. (1990). The existence of publication bias and risk factors for its occurrence. Journal of the American Medical Association, 263, 1385-1389.
23. Dickersin, K., Min, Y.-I. and Meinert, C.L. (1992). Factors influencing publication of research results: Follow-up of applications submitted to two institutional review boards. Journal of the American Medical Association, 267, 374-378.
24. Djulbegovic, B., Bennett, C.L. and Lyman, G.H. (1999). Violation of the uncertainty principle in conduct of randomized controlled trials (RCTs) of erythropoieten. Blood, 94, 399a.
25. Djulbegovic, B., Lacevic, M., Cantor, A., Fields, K.K., Bennett, C.L., Adams, J.R., Kuderer, N.M. and Lyman, G.H. (2000). The uncertainty principle and industrysponsored research. Lancet, 356, 635-638.
26. Dong, B.J., Hauck, W.W., Gambertoglio, J.G., Gee, L., White, J.R., Bubp, J.L. and Greenspan, F.S. (1997). Bioequivalence of generic and brand-name levothyroxine products in the treatment of hypothyroidism. Journal of the American Medical Association, 277, 1205-1213.
27. Drazen, J.M. and Curfman, G.D. (2002). Financial associations of authors. New England Journal of Medicine, 346, 1901-1902.
28. Duval, S. and Tweedie, R. (2000a). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89-98.
29. Duval, S. and Tweedie, R. (2000b). Trim and fill: A simple funnel-plot-based method of testing adjusting for publication bias in meta-analysis. Biometrics, 56, 455-463.
30. Easterbrook, P.J., Berlin, J.A., Gopalan, R. and Matthews, D.R. (1991). Publication bias in clinical research. Lancet, 337, 867-872.
31. Egger, M., Smith, G.D., Schneider, M. and Minder, C. (1997). Bias in meta-analysis detected by a simple graphical test. British Medical Journal, 315, 629-634.
32. Emmanuel, E.J., Wendler, D. and Grady, C. (2000). What makes clinical research ethical? Journal of the American Medical Association, 283, 2701-2711.
33. Evans, S. and Pocock, S. (2001). Societal responsibilities of clinical trial sponsors. British Medical Journal, 322, 569-570.
34. Freedman, B. (1987). Scientific value and validity as ethical requirements for research: A proposed explication. IRB: Review of Human Subjects Research, 9(6), 7-10.
35. Friedberg, M., Saffran, B., Stinson, T.J., Nelson, W. and Bennett, C.L. (1999). Evaluation of conflict of interest in economic analyses of new drugs used in oncology. Journal of the American Medical Association, 282, 1453-1457.
36. Garattini, S. and Liberati, A. (2000). The risk of bias from omitted research. British Medical Journal, 321, 845-846.
37. Halpern, S.D. & Karlawish, J.H.T. (2000). Industry-sponsored research [letter]. Lancet, 356, 2193.
38. Halpern, S.D., Karlawish, J.H.T. and Berlin, J.A. (2002a). The continuing unethical conduct of underpowered clinical trials. Journal of the American Medical Association, 288, 358-362.
39. Halpern, S.D., Karlawish, J.H.T. and Berlin, J.A. (2002b). The ethics of underpowered clinical trials [letter]. Journal of the American Medical Association, 288, 2118-2119.
40. Hopf, G. (1997). Early stopping of trials. Lancet, 350, 891.
41. Horton, R. (2000). The less acceptable face of bias. Lancet, 356, 959-960.
42. Hunt, M. (1999). The New Know-Nothings. The Political Foes of the Scientific Study of Human Nature. New Brunswick, NJ: Transaction Publishers.
43. Ioannidis, J.P.A. (1998). Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. Journal of the American Medical Association, 279, 281-286.
44. James, A. and Horton, R. (2003). The Lancet’s policy on conflicts of interest. Lancet, 361, 8-9.
45. Johansen, H.K. and Gotzsche, P.C. (1999). Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. Journal of the American Medical Association, 282, 1752-1759.
46. Kahn, J.O., Cherng, D.W., Mayer, K., Murray, H. and Lagakos, S. (2000). Evaluation of HIV-1 Immunogen, an immunologic modifier, administered to patients infected with HIV having 300 to 549 ×106/L CD4 cell counts. Journal of the American Medical Association, 284, 2193-2202.
47. Kjaergard, L.L. and Als-Nielsen, B. (2002). Association between competing interests and authors’ conclusions: Epidemiological study of randomized clinical trials published in the BMJ. British Medical Journal, 325, 249-252.
48. Koshland, D.E. (1992). Conflict of interest policy. Science, 257, 595.
49. Kotelchuck, D. (1974). Asbestos research: Winning the battle but losing the war. Health/PAC Bulletin, 61 (Nov.-Dec.), 1-27.
50. Langer, A. (1997). Early stopping of trials. Lancet, 350, 890-891.
51. Lauritsen, K., Havelund, T., Larsen, L.S. and Rask-Madsen, J. (1987). Withholding unfavourable results in drug company sponsored clinical trials. Lancet, i, 1091.
52. Levinsky, N.G. (2002). Nonfinancial conflicts of interest in research. New England Journal of Medicine, 347, 759-761.
53. Lièvre, M., Ménard, J., Bruckert, E., Cogneau, J., Delahaye, F., Giral, P. et al. (2001). Premature discontinuation of clinical trial for reasons not related to efficacy, safety, or feasibility. British Medical Journal, 322, 603-605.
54. Marshall, E. (1992). The perils of a deeply held point of view. Science, 257, 621-622.
55. National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. (1979). The Belmont Report. Ethical Principles and Guidelines for the Protection of Human Subjects of Research. Washington, DC: US Government Printing Office.
56. Olivieri, N.F., Brittenham, G.M., McLaren, C.E., Templeton D.M., Cameron, R.G. and McClelland, R.A. (1998). Long-term safety and effectiveness of iron-chelation therapy with deferiprone for thalassemia major. New England Journal of Medicine, 339, 417-423.
57. Rennie, D. (1997). Thyroid storm. Journal of the American Medical Association, 277, 1238-1243.
58. Rochon, P.A., Gurwitz, J.H., Simms, R.W., Fortin, P.R., Felson, D.T., Minaker, K.L. and Chalmers, T.C. (1994). A study of manufacturer-supported trials of nonsteroidal antiinflammatory drugs in the treatment of arthritis. Archives of Internal Medicine, 154, 157-163.
59. Rosenberg, S.A. (1996). Secrecy in medical research. New England Journal of Medicine, 334, 393-394.
60. Rothman, K.J. (1993). Conflict of interest: The new McCarthyism in science. Journal of the American Medical Association, 269, 2782-2784.
61. Schulz, K.F., Chalmers, I., Hayes, R.J. and Altman, D.G. (1995). Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Journal of the American Medical Association, 273, 408-412.
62. Smith, M.L. (1980). Sex bias in counseling and psychotherapy. Psychological Bulletin, 87, 392-407.
63. Spurgeon, D. (1998). Trials sponsored by drug companies: Review ordered. British Medical Journal, 317, 618.
64. Stelfox, H.T., Chua, G., O’Rourke, K. and Detsky, A.S. (1998). Conflict of interest in the debate over calcium-channel antagonists. New England Journal of Medicine, 338, 101-106.
65. Sterne, J.A.C., Egger, M. and Smith, G.D. (2001). Investigating and dealing with publication and other biases in meta-analysis. British Medical Journal, 323, 101-105.
66. Thompson, D.F. (1993). Understanding financial conflicts of interest. New England Journal of Medicine, 329, 573-576.
67. Viberti, G., Slama, G., Pozza, G., Czyzyk, A., Bilous, R.W., Gries, A. et al. (1997). Early closure of European Pimagedine trial. Lancet, 350, 214-215.
68. Vogel, G. (1997). Long-suppressed study finally sees light of day. Science, 276, 523-525.
69. Wahlbeck, K. and Adams, C. (1999). Beyond conflict of interest. Sponsored drug trials show more favorable outcomes. British Medical Journal, 318, 465.
70. Yaphe, J., Edman, R., Knishkowy, B. and Herman, J. (2001). The association between funding by commercial interests and study outcome in randomized controlled drug trials. Family Practice, 18, 565-568.