Sources of error in the retracted scientific literature

FASEB Journal

Volumn 28, Issue 9, 2014, Pages 3847-3855

  Casadevall, Arturo ^a   Steen, R Grant ^b   Fang, Ferric C ^c  

^a ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^b MediCC Medical Communications Consultants   (United States)

^c UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

Author keywords

Bibliometric analysis; Biomedical publishing; Ethics

Indexed keywords

ANALYTICAL ERROR; ARTICLE; HUMAN; LABORATORY TEST; MEDLINE; MOLECULAR BIOLOGY; PROFESSIONAL MISCONDUCT; PUBLICATION; SCIENTIFIC LITERATURE; INFORMATION DISSEMINATION; METHODOLOGY; PUBLISHING; SCIENTIFIC MISCONDUCT; STANDARDS;

HUMANS; INFORMATION DISSEMINATION; PERIODICALS AS TOPIC; RESEARCH DESIGN; RETRACTION OF PUBLICATION AS TOPIC; SCIENTIFIC MISCONDUCT;

EID: 84904726515     PISSN: 08926638     EISSN: 15306860     Source Type: Journal    
DOI: 10.1096/fj.14-256735     Document Type: Article

References (81)

1. Jefferson T (1792) Letter to George Washington, 16 May 1792, Philadelphia, PA
2. Begley, C. G., and Ellis, L. M. (2012) Drug development: Raise standards for preclinical cancer research. Nature 483, 531-533
3. Prinz, F., Schlange, T., and Asadullah, K. (2011) Believe it or not: how much can we rely on published data on potential drug targets? Nat. Rev. Drug Discov. 10, 712
4. Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A. W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., Ghersi, D., Ioannidis, J. P., Simes, J., and Williamson, P. R. (2008) Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One 3, e3081
5. McGauran, N., Wieseler, B., Kreis, J., Schuler, Y. B., Kolsch, H., and Kaiser, T. (2010) Reporting bias in medical research - a narrative review. Trials 11, 37
6. Button, K. S., Ioannidis, J. P., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S., and Munafo, M. R. (2013) Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14, 365-376
7. Rosmalen, J. G., and Oldehinkel, A. J. (2011) The role of group dynamics in scientific inconsistencies: a case study of a research consortium. PLoS Med 8, e1001143
8. Johnson, V. E. (2013) Revised standards for statistical evidence. Proc. Natl. Acad. Sci. U. S. A. 110, 19313-19317
9. Fang, F. C., Steen, R. G., and Casadevall, A. (2012) Misconduct accounts for the majority of retracted scientific publications. Proc. Natl. Acad. Sci. U. S. A. 109, 17028-17033
10. Casadevall, A., and Fang, F. C. (2013, June 5) Science, heal thyself. Project Syndicate http://www.project-syndicate.org
11. Anonymous. (2013, October 19) Unreliable research: trouble at the lab. Economist http://www.economist.com/news/briefing/21588057-scientists-think-science-self-correcting-alarming-degree-it-nottrouble
12. Anonymous (2013, October 17) Problems with scientific research: how science goes wrong. Economist http://www.economist.com/news/leaders/21588069-scientific-research-has-changed-world-now-it-needs-change-itself-how-science-goes-wrong
13. Johnson, G. (2014, January 20) New truths that only one can see. New York Times http://www.nytimes.com/2014/01/21/science/new-truths-that-only-one-can-see.html?-r=0
14. Fang, F. C., and Casadevall, A. (2011) Retracted science and the retraction index. Infect. Immun. 79, 3855-3859
15. Zarychanski, R., Abou-Setta, A. M., Turgeon, A. F., Houston, B. L., McIntyre, L., Marshall, J. C., and Fergusson, D. A. (2013) Association of hydroxyethyl starch administration with mortality and acute kidney injury in critically ill patients requiring volume resuscitation: a systematic review and meta-analysis. JAMA 309, 678-688
16. Husten L (2013, July 31) How heart guidelines based on disgraced research may have caused thousands of deaths. Forbes http://www.forbes.com/sites/larryhusten/2013/07/31/european-heart-guidelines-based-on-disgraced-research-may-have-caused-thousands-of-deaths/
17. Steen, R. G., Casadevall, A., and Fang, F. C. (2013) Why has the number of scientific retractions increased? PLoS One 8, e68397
18. Fanelli, D. (2013) Why growing retractions are (mostly) a good sign. PLoS Med 10, e1001563
19. Casadevall, A., and Fang, F. C. (2012) Reforming science: methodological and cultural reforms. Infect. Immun. 80, 891-896
20. Struys, M. M., Fechner, J., Schuttler, J., and Schwilden, H. (2010) Erroneously published fospropofol pharmacokinetic-pharmacodynamic data and retraction of the affected publications. Anesthesiology 112, 1056-1057
21. Quik, M., Cook, R. G., Revah, F., Changeux, J. P., and Patrick, J. (1993) Presence of α-cobratoxin and phospholipase A2 activity in thymopoietin preparations. Mol. Pharmacol. 44, 678-679
22. Nardone, R. M. (2007) Eradication of cross-contaminated cell lines: a call for action. Cell Biol. Toxicol. 23, 367-372
23. Rojas, A., Gonzalez, I., and Figueroa, H. (2008) Cell line cross-contamination in biomedical research: a call to prevent unawareness. Acta Pharmacol. Sin. 29, 877-880
24. Knight, L. A., and Cree, I. A. (2011) Quality assurance and good laboratory practice. Methods. Mol. Biol. 731, 115-124
25. Barallon, R., Bauer, S. R., Butler, J., Capes-Davis, A., Dirks, W. G., Elmore, E., Furtado, M., Kline, M. C., Kohara, A., Los, G. V., MacLeod, R. A., Masters, J. R., Nardone, M., Nardone, R. M., Nims, R. W., Price, P. J., Reid, Y. A., Shewale, J., Sykes, G., Steuer, A. F., Storts, D. R., Thomson, J., Taraporewala, Z., Alston-Roberts, C., and Kerrigan, L. (2010) Recommendation of short tandem repeat profiling for authenticating human cell lines, stem cells, and tissues. In Vitro Cell. Dev. Biol. Anim. 46, 727-732
26. Nelson-Rees, W. A., Daniels, D. W., and Flandermeyer, R. R. (1981) Cross-contamination of cells in culture. Science 212, 446-452
27. Drexler, H. G., Dirks, W. G., Matsuo, Y., and MacLeod, R. A. (2003) False leukemia-lymphoma cell lines: an update on over 500 cell lines. Leukemia 17, 416-426
28. MacLeod, R. A., Dirks, W. G., Matsuo, Y., Kaufmann, M., Milch, H., and Drexler, H. G. (1999) Widespread intraspecies cross-contamination of human tumor cell lines arising at source. Int. J. Cancer 83, 555-563
29. Capes-Davis, A., Theodosopoulos, G., Atkin, I., Drexler, H. G., Kohara, A., MacLeod, R. A., Masters, J. R., Nakamura, Y., Reid, Y. A., Reddel, R. R. Freshney, R. I. (2010) Check your cultures! A list of cross-contaminated or misidentified cell lines. Int. J. Cancer 127, 1-8
30. Phuchareon, J., Ohta, Y., Woo, J. M., Eisele, D. W., and Tetsu, O. (2009) Genetic profiling reveals cross-contamination and misidentification of 6 adenoid cystic carcinoma cell lines: ACC2, ACC3, ACCM, ACCNS, ACCS and CAC2. PLoS One 4, e6040
31. Miller, G. (2006) Scientific publishing. A scientist's nightmare: software problem leads to five retractions. Science 314, 1856-1857
32. Rekers, H., and Affandi, B. (2004) Implanon studies conducted in Indonesia. Contraception 70, 433
33. Joppa, L. N., McInerny, G., Harper, R., Salido, L., Takeda, K., O'Hara, K., Gavaghan, D., and Emmott, S. (2013) Computational science. troubling trends in scientific software use. Science 340, 814-815
34. Vasilevsky, N. A., Brush, M. H., Paddock, H., Ponting, L., Tripathy, S. J., Larocca, G. M., and Haendel, M. A. (2013) On the reproducibility of science: unique identification of research resources in the biomedical literature. Peer J. 1, e148
35. Ram, K. (2013) Git can facilitate greater reproducibility and increased transparency in science. Source Code Biol. Med. 8, 7
36. Ter Riet, G., Korevaar, D. A., Leenaars, M., Sterk, P. J., Van Noorden, C. J., Bouter, L. M., Lutter, R., Elferink, R. P., and Hooft, L. (2012) Publication bias in laboratory animal research: a survey on magnitude, drivers, consequences and potential solutions. PLoS One 7, e43404
37. Loscalzo, J. (2012) Irreproducible experimental results: causes, (mis)interpretations, and consequences. Circulation 125, 1211-1214
38. Couzin-Frankel, J. (2012) Research quality. Service offers to reproduce results for a fee. Science 337, 1031
39. Brown, E. N., and Ramaswamy, S. (2007) Quality of protein crystal structures. Acta Crystallogr. D Biol. Crystallogr. 63, 941-950
40. MacArthur, D. (2012) Methods: face up to false positives. Nature 487, 427-428
41. Wager, E., and Williams, P. (2011) Why and how do journals retract articles? An analysis of Medline retractions 1988-2008. J. Med. Ethics 37, 567-570
42. Grcar, J. (2013) Comments and corrigenda in scientific literature. Am. Scientist 101, 16
43. Chow, Y. K., Hirsch, M. S., Merrill, D. P., Bechtel, L. J., Eron, J. J., Kaplan, J. C., and D'Aquila, R. T. (1993) Use of evolutionary limitations of HIV-1 multidrug resistance to optimize therapy. Nature 361, 650-654
44. Larder, B. A., Kellam, P., and Kemp, S. D. (1993) Convergent combination therapy can select viable multidrug-resistant HIV-1 in vitro. Nature 365, 451-453
45. Chow, Y. K., Hirsch, M. S., Kaplan, J. C., D'Aquila, R. T. (1993) HIV-1 error revealed. Nature 364, 679
46. Wolfe-Simon, F., Switzer Blum, J., Kulp, T. R., Gordon, G. W., Hoeft, S. E., Pett-Ridge, J., Stolz, J. F., Webb, S. M., Weber, P. K., Davies, P. C. Anbar, A. D., and Oremland, R. S. (2011) A bacterium that can grow by using arsenic instead of phosphorus. Science 332, 1163-1166
47. Erb, T. J., Kiefer, P., Hattendorf, B., Gunther, D., and Vorholt, J. A. (2012) GFAJ-1 is an arsenate-resistant, phosphate-dependent organism. Science 337, 467-470
48. Reaves, M. L., Sinha, S., Rabinowitz, J. D., Kruglyak, L., and Redfield, R. J. (2012) Absence of detectable arsenate in DNA from arsenate-grown GFAJ-1 cells. Science 337, 470-473
49. Alberts, B. (2011) Editor's note. Science 332, 1149
50. Tomkins, J. L., Penrose, M. A., Greeff, J., and Lebas, N. R. (2011) Retraction. Science 333, 1220
51. Traver, J. R. (1951) Unusual scalp dermatitis in humans caused by the mite, Dermatophagoides. (Acarine, Epidermoptidae). Proc. Entomol. Soc. Wash. 53, 1-25
52. Shelomi, M. (2013) Mad scientist: the unique case of a published delusion. Sci. Eng. Ethics 19, 381-388
53. Steinschneider, A. (1972) Prolonged apnea and the sudden infant death syndrome: clinical and laboratory observations. Pediatrics 50, 646-654
54. Pinholster, G. (1994) SIDS paper triggers a murder charge. Science 264, 197-198
55. Davenas, E., Beauvais, F., Amara, J., Oberbaum, M., Robinzon, B., Miadonna, A., Tedeschi, A., Pomeranz, B., Fortner, P., Belon, P., Sainte-Laudy, J., Poitevin, B., and Benvenise, J. (1988) Human basophil degranulation triggered by very dilute antiserum against IgE. Nature 333, 816-818
56. Maddox, J., Randi, J., and Stewart, W. W. (1988) "High-dilution" experiments a delusion. Nature 334, 287-291
57. Hirst, S. J., Hayes, N. A., Burridge, J., Pearce, F. L., and Foreman, J. C. (1993) Human basophil degranulation is not triggered by very dilute antiserum against human IgE. Nature 366, 525-527
58. Benveniste, J., Ducot, B., and Spira, A. (1994) Memory of water revisited. Nature 370, 322
59. Fleischmann, M., and Pons, S. (1989) Electrochemically induced nuclear fusion of deuterium. J. Electroanal. Chem. 261, 301-308
60. Fleischmann M, Pons S, Hawkins M (1989) Errata. J. Electroanal. Chem. 263, 187-188
61. Miskelly, G. M., Heben, M. J., Kumar, A., Penner, R. M., Sailor, M. J., and Lewis, N. S. (1989) Analysis of the published calorimetric evidence for electrochemical fusion of deuterium in palladium. Science 246, 793-796
62. Salamon, M. H. M. W., Bergeson, H. E., Crawford, H. C., Delaney, W. H., Henderson, C. L., Li, Y. Q., Rusho, J. A., Sandquist, G. M., and Seltzer, S. M. (1990) Limits on the emission of neutrons, γ-rays, electrons and protons from Pons/ Fleischmann electrolytic cells. Nature 344, 401-405
63. Bagenal, F. S., Easton, D. F., Harris, E., Chilvers, C. E., and McElwain, T. J. (1990) Survival of patients with breast cancer attending Bristol Cancer Help Centre. Lancet 336, 606-610
64. Goodare, H. (1994) The scandal of poor medical research. Wrong results should be withdrawn. Br. Med. J. 308, 593
65. Emini, E. A., Graham, D. J., Gotlib, L., Condra, J. H., Byrnes, V. W., and Schleif, W. A. (1993) HIV and multidrug resistance. Nature 364, 679
66. Bellgrau, D., Gold, D., Selawry, H., Moore, J., Franzusoff, A., and Duke, R. C. (1995) A role for CD95 ligand in preventing graft rejection. Nature 377, 630-632
67. Yagita, H., Seino, K., Kayagaki, N., and Okumura, K. (1996) CD95 ligand in graft rejection. Nature 379, 682
68. Allison, J., Georgiou, H. M., Strasser, A., and Vaux, D. L. (1997) Transgenic expression of CD95 ligand on islet beta cells induces a granulocytic infiltration but does not confer immune privilege upon islet allografts. Proc. Natl. Acad. Sci. U. S. A. 94, 3943-3947
69. Kang, S. M., Schneider, D. B., Lin, Z., Hanahan, D., Dichek, D. A., Stock, P. G., and Baekkeskov, S. (1997) Fas ligand expression in islets of Langerhans does not confer immune privilege and instead targets them for rapid destruction. Nat. Med. 3, 738-743
70. Vaux, D. L. (1998) Immunology. Ways around rejection. Nature 394, 133
71. Gugliotti, L. A., Feldheim, D. L., and Eaton, B. E. (2004) RNA-mediated metal-metal bond formation in the synthesis of hexagonal palladium nanoparticles. Science 304, 850-852
72. Franzen, S., Cerruti, M., Leonard, D. N., and Duscher, G. (2007) The role of selection pressure in RNA-mediated evolutionary materials synthesis. J. Am. Chem. Soc. 129, 15340-15346
73. Neff, J. (2014, January 19) NC State professor uncovers problems in lab journal. News & Observer http://www.newsobserver.com/2014/01/19/3544566/in-a-notebook-at-nc-state-a-smoking.html
74. Labandeira-Rey, M., Couzon, F., Boisset, S., Brown, E. L., Bes, M., Benito, Y., Barbu, E. M., Vazquez, V., Hook, M., Etienne, J. Vandenesch, F., Bowden, M. G. (2007) Staphylococcus aureus Panton-Valentine leukocidin causes necrotizing pneumonia. Science 315, 1130-1133
75. Villaruz, A. E., Bubeck Wardenburg, J., Khan, B. A., Whitney, A. R., Sturdevant, D. E., Gardner, D. J., DeLeo, F. R., and Otto, M. (2009) A point mutation in the agr locus rather than expression of the Panton-Valentine leukocidin caused previously reported phenotypes in Staphylococcus aureus pneumonia and gene regulation. J. Infect. Dis. 200, 724-734
76. Wyatt, M. A., Wang, W., Roux, C. M., Beasley, F. C., Heinrichs, D. E., Dunman, P. M., and Magarvey, N. A. (2010) Staphylococcus aureus nonribosomal peptide secondary metabolites regulate virulence. Science 329, 294-296
77. Wyatt, M. A., Wang, W., Roux, C. M., Beasley, F. C., Heinrichs, D. E., Dunman, P. M., and Magarvey, N. A. (2011) Clarification of "Staphylococcus aureus nonribosomal peptide secondary metabolites regulate virulence." Science 333, 1381
78. Sun, F., Cho, H., Jeong, D. W., Li, C., He, C., and Bae, T. (2010) Aureusimines in Staphylococcus aureus are not involved in virulence. PLoS One 5, e15703
79. Regan, M. M., Leyland-Jones, B., Bouzyk, M., Pagani, O., Tang, W., Kammler, R., Dell'orto, P., Biasi, M. O., Thurlimann, B., Lyng, M. B., Ditzel, H. J., Neven, P., Debled, M., Maibach, R., Price, K. N., Gelber, R. D., Coates, A. S., Goldhirsch, A., Rae, J. M., Viale, G., and Breast International Group (BIG) 1-98 Collaborative Group. (2012) CYP2D6 genotype and tamoxifen response in postmenopausal women with endocrine-responsive breast cancer: the breast international group 1-98 trial. J. Natl. Cancer Inst. 104, 441-451
80. Nakamura, Y., Ratain, M. J., Cox, N. J., McLeod, H. L., Kroetz, D. L., and Flockhart, D. A. (2012) Re: CYP2D6 genotype and tamoxifen response in postmenopausal women with endocrine-responsive breast cancer: the Breast International Group 1-98 trial. J. Natl. Cancer Inst. 104, 1264
81. Atkinson, I. (2012) Accuracy of data transfer: double data entry and estimating levels of error. J. Clin. Nurs. 21, 2730-2735