Unknown unknowns in biomedical research: Does an inability to deal with ambiguity contribute to issues of irreproducibility?

Biochemical Pharmacology

Volumn 97, Issue 2, 2015, Pages 133-136

  Mullane, Kevin ^a   Williams, Michael ^b  

^a Profectus Pharma Consulting   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Peer review; Reagent validation; Reproducibility, unknown unknowns

Indexed keywords

AMBIGUITY; ARTICLE; AWARENESS; CANCER CELL LINE; FUNDING; HUMAN; MEDICAL RESEARCH; PEER REVIEW; POLICY; PRIORITY JOURNAL; PUBLICATION; REPRODUCIBILITY; RESPONSIBILITY; AGE; STANDARDS;

AGE FACTORS; BIOMEDICAL RESEARCH; HUMANS; PEER REVIEW, RESEARCH; REPRODUCIBILITY OF RESULTS;

EID: 84940592606     PISSN: 00062952     EISSN: 18732968     Source Type: Journal    
DOI: 10.1016/j.bcp.2015.07.002     Document Type: Note

References (59)

1. C.G. Begley, and L.M. Ellis Drug development: raise standards for preclinical cancer research Nature 483 2012 531 533
2. A. Von Bubnoff, Special Report Biomedical research: Are All the Results Correct? Burroughs Wellcome Fund, March 31, 2014 http://www.bwfund.org/newsroom/newsletter-articles/special-report-biomedical-research-are-all-results-correct.
3. C.G. Begley, and J.P.A. Ioannidis Reproducibility in science improving the standard for basic and preclinical research Circ. Res. 116 2015 116 126
4. K. Mullane, and M. Williams Translational semantics and infrastructure: another search for the emperor's new clothes Drug Discov. Today 17 2012 459 468
5. J.P.A. Ioannidis, and M.J. Khoury Assessing value in biomedical research: the PQRST of appraisal and reward JAMA 312 2015 483 484
6. B. Alberts, M.W. Kirschner, S. Tilghman, and H. Varmus Rescuing US biomedical research from its systemic flaws Proc. Natl. Acad. U. S. A. 111 2014 5773 5777
7. M. Kaiser The integrity of science-lost in translation? Best Pract. Res. Clin. Gastroenterol. 28 2014 339 347
8. B.K. Redman, Are the Biomedical Sciences Sliding Toward Institutional Corruption? And Why Didn't We Notice It? Edmond J. Safra Working Papers, No. 59. Harvard University, March 25, 2015 http://dx.doi.org/10.2139/ssrn.2585141.
9. A. Wendler, and M. Wehling Translatability scoring in drug development: eight case studies J. Transl. Med. 10 2012 39
10. F. Vincent, P. Loria, M. Pregel, R. Stanton, K. Kitching, K. Nocka, and et al. Developing predictive assays: phenotypic screening rule of 3 Sci. Transl. Med. 7 2015 293ps15
11. M. Kirschner A perverted view of impact Science 340 2013 1265
12. J.P.A. Ioannidis Why most published research findings are false PLoS Med. 2005 e124
13. M. Wadman NIH mulls rules for validating key results Nature 500 2013 14 16
14. F.S. Collins, and L.A. Tabak Policy NIH plans to enhance reproducibility Nature 505 2014 612 613
15. F.C. Fang, R.G. Steen, and A. Casadevall Misconduct accounts for the majority of retracted scientific publications Proc. Natl. Acad. U. S. A. 109 2012 17028 17033
16. D.S.P. Kornfeld Perspective research misconduct: the search for a remedy Acad. Med. 87 2012 877 882
17. J. Neimark Line of attack Science 347 2015 938 940
18. M. Baker Blame it on the antibodies Nature 521 2015 274 276
19. M. Marino The use and misuse of statistical methodologies in pharmacology research Biochem. Pharmacol. 87 2014 78 92
20. H. Motulsky Editorial common misconceptions about data analysis and statistics J. Pharmacol. Exp. Ther. 351 2014 200 205
21. D. Colquhoun An investigation of the false discovery rate and the misinterpretation of p-values Roy Soc. Open Sci. 1 2015 140216
22. NIH. Principles and Guidelines for Reporting Preclinical Research. February 19, 2015. http://www.nih.gov/about/reporting-preclinical-research.htm.
23. NIH. Enhancing Reproducibility through Rigor and Transparency June 9, 2015. http://grants.nih.gov/grants/guide/notice-files/NOT-OD-15-103html#sthash.1qh4Pu1Y.dpuf.
24. M.J. Curtis, R.A. Bond, D. Spina, A. Ahluwalia, S.P.A. Alexander, M.A. Giembycz, and et al. Experimental design and analysis and their reporting: new guidance for publication in BJP Br. J. Pharmacol. 172 2015 3461 3471
25. K. Mullane, S.J. Enna, J. Piette, and M. Williams Guidelines for manuscript submission in the peer-reviewed pharmacological literature Biochem. Pharmacol. 2015 10.1016/j.bcp.2015.06.023 (in press)
26. R.M. Nardone Curbing rampant cross-contamination and misidentification of cell lines Biotechniques 45 2008 221 227
27. L. Tabak, Quoted in Fishburn CS. Repairing reproducibility. SciBX, 2014, 7, March, 13 http://www.nature.com/scibx/journal/v7/n10/full/scibx.2014.275html.
28. S. Kerr On the folly of rewarding A, while hoping for B Acad. Manag. Exec. 9 1995 7 14
29. Editorial The greater good. Nature 2014. 505, 5.
30. M. Yu, S.K. Selvaraj, M.M. Liang-Chu, S. Aghajani, M. Busse, J. Yuan, and et al. A resource for cell line authentication, annotation and quality control Nature 520 2015 307 311
31. A. Bradbury, and A. Pluckthun Standardize antibodies used in research Nature 518 2015 27 29
32. J. Neimark The dirty little secret of cancer research Discover October 2014 http://discovermagazine.com/2014/nov/20-trial-and-error
33. L.P. Freedman, I.M. Cockburn, and T.S. Simcoe The economics of reproducibility in preclinical research PLoS Biol. 13 2015 e1002165
34. L.G. Halsey, D. Curran-Everett, S.L. Vowler, and G.B. Drummond The fickle P value generates irreproducible results Nat. Methods 12 2015 179 185
35. D.J. Biau, B.M. Jolles, and R. Porcher P value and the theory of hypothesis testing: an explanation for new researchers Clin. Orthop. Relat. Res. 468 2010 885 892
36. J. Ware, and M. Munafo Significance chasing in research practice: causes, consequences, and possible solutions Addiction 110 2015 4 8
37. D.P. Lovell Biological importance and statistical significance J. Agric. Food Chem. 61 2013 8340 8348
38. D.A. Graham, Rumsfeld's Knowns and Unknowns: The Intellectual History of a Quip. Atlantic Magazine, March 27, 2014. http://www.theatlantic.com/politics/archive/2014/03/rumsfelds-knowns-and-unknowns-the-intellectual-history-of-a-quip/359719/.
39. A. Johnston, Only 15% of Fortune 500Companies Use Big Data Analytics To Look Beyond The 'Known-Knowns'-Why? Fortune. June 24, 2015. http://www.forbes.com/sites/teradata/2015/06/24/why-only-15-of-the-fortune-500-uses-big-data-analytics-to-look-beyond-the-known-knowns/.
40. J.W. Scannell, A. Blanckley, H. Boldon, and B. Warrington Diagnosing the decline in pharmaceutical R&D efficiency Nat. Rev. Drug Discov. 11 2012 191 200
41. S.M. Paul, D.S. Mytelka, C.T. Dunwiddie, C.C. Persinger, B.H. Munos, S.R. Lindborg, and et al. How to improve R&D productivity: the pharmaceutical industry's grand challenge Nat. Rev. Drug Discov. 9 2010 203 214
42. D. Lowe, Andy Grove's Idea For Opening Up Clinical Trials. In the Pipeline, September 28, 2011. http://pipeline.corante.com/archives/2011/09/28/andy-groves-idea-for-opening-up-clinical-trials.php.
43. C.A. Lipinski Drug-like properties and the causes of poor solubility and poor permeability Adv. Drug Deliv. Rev. 23 1997 3 25
44. M.J. Waring, J. Arrowsmith, A.R. Leach, PD, S. Mandrell, R.M. Owen, and et al. An analysis of the attrition of drug candidates from four major pharmaceutical companies Nat. Rev. Drug Discov. 14 2015 475 486
45. D.C. Swinney, and J. Anthony How were new medicines discovered Nat. Rev. Drug Discov. 10 2011 507 519
46. S.J. Enna, and M. Williams Challenges in the search for drugs to treat central nervous system disorders J. Pharmacol. Exp. Ther. 329 2009 404 411
47. W.L. Kraus Editorial do you see what i see? quality, reliability, and reproducibility in biomedical research Mol. Endocrinol. 38 2014 277 280
48. D.J. Triggle Nous sommes tous des bacteries: implications for medicine, pharmacology and public health Biochem. Pharmacol. 84 2012 1543 1550
49. R.D. Moloney, L. Desbonnet, G. Clarke, T.G. Dinan, and J.F. Cryan The microbiome: stress, health and disease Mamm. Genome 25 2014 49 74
50. E. Dzeng, How Academia and Publishing are Destroying Scientific Innovation: A Conversation with Sydney Brenner. King's Rev. February 24th, 2014. http://kingsreview.co.uk/magazine/blog/2014/02/24/how-academia-and-publishing-are-destroying-scientific-innovation-a-conversation-with-sydney-brenner/.
51. Rasko J, Power C. What pushes scientists to lie? The disturbing but familiar story of Haruko Obokata. Guardian, July 25, 2015. http://www.theguardian.com/science/2015/feb/18/haruko-obokata-stap-cells-controversy-scientists-lie.
52. S. Rockey, Age Distribution of NIH Principal Investigators and Medical School Faculty. NIH Extramural Nexus. February 13, 2012. http://nexus.od.nih.gov/all/2012/02/13/age-distribution-of-nih-principal-investigators-and-medical-school-faculty/.
53. R. Barr, R01 teams and grantee age trends in grant funding. Inside NIA Blog. April 22, 2015. https://www.nia.nih.gov/research/blog/2015/04/r01-teams-and-grantee-age-trends-grant-funding.
54. B. Alberts, R.J. Cicerone, S.E. Fienberg, A. Kamb, M. McNutt, R.M. Nerem, and et al. Self-correction in science at work Science 348 2015 1420 1422
55. D.J. Triggle, and K.W. Miller Doctoral education: another tragedy of the commons Am. J. Pharm. Educ. 66 2002 287 294
56. G. Leef True or false: America desperately needs more STEM workers Forbes 6 June 2014 http://www.forbes.com/sites/georgeleef/2014/06/06/true-or-false-america-desperately-needs-more-stem-workers/
57. A. Hacker, The frenzy about high-tech talent. New York Rev Books. July 9, 2015. http://www.nybooks.com/articles/archives/2015/jul/09/frenzy-about-high-tech-talent/.
58. E.C. Friedburg An interview with Sydney Brenner Nat. Rev. Mol. Cell Biol. 9 2008 8 9
59. J.L. Jameson Disruptive innovation as a driver of science and medicine J. Clin. Invest. 124 2014 2822 2826