Food for thought; Look back in anger - What clinical studies tell us about preclinical work

Altex

Volumn 30, Issue 3, 2013, Pages 275-291

  Hartung, Thomas ^a,b  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b UNIVERSITY OF KONSTANZ   (Germany)

Author keywords

Animal studies; In vitro studies; Preclinical studies; Safety pharmacology; Toxicology

Indexed keywords

ANGER; ARTICLE; BASIC RESEARCH; CLINICAL RESEARCH; CLINICAL TRIAL (TOPIC); CONFLICT; DRUG DEVELOPMENT; DRUG EFFICACY; DRUG INDUSTRY; GENOTOXICITY; GOOD LABORATORY PRACTICE; NONHUMAN; PHASE 2 CLINICAL TRIAL (TOPIC); PHASE 3 CLINICAL TRIAL (TOPIC); PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); ANIMAL; ANIMAL EXPERIMENT; ANIMAL TESTING ALTERNATIVE; CONFLICT OF INTEREST; DRUG APPROVAL; DRUG SCREENING; ETHICS; EUROPE; FOOD AND DRUG ADMINISTRATION; HUMAN; METHODOLOGY; MUTAGEN TESTING; STANDARD; STATISTICAL ANALYSIS; TOXICITY TESTING; UNITED STATES;

ANIMAL EXPERIMENTATION; ANIMAL TESTING ALTERNATIVES; ANIMALS; CONFLICT OF INTEREST; DATA INTERPRETATION, STATISTICAL; DRUG APPROVAL; DRUG EVALUATION, PRECLINICAL; DRUG INDUSTRY; EUROPE; HUMANS; MUTAGENICITY TESTS; RESEARCH DESIGN; TOXICITY TESTS; UNITED STATES; UNITED STATES FOOD AND DRUG ADMINISTRATION;

EID: 84883880887     PISSN: 1868596X     EISSN: 18688551     Source Type: Journal    
DOI: 10.14573/altex.2013.3.275     Document Type: Article

References (113)

1. Altman, D. G. (1994). The scandal of poor medical research. BMJ 308, 283-284.
2. Altman, D. G. (1998). Statistical reviewing for medical journals. Stat Med 17, 2661-267
3. Altman, D. G. (2002). Poor-quality medical research - what can journals do? JAMA 287, 2765-2767.
4. Andersen, B. (1990). Methodological errors in medical research: An Incomplete Catalogue (288pp). Chicago, USA: Blackwell Science Ltd.
5. Arrowsmith, J. (2011a). Trial watch: Phase II failures: 2008-2010. Nat Rev Drug Discov 10, 328-329.
6. Arrowsmith, J. (2011b). Trial watch: Phase III and submission failures: 2007-2010. Nat Rev Drug Discov 10, 87.
7. Arrowsmith, J. (2012). A decade of change. Nat Rev Drug Discov 11, 17-18.
8. Baker, D. D., Lidster, K. K., Sottomayor, A. A., and Amor, S. S. (2012). Reproducibility: Research-reporting standards fall short. Nature 492, 41.
9. Basketter, D. A., Clewell, H., Kimber, I., et al. (2012). A roadmap for the development of alternative (non-animal) methods for systemic toxicity testing - t4 report. ALTEX 29, 3-91.
10. Bebarta, V., Luyten, D., and Heard, K. (2003). Emergency medicine animal research: does use of randomization and blinding affect the results? Acad Emerg Med 10, 684-687.
11. Begley, C. G. and Ellis, L. M. (2012). Drug development: Raise standards for preclinical cancer research. Nature 483, 531-533.
12. Bekelman, J. E., Li, Y., and Gross, C. P. (2003). Scope and impact of financial conflicts of interest in biomedical research a systematic review. JAMA 289, 454-465.
13. Blakey, D., Galloway, S. M., Kirkland, D. J., and MacGregor, J. T. (2008). Regulatory aspects of genotoxicity testing: from hazard identification to risk assessment. Mutat Res 657, 84-90.
14. Bottini, A. A. and Hartung, T. (2009). Food for thought on the economics of animal testing. ALTEX 26, 3-16.
15. Bottini, A. A. and Hartung, T. (2010). The economics of animal testing. ALTEX 27, Spec Issue 1, 67-77.
16. Briel, M., Müller, K. F., Meerpohl, J. J., et al. (2013). Publication bias in animal research: a systematic review protocol. Syst Rev 2, 23.
17. Bruchmüller, I., Pirkl, E., Herrmann, R., et al. (2006). Introduction of a validation concept for a PCR-based Mycoplasma detection assay. Cytotherapy 8, 62-69.
18. Buehring, G. C., Eby, E. A., and Eby, M. J. (2004). Cell line cross-contamination: how aware are mammalian cell culturists of the problem and how to monitor it? In Vitro Cell Dev Biol Anim 40, 211-215.
19. Ciccone, A. and Candelise, L. (2003). Risk of cerebral haemorrhage after thrombolysis: Systematic review of animal stroke models. In Proceedings of the European Stroke Conference, Valencia, May 2003.
20. Coecke, S., Balls, M., Bowe, G., et al. (2005). Guidance on good cell culture practice. A report of the second ECVAM task force on good cell culture practice. ATLA 33, 261-287.
21. Cook, D. J., Mulrow, C. D., and Haynes, R. B. (1997). Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med 126, 376-380.
22. Cooper-Hannan, R., Harbell, J., and Coecke, S. (1999). The principles of Good Laboratory Practice: application to in vitro toxicology studies. ATLA 27, 539-577.
23. Corpet, D. E. and Pierre, F. (2003). Point: From animal models to prevention of colon cancer. Systematic review of chemoprevention in min mice and choice of the model system. Canc Epidemiol Biomarkers Prev 12, 391-400.
24. Corpet, D. E. and Pierre, F. (2005). How good are rodent models of carcinogenesis in predicting efficacy in humans? A systematic review and meta-analysis of colon chemoprevention in rats, mice and men. Eur J Cancer 41, 1911-1922.
25. Dabrazhynetskaya, A. A., Volokhov, D. V. D., David, S. W. S., et al. (2011). Preparation of reference strains for validation and comparison of mycoplasma testing methods. J Appl Microbiol 111, 904-914.
26. Dirks, W. G., Macleod, R. A. F., Nakamura, Y., et al. (2010). Cell line cross-contamination initiative: An interactive reference database of STR profiles covering common cancer cell lines. Int J Cancer 126, 303-304.
27. Drexler, H. G. and Uphoff, C. C. (2002). Mycoplasma contamination of cell cultures: Incidence, sources, effects, detection, elimination, prevention. Cytotechnology 39, 75-90.
28. Ersson, C., Moller, P., Forchhammer, L., et al. (2013). An ECVAG inter-laboratory validation study of the comet assay: inter-laboratory and intra-laboratory variations of DNA strand breaks and FPG-sensitive sites in human mononuclear cells. Mutagenesis 28, 279-286.
29. Fang, F. C., Steen, R. G., and Casadevall, A. (2012). Misconduct accounts for the majority of retracted scientific publications. Proc Natl Acad Sci U S A 109, 17028-17033.
30. Fellows, M. D., O'Donovan, M. R., Lorge, E., and Kirkland, D. (2008). Comparison of different methods for an accurate assessment of cytotoxicity in the in vitro micronucleus test. II: Practical aspects with toxic agents. Mutat Res 655, 4-21.
31. Fellows, M. D., Boyer, S., and O'Donovan, M. R. (2011). The incidence of positive results in the mouse lymphoma TK assay (MLA) in pharmaceutical screening and their prediction by MultiCase MC4PC. Mutagenesis 26, 529-532.
32. Festing, M. (2003). The need for better experimental design. Trends Pharmacol Sci 27, 341-345.
33. Fowler, P., Smith, K., Young, J., et al. (2012a). Reduction of misleading ("false") positive results in mammalian cell geno- toxicity assays. I. Choice of cell type. Mutat Res 742, 11-25.
34. Fowler, P., Smith, R., and Smith, K. (2012b). Reduction of misleading ("false") positive results in mammalian cell genotoxicity assays. II. Importance of accurate toxicity measurement. Mutat Res 747, 104-117.
35. Garner, C. M., Hubbold, L. M., and Chakraborti, P. R. (2000). Mycoplasma detection in cell cultures: a comparison of four methods. Br J Biomed Sci 57, 295-301.
36. Goldacre, B. (2012). Bad Pharma (448pp). London, UK: Fourth Estate.
37. Gollapudi, B. B., Schisler, M. R., McDaniel, L. P., and Moore, M. M (2012). Reevaluation of the U.S. National Toxicology Program's (NTP) mouse lymphoma forward mutation assay (MLA) data using current standards reveals limitations of using the program's summary calls. Toxicologist 126, 448 (abstract).
38. Hackam, D. G. and Redelmeier, D. A. (2006). Translation of research evidence from animals to humans. JAMA 296, 1731-1732.
39. Hackam, D. G. (2007). Translating animal research into clinical benefit. BMJ 334, 163-164.
40. Harrell, F. E. (2011). Reproducible research. Presentation available at: https://www.ctsacentral.org/sites/default/files/documents/berdrrhandout.pdf (accessed on June 9, 2013)
41. Hartung, T. (2007). Food for thought on cell culture. ALTEX 24, 143-152.
42. Hartung, T. (2008a). Food for thought - on animal tests. ALTEX 25, 3-9.
43. Hartung, T. (2008b). Food for thought on alternative methods for cosmetics safety testing. ALTEX 25, 147-162.
44. Hartung, T. (2009a). Food for thought on evidence-based toxicology. ALTEX 26, 75-82.
45. Hartung, T. (2009b). Toxicology for the twenty-first century. Nature 460, 208-212.
46. Hartung, T. (2009c). Per aspirin ad astra ATLA 37, Suppl 2, 45-47.
47. Hartung, T. and Hoffmann, S. (2009). Food for thought on in silico methods in toxicology. ALTEX 26, 155-166.
48. Hartung, T. (2010). Evidence-based toxicology - the toolbox of validation for the 21st century? ALTEX 27, 253-263.
49. Hartung, T. and Zurlo, J. (2012). Food for thought Alternative approaches for medical countermeasures to biological and chemical terrorism and warfare. ALTEX 29, 251-260.
50. Hay, R. J., Macy, M. L., and Chen, T. R. (1989). Mycoplasma infection of cultured cells. Nature 339, 487-488.
51. Helsel, D. R. (2006). Fabricating data: How substituting values for nondetects can ruin results, and what can be done about it. Chemosphere 65, 6.
52. Hoffmann, S. and Hartung, T. (2006). Toward an evidence-based toxicology. Hum Exp Toxicol 25, 497-513.
53. Hooijmans, C. R., Leenaars, M., and Ritskes-Hoitinga, M. (2010). A gold standard publication checklist to improve the quality of animal studies, to fully integrate the Three Rs, and to make systematic reviews more feasible. ATLA 38, 167-182.
54. Horn, J., de Haan, R. J., Vermeulen, M., et al. (2001). Nimodipine in animal model experiments of focal cerebral ischemia: a systematic review. Stroke 32, 2433-2438.
55. Hughes, P., Marshall, D., Reid, Y., et al. (2007). The costs of using unauthenticated, over-passaged cell lines: how much more data do we need? BioTechniques 43, 575-584.
56. Ioannidis, J. P. A. (2005a). Contradicted and initially stronger effects in highly cited clinical research. JAMA 294, 218-226.
57. Ioannidis, J. P. A. (2005b). Why most published research findings are false. PLoS Med 2, e124-e124.
58. Ioannidis, J. P. A. (2012). Extrapolating from animals to humans. Sci Transl Med 4, 151.
59. Kilkenny, C. C., Browne, W. J., Cuthill, I. C., et al. (2010). Improving bioscience research reporting: the ARRIVEguidelines for reporting animal research. PLoS Biol 8, e1000412.
60. Kirkland, D., Aardema, M., Henderson, L., and Müller, L. (2005). Evaluation of the ability of a battery of three in vitro genotoxicity tests to discriminate rodent carcinogens and non-carcinogens. Mutat Res 584, 1-256.
61. Kirkland, D., Pfuhler, S., Tweats, D., et al. (2007). How to reduce false positive results when undertaking in vitro genotoxicity testing and thus avoid unnecessary follow-up animal tests: Report of an ECVAM Workshop. Mutat Res 628, 31-55.
62. Kirkland, D. (2010a). Evaluation of different cytotoxic and cytostatic measures for the in vitro micronucleus test (MNVit): Introduction to the collaborative trial. Mutat Res 702, 139-147.
63. Kirkland, D. (2010b). Evaluation of different cytotoxic and cytostatic measures for the in vitro micronucleus test (MNVit): Summary of results in the collaborative trial. Mutat Res 702, 135-138.
64. Knight, A. (2007). Systematic reviews of animal experiments demonstrate poor human clinical and toxicological utility. ATLA 35, 641-659.
65. Landry, J. J. M., Pyl, P. T., Rausch, T., et al. (2013). The genomic and transcriptomic landscape of a HeLa cell line. G3 (Bethesda), Epub March 11, 2013. doi: 10.1534/g3.113.005777.
66. Lang, T. (2004). Twenty statistical errors even you can find in biomedical research articles. Croat Med J 45, 361-370.
67. Langdon, S. P. (2003). Cell culture contamination: An overview. Methods Mol Med 88, 309-318.
68. Lawrence, B., Bashiri, H., and Dehghani, H. (2010). Cross comparison of rapid mycoplasma detection platforms. Biologicals 38, 6.
69. Lazarou, J., Pomeranz, B. H., and Corey, P. N. (1998). Incidence of adverse drug reactions in hospitalized patients. JAMA 279, 1200-1205.
70. Leist, M., Efremova, L., and Karreman, C. (2010). Food for thought considerations and guidelines for basic test method descriptions in toxicology. ALTEX 27, 309-317.
71. Leist, M. and Hartung, T. (2013). Reprint: Inflammatory findings on species extrapolations: humans are definitely no 70-kg mice. ALTEX 30, 227-230.
72. Lexchin, J. (2003). Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 326, 1167-1170.
73. Lorge, E., Hayashi, M., Albertini, S., and Kirkland, D. (2008). Comparison of different methods for an accurate assessment of cytotoxicity in the in vitro micronucleus test. I. Theoretical aspects. Mutat Res 655, 1-3.
74. Lucas, C., Criens-Poublon, L. J., Cockrell, C. T., and de Haan, R. J. (2002). Wound healing in cell studies and animal model experiments by low level laser therapy; were clinical studies justified? A systematic review. Lasers Med Sci 17, 110-134.
75. Lumbreras, B., Parker, L. A., Porta, M., et al. (2009). Overinterpretation of clinical applicability in molecular diagnostic research. Clin Chem 55, 786-794.
76. Lund, R. J., Nadie;rvadie;, E., and Lahesmaa, R. (2012). Genetic and epigenetic stability of human pluripotent stem cells. Nat Rev Genet 13, 732-744.
77. Macleod, R. A. F., Dirks, W. G., Matsuo, M., et al. (1999). Widespread intraspecies cross-contamination of human tumor cell lines arising at source. Int J Cancer 83, 555-563.
78. Macleod, M. and van der Worp, H. B. (2010). Animal models of neurological disease: are there any babies in the bathwater? Pract Neurol 10, 312-314.
79. MacCallum, C. J. (2010). Reporting animal studies: good science and a duty of care. PLoS Biol 8, e1000413.
80. Mapstone, J., Roberts, I., and Evans, P. (2003). Fluid resuscitation strategies: a systematic review of animal trials. J Trauma Injury Infect Crit Care 55, 571-589.
81. Mignini, L. E. and Khan, K. S. (2006). Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research. BMC Med Res Methodol 6, 10.
82. Mitalipova, M. M., Rao, R. R., Hoyer, D. M., et al. (2005). Preserving the genetic integrity of human embryonic stem cells. Nat Biotechnol 23, 19-20.
83. Moore, T. J., Cohen, M. R., and Furberg, C. D. (2007). Serious adverse drug events reported to the Food and Drug Administration, 1998-2005. Arch Intern Med 167, 1752-1759.
84. Moreno-Villanueva, M., Pfeiffer, R., Sindlinger, T., et al. (2009). A modified and automated version of the "Fluorimetric Detection of Alkaline DNA Unwinding" method to quantify formation and repair of DNA strand breaks. BMC Biotechnology 9, 39.
85. Moreno-Villanueva, M., Eltze, T., Dressler, D., et al. (2011). The automated FADU-assay, a potential high-throughput in vitro method for early screening of DNA breakage. ALTEX 28, 295-303.
86. NRC - National Research Council, Committee on Animal Models for Assessing Countermeasures to Bioterrorism Agents (2011). Animal Models for Assessing Countermeasures to Bioterrorism Agents (1-153). Washington, DC, USA: The National Academies Press. http://dels.nationalacademies.org/Report/Animal- Models-Assessing-Countermeasures/13233
87. Nikfarjam, L. and Farzaneh, P. (2012). Prevention and detection of Mycoplasma contamination in cell culture. Cell J 13, 203-212.
88. OECD (2004). Advisory document of the working group on GLP - the application of the principles of GLP to in vitro studies. Series on Principles of Good Laboratory Practice and Compliance Monitoring 14, 1-18.
89. Olson, H., Betton, G., Robinson, D., et al. (2000). Concordance of the toxicity of pharmaceuticals in humans and in animals. Regul Toxicol Pharmacol 32, 56-67.
90. Petticrew, M. and Davey Smith, G. (2003). Monkey business: what do primate studies of social hierarchies, stress, and the development of CHD tell us about humans? J Epidemiol Community Health 57, Suppl. 1, A1-21.
91. Perel, P., Roberts, I., Sena, E., et al. (2007). Comparison of treatment effects between animal experiments and clinical trials: systematic review. BMJ (Clinical research ed) 334, 197.
92. Pfuhler, S., Kirkland, D., Kasper, P., et al. (2009). Reduction of use of animals in regulatory genotoxicity testing: Identification and implementation opportunities - Report from an ECVAM workshop. Mutat Res 680, 31-42.
93. Pfuhler, S., Kirst, A., Aardema, M., et al. (2010). A tiered approach to the use of alternatives to animal testing for the safety assessment of cosmetics: Genotoxicity. A COLIPA analysis. Regul Toxicol Pharmacol 57, 315-324.
94. Pottenger, L. H., Bus, J. S., and Gollapudi, B. B. (2007). Genetic toxicity assessment: employing the best science for human safety evaluation Part VI: When salt and sugar and vegetables are positive, how can genotoxicity data serve to inform risk assessment? Toxicol Sci 98, 327-331.
95. Pound, P., Ebrahim, S., Sandercock, P., et al. (2004). Where is the evidence that animal research benefits humans? BMJ 328, 514-517.
96. Prinz, F., Schlange, T., and Asadullah, K. (2011). Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov 10, 712.
97. Roberts, I., Kwan, I., Evans, P., and Haig, S. (2002). Does animal experimentation inform human healthcare? Observations from a systematic review of international animal experiments on fluid resuscitation. BMJ 324, 474-476.
98. Rojas, A., Gonzalez, I., and Figueroa, H. (2008). Cell line cross-contamination in biomedical research: a call to prevent unawareness. Acta Pharmacologica Sinica 29, 877-880.
99. Rottem, S. and Barile, M. F. (1993). Beware of mycoplasmas. Trends Biotechnol 11, 143-151.
100. Sena, E. S., van der Worp, H. B., Bath, P. M. W., et al. (2010). Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biol 8, e1000344.
101. Seok, J., Warren, H. S., Cuenca, A. G., et al. (2013). Genomic responses in mouse models poorly mimic human inflammatory diseases. Proc Natl Acad Sci U S A 110, 3507-3512.
102. Skloot, R. (2010). The Immortal Life of Henrietta Lacks (402pp). Crown Publishing Group; Reprint edition (February 2, 2010).
103. Skrabanek, P. and McCormick, J. (1990). Follies and Fallacies in Medicine (147 pp). Prometheus Books.
104. Snyder, R. D. and Green, J. W. (2001). A review of the genotoxicity of marketed pharmaceuticals. Mutat Res 488, 151-169.
105. Stacey, G. N. (2000). Cell contamination leads to inaccurate data: we must take action now. Nature 203, 356.
106. Steinemann, D., Godie;hring, G., and Schlegelberger, B. (2013). Genetic instability of modified stem cells - a first step towards malignant transformation? Am J Stem Cells 2, 39-51.
107. van der Worp, H. B., Howells, D. W., Sena, E. S., et al. (2010). Can animal models of disease reliably inform human studies? PLoS Med 7, e1000245.
108. van der Worp, H. B. and Macleod, M. R. (2011). Preclinical studies of human disease: time to take methodological quality seriously. J Mol Cell Cardiol 51, 449-450.
109. Volokhov, D. V., Graham, L. J., Brorson, K. A., and Chizhikov, V. E. (2011). Mycoplasma testing of cell substrates and biologics: Review of alternative non-microbiological techniques. Mol Cell Probes 25, 69-77.
110. Walmsley, R. M. (2008). GADD45a-GFP GreenScreen HC genotoxicity screening assay. Expert Opin Drug Metab Toxicol 4, 827-835.
111. Ward, D. J., Martino, O. I., Simpson, S., and Stevens, A. J. (2013). Decline in new drug launches: myth or reality? Retrospective observational study using 30 years of data from the UK. BMJ Open 3, e002088.
112. Young, N. S., Ioannidis, J. P. A., and Al-Ubaydli, O. (2008). Why current publication practices may distort science. PLoS Med 5, e201.
113. Young, L., Sung, J., Stacey, G., and Masters. J. R. (2010). Detection of Mycoplasma in cell cultures. Nat Protoc 5, 929-934.