A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib

eLife

Volumn 4, Issue OCTOBER2015, 2015, Pages

  Henderson, Valerie C ^a   Demko, Nadine ^a   Hakala, Amanda ^a   MacKinnon, Nathalie ^a   Federico, Carole A ^a   Fergusson, Dean ^b   Kimmelman, Jonathan ^a  

^a MCGILL UNIVERSITY   (Canada)

^b OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

SUNITINIB; ANTINEOPLASTIC AGENT; INDOLE DERIVATIVE; PYRROLE DERIVATIVE;

ANTINEOPLASTIC ACTIVITY; ARTICLE; DATA PROCESSING; DISEASE MODEL; DOSE RESPONSE; DRUG EFFICACY; DRUG RESEARCH; DRUG SCREENING; HUMAN; META ANALYSIS; METHODOLOGY; MONOTHERAPY; NONHUMAN; OUTCOME ASSESSMENT; PUBLISHING; TUMOR VOLUME; VALIDATION STUDY; VALIDITY; ANIMAL; CLINICAL TRIAL (TOPIC); NEOPLASMS; PATHOLOGY; PRECLINICAL STUDY; STANDARDS; TREATMENT OUTCOME;

ANIMALS; ANTINEOPLASTIC AGENTS; CLINICAL TRIALS AS TOPIC; DOSE-RESPONSE RELATIONSHIP, DRUG; DRUG EVALUATION, PRECLINICAL; INDOLES; NEOPLASMS; PYRROLES; RESEARCH DESIGN; TREATMENT OUTCOME;

EID: 84946594804     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.08351     Document Type: Article

References (51)

1. Anonymous. 2014. Budgets up at NIH, NCI, and FDA. Cancer Discovery 4:263. doi: 10.1158/2159-8290.CD-NB2014-016.
2. Abrams TJ, Murray LJ, Pesenti E, Holway VW, Colombo T, Lee LB, Cherrington JM, Pryer NK. 2003. Preclinical evaluation of the tyrosine kinase inhibitor SU11248 as a single agent and in combination with 'standard of care' therapeutic agents for the treatment of breast cancer. Molecular Cancer Therapeutics 2:1011-1021.
3. Adams CP, Brantner VV. 2006. Estimating the cost of new drug development: is it really 802 million dollars? Health Affairs 25:420-428. doi: 10.1377/hlthaff.25.2.420.
4. Amarasingh S, Macleod MR, Whittle IR. 2009. What is the translational efficacy of chemotherapeutic drug research in neuro-oncology? A systematic review and meta-analysis of the efficacy of BCNU and CCNU in animal models of glioma. Journal of Neuro-Oncology 91:117-125. doi: 10.1007/s11060-008-9697-z.
5. Amino N, Ideyama Y, Yamano M, Kuromitsu S, Tajinda K, Samizu K, Hisamichi H, Matsuhisa A, Shirasuna K, Kudoh M, Shibasaki M. 2006. YM-359445, an orally bioavailable vascular endothelial growth factor receptor-2 tyrosine kinase inhibitor, has highly potent antitumor activity against established tumors. Clinical Cancer Research 12:1630-1638. doi: 10.1158/1078-0432.CCR-05-2028.
6. Begley CG. 2013a. Six red flags for suspect work. Nature 497:433-434. doi: 10.1038/497433a.
7. Begley CG. 2013b. An unappreciated challenge to oncology drug discovery: pitfalls in preclinical research. American Society of Clinical Oncology Educational Book 2013:466-468. doi: 10.1200/EdBook_AM.2013.33.466.
8. Begley CG, Ellis LM. 2012. Drug development: raise standards for preclinical cancer research. Nature 483:531-533. doi: 10.1038/483531a.
9. Begley CG, Ioannidis JP. 2015. Reproducibility in science: improving the standard for basic and preclinical research. Circulation Research 116:116-126. doi: 10.1161/CIRCRESAHA.114.303819.
10. Chow LQ, Eckhardt SG. 2007. Sunitinib: from rational design to clinical efficacy. Journal of Clinical Oncology 25:884-896. doi: 10.1200/JCO.2006.06.3602.
11. Corpet DE, Pierre F. 2005. How good are rodent models of carcinogenesis in predicting efficacy in humans? A systematic review and meta-analysis of colon chemoprevention in rats, mice and men. European Journal of Cancer 41:1911-1922. doi: 10.1016/j.ejca.2005.06.006.
12. Crossley NA, Sena E, Goehler J, Horn J, van der Worp B, Bath PM, Macleod M, Dirnagl U. 2008. Empirical evidence of bias in the design of experimental stroke studies: a metaepidemiologic approach. Stroke 39:929-934. doi: 10.1161/STROKEAHA.107.498725.
13. Curtis MJ, Hancox JC, Farkas A, Wainwright CL, Stables CL, Saint DA, Clements-Jewery H, Lambiase PD, Billman GE, Janse MJ, Pugsley MK, Ng GA, Roden DM, Camm AJ, Walker MJ. 2013. The Lambeth Conventions (II): guidelines for the study of animal and human ventricular and supraventricular arrhythmias. Pharmacology & Therapeutics 139:213-248. doi: 10.1016/j.pharmthera.2013.04.008.
14. de Vries RB, Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M. 2011. A search filter for increasing the retrieval of animal studies in Embase. Laboratory Animals 45:268-270. doi: 10.1258/la.2011.011056.
15. DerSimonian R, Laird N. 1986. Meta-analysis in clinical trials. Contemporary Clinical Trials 7:177-188. doi: 10.1016/ 0197-2456(86)90046-2.
16. Dietz G, Dahabreh IJ, Gurevitch J, Lajeunesse MJ, Schmid CH, Trikalinos TA, Wallace BC. 2014. OpenMEE: software for ecological and evolutionary meta-analysis.
17. Faivre S, Delbaldo C, Vera K, Robert C, Lozahic S, Lassau N, Bello C, Deprimo S, Brega N, Massimini G, Armand JP, Scigalla P, Raymond E. 2006. Safety, pharmacokinetic, and antitumor activity of SU11248, a novel oral multitarget tyrosine kinase inhibitor, in patients with cancer. Journal of Clinical Oncology 24:25-35. doi: 10.1200/JCO.2005.02.2194.
18. Fisher M, Feuerstein G, Howells DW, Hurn PD, Kent TA, Savitz SI, Lo EH, STAIR Group. 2009. Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke 40:2244-2250. doi: 10.1161/STROKEAHA.108.541128.
19. Galanopoulou AS, Buckmaster PS, Staley KJ, MoshéSL, Perucca E, Engel J Jr, Löscher W, Noebels JL, Pitkänen A, Stables J, White HS, O'Brien TJ, Simonato M, American Epilepsy Society Basic Science Committee And The International League Against Epilepsy Working Group On Recommendations For Preclinical Epilepsy Drug Discovery. 2012. Identification of new epilepsy treatments: issues in preclinical methodology. Epilepsia 53:571-582. doi: 10.1111/j.1528-1167.2011.03391.x.
20. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. 2014. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383:267-276. doi: 10.1016/S0140-6736(13)62228-X.
21. Han JY, Kim HY, Lim KY, Han JH, Lee YJ, Kwak MH, Kim HJ, Yun T, Kim HT, Lee JS. 2013. A phase II study of sunitinib in patients with relapsed or refractory small cell lung cancer. Lung Cancer 79:137-142. doi: 10.1016/j. lungcan.2012.09.019.
22. Hay M, Thomas DW, Craighead JL, Economides C, Rosenthal J. 2014. Clinical development success rates for investigational drugs. Nature Biotechnology 32:40-51. doi: 10.1038/nbt.2786.
23. Henderson VC, Kimmelman J, Fergusson D, Grimshaw JM, Hackam DG. 2013. Threats to validity in the design and conduct of preclinical efficacy studies: a systematic review of guidelines for in vivo animal experiments. PLOS Medicine 10:e1001489. doi: 10.1371/journal.pmed.1001489.
24. Hill AB. 1965. The environment and disease: association or causation? Proceedings of the Royal Society of Medicine 58:295-300.
25. Hirst TC, Vesterinen HM, Sena ES, Egan KJ, Macleod MR, Whittle IR. 2013. Systematic review and meta-analysis of temozolomide in animal models of glioma: was clinical efficacy predicted? British Journal of Cancer 108:64-71. doi: 10.1038/bjc.2012.504.
26. Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M. 2010. Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed. Laboratory Animals 44:170-175. doi: 10.1258/ la.2010.009117.
27. Houk BE, Bello CL, Poland B, Rosen LS, Demetri GD, Motzer RJ. 2010. Relationship between exposure to sunitinib and efficacy and tolerability endpoints in patients with cancer: results of a pharmacokinetic/pharmacodynamic meta-analysis. Cancer Chemotherapy and Pharmacology 66:357-371. doi: 10.1007/s00280-009-1170-y.
28. Johnson JI, Decker S, Zaharevitz D, Rubinstein LV, Venditti JM, Schepartz S, Kalyandrug S, Christian M, Arbuck S, Hollingshead M, Sausville EA. 2001. Relationships between drug activity in NCI preclinical in vitro and in vivo models and early clinical trials. British Journal of Cancer 84:1424-1431. doi: 10.1054/bjoc.2001.1796.
29. Kerbel RS. 2003. Human tumor xenografts as predictive preclinical models for anticancer drug activity in humans: better than commonly perceived-but they can be improved. Cancer Biology & Therapy 2(4 Suppl 1):S134-S139.
30. Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. 2010. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLOS Biology 8:e1000412. doi: 10.1371/journal.pbio.1000412.
31. Kilkenny C, Parsons N, Kadyszewski E, Festing MF, Cuthill IC, Fry D, Hutton J, Altman DG. 2009. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PLOS ONE 4:e7824. doi: 10.1371/journal.pone.0007824.
32. Ko JS, Rayman P, Ireland J, Swaidani S, Li G, Bunting KD, Rini B, Finke JH, Cohen PA. 2010. Direct and differential suppression of myeloid-derived suppressor cell subsets by sunitinib is compartmentally constrained. Cancer Research 70:3526-3536. doi: 10.1158/0008-5472.CAN-09-3278.
33. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. 2006. The case of the misleading funnel plot. BMJ 333:597-600. doi: 10.1136/bmj.333.7568.597.
34. Macleod MR, O'Collins T, Howells DW, Donnan GA. 2004. Pooling of animal experimental data reveals influence of study design and publication bias. Stroke 35:1203-1208. doi: 10.1161/01.STR.0000125719.25853.20.
35. Maris JM, Courtright J, Houghton PJ, Morton CL, Kolb EA, Lock R, Tajbakhsh M, Reynolds CP, Keir ST, Wu J, Smith MA. 2008. Initial testing (stage 1) of sunitinib by the pediatric preclinical testing program. Pediatric Blood & Cancer 51:42-48. doi: 10.1002/pbc.21535.
36. Morrison SJ. 2014. Time to do something about reproducibility. eLife 3:e03981. doi: 10.7554/eLife.03981.
37. Motzer RJ, Hutson TE, Tomczak P, Michaelson MD, Bukowski RM, Oudard S, Negrier S, Szczylik C, Pili R, Bjarnason GA, Garcia-del-Muro X, Sosman JA, Solska E, Wilding G, Thompson JA, Kim ST, Chen I, Huang X, Figlin RA. 2009. Overall survival and updated results for sunitinib compared with interferon alfa in patients with metastatic renal cell carcinoma. Journal of Clinical Oncology 27:3584-3590. doi: 10.1200/JCO.2008.20.1293.
38. Motzer RJ, Michaelson MD, Redman BG, Hudes GR, Wilding G, Figlin RA, Ginsberg MS, Kim ST, Baum CM, DePrimo SE, Li JZ, Bello CL, Theuer CP, George DJ, Rini BI. 2006a. Activity of SU11248, a multitargeted inhibitor of vascular endothelial growth factor receptor and platelet-derived growth factor receptor, in patients with metastatic renal cell carcinoma. Journal of Clinical Oncology 24:16-24. doi: 10.1200/JCO.2005.02.2574.
39. Motzer RJ, Rini BI, Bukowski RM, Curti BD, George DJ, Hudes GR, Redman BG, Margolin KA, Merchan JR, Wilding G, Ginsberg MS, Bacik J, Kim ST, Baum CM, Michaelson MD. 2006b. Sunitinib in patients with metastatic renal cell carcinoma. JAMA 295:2516-2524. doi: 10.1001/jama.295.21.2516.
40. O'Collins VE, Macleod MR, Donnan GA, Horky LL, van der Worp BH, Howells DW. 2006. 1, 026 experimental treatments in acute stroke. Annals of Neurology 59:467-477. doi: 10.1002/ana.20741.
41. Peterson JK, Houghton PJ. 2004. Integrating pharmacology and in vivo cancer models in preclinical and clinical drug development. European Journal of Cancer 40:837-844. doi: 10.1016/j.ejca.2004.01.003.
42. Pusztai L, Hatzis C, Andre F. 2013. Reproducibility of research and preclinical validation: problems and solutions. Nature Reviews Clinical Oncology 10:720-724. doi: 10.1038/nrclinonc.2013.171.
43. Raymond E, Dahan L, Raoul JL, Bang YJ, Borbath I, Lombard-Bohas C, Valle J, Metrakos P, Smith D, Vinik A, Chen JS, Hörsch D, Hammel P, Wiedenmann B, Van Cutsem E, Patyna S, Lu DR, Blanckmeister C, Chao R, Ruszniewski P. 2011. Sunitinib malate for the treatment of pancreatic neuroendocrine tumors. The New England Journal of Medicine 364:501-513. doi: 10.1056/NEJMoa1003825.
44. Rooke ED, Vesterinen HM, Sena ES, Egan KJ, Macleod MR. 2011. Dopamine agonists in animal models of Parkinson's disease: a systematic review and meta-analysis. Parkinsonism & Related Disorders 17:313-320. doi: 10.1016/j.parkreldis.2011.02.010.
45. Smith MA, Houghton P. 2013. A proposal regarding reporting of in vitro testing results. Clinical Cancer Research 19:2828-2833. doi: 10.1158/1078-0432.CCR-13-0043.
46. Sugar E, Pascoe AJ, Azad N. 2012. Reporting of preclinical tumor-graft cancer therapeutic studies. Cancer Biology & Therapy 13:1262-1268. doi: 10.4161/cbt.21782.
47. Tsilidis KK, Panagiotou OA, Sena ES, Aretouli E, Evangelou E, Howells DW, Al-Shahi Salman R, Macleod MR, Ioannidis JP. 2013. Evaluation of excess significance bias in animal studies of neurological diseases. PLOS Biology 11:e1001609. doi: 10.1371/journal.pbio.1001609.
48. van der Worp HB, de Haan P, Morrema E, Kalkman CJ. 2005. Methodological quality of animal studies on neuroprotection in focal cerebral ischaemia. Journal of Neurology 252:1108-1114. doi: 10.1007/s00415-005-0802-3.
49. van der Worp HB, Howells DW, Sena ES, Porritt MJ, Rewell S, O'Collins V, Macleod MR. 2010. Can animal models of disease reliably inform human studies? PLOS Medicine 7:e1000245. doi: 10.1371/journal.pmed.1000245.
50. Voskoglou-Nomikos T, Pater JL, Seymour L. 2003. Clinical predictive value of the in vitro cell line, human xenograft, and mouse allograft preclinical cancer models. Clinical Cancer Research 9:4227-4239.
51. Wallace BC, Schmid CH, Lau J, Trikalinos TA. 2009. Meta-analyst: software for meta-analysis of binary, continuous and diagnostic data. BMC Medical Research Methodology 9:80. doi: 10.1186/1471-2288-9-80.