Cross-study validation for the assessment of prediction algorithms

Bioinformatics

Volumn 30, Issue 12, 2014, Pages

  Bernau, Christoph ^a,b   Riester, Markus ^c,d   Boulesteix, Anne Laure ^b   Parmigiani, Giovanni ^c,d   Huttenhower, Curtis ^d   Waldron, Levi ^e   Trippa, Lorenzo ^c,d  

^a LEIBNIZ SUPERCOMPUTING CENTRE   (Germany)

^b Department for Medical Informatics Biometry and Epidemiology ^*  (Germany)

^c DANA FARBER CANCER INSTITUTE   (United States)

^d HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^e CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BREAST TUMOR; DISEASE FREE SURVIVAL; DNA MICROARRAY; EVALUATION STUDY; FEMALE; GENE EXPRESSION PROFILING; HUMAN; METASTASIS; PATHOLOGY; PROGNOSIS; REPRODUCIBILITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BREAST NEOPLASMS; DISEASE-FREE SURVIVAL; FEMALE; GENE EXPRESSION PROFILING; HUMANS; NEOPLASM METASTASIS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; PROGNOSIS; REPRODUCIBILITY OF RESULTS;

EID: 84902519819     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btu279     Document Type: Article

References (41)

1. Baek, S. et al. (2009) Development of biomarker classifiers from high-dimensional data. Brief. Bioinform., 10, 537-546.
2. Baggerly, K.A. et al. (2008) Run batch effects potentially compromise the usefulness of genomic signatures for ovarian cancer. J. Clin. Oncol., 26, 1186-1187.
3. Bender, R. et al. (2005) Generating survival times to simulate Cox proportional hazards models. Stat. Med., 24, 1713-1723.
4. Binder, H. and Schumacher, M. (2008) Allowing for mandatory covariates in boosting estimation of sparse high-dimensional survival models. BMC Bioinform., 9, 14.
5. Blair, E. and Tibshirani, R. (2004) Semi-supervised methods to predict patient survival from gene expression data. PLoS Biol., 2, 511-522.
6. Boulesteix, A.L. (2013) On representative and illustrative comparisons with real data in bioinformatics: response to the letter to the editor by smith et al. Bioinformatics, 29, 2664-2666.
7. Bøvelstad, H.M. et al. (2007) Predicting survival from microarray data- A comparative study. Bioinformatics, 23, 2080-2087.
8. Castaldi, P.J. et al. (2011) An empirical assessment of validation practices for molecular classifiers. Brief. Bioinform., 12, 189-202.
9. Chin, K. et al. (2006) Genomic and transcriptional aberrations linked to breast cancer pathophysiologies. Cancer Cell, 10, 529-541.
10. Demsar, J. (2006) Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res., 7, 1-30.
11. Desmedt, C. et al. (2007) Strong time dependence of the 76-gene prognostic signature for node-negative breast cancer patients in the transbig multicenter independent validation series. Clin. Cancer Res., 13, 3207-3214.
12. Efron, B. and Tibshirani, R.J. (1993) An Introduction to the Bootstrap. Chapman and Hall, New York.
13. Foekens, J.A. et al. (2006) Multicenter validation of a gene ExpressionBased prognostic signature in lymph NodeNegative primary breast cancer. J. Clin. Oncol., 24, 1665-1671.
14. Ganzfried, B.F. et al. (2013) curatedOvarianData: clinically annotated data for the ovarian cancer transcriptome. Database, [Epup ahead of print, doi: 10.1093/database/bat013, April 2, 2013].
15. Gentleman, R.C. et al. (2004) Bioconductor: open software development for computational biology and bioinformatics. Genome Biol., 5, R80.
16. 1 penalized estimation in the cox proportional hazards model. Biometr. J., 52, 70-84.
17. Gnen, M. and Heller, G. (2005) Concordance probability and discriminatory power in proportional hazards regression. Biometrika, 92, 965-970.
18. Haibe-Kains, B. et al. (2012) A three-gene model to robustly identify breast cancer molecular subtypes. J. Natl Cancer Inst., 104, 311-325.
19. Harrell, F.E. et al. (1996) Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stati. Med., 15, 361-387.
20. Hartley, H.O. and Sielken, R.L. Jr (1975) A 'Super-Population viewpoint' for finite population sampling. Biometrics, 31, 411-422.
21. Leek, J.T. et al. (2010) Tackling the widespread and critical impact of batch effects in high-throughput data. Nat. Rev. Genet., 11, 733-739.
22. Micheel, C. et al. (2012) Evolution of Translational Omics: Lessons Learned and the Path Forward. National Academies Press, Wahington, D.C.
23. Miller, J.A. et al. (2011) Strategies for aggregating gene expression data: the collap-serows R function. BMC Bioinform., 12, 322.
24. Minn, A.J. et al. (2005) Genes that mediate breast cancer metastasis to lung. Nature, 436, 518-524.
25. Minn, A.J. et al. (2007) Lung metastasis genes couple breast tumor size and meta-static spread. Proc. Natl Acad. Sci. USA, 104, 6740-6745.
26. Moher, D. and Olkin, I. (1995) Meta-analysis of randomized controlled trials: A concern for standards. JAMA, 274, 1962-1964.
27. Molinaro, A.M. et al. (2005) Prediction error estimation: a comparison of resampling methods. Bioinformatics, 21, 3301-3307.
28. Riester, M. et al. (2014) Risk prediction for Late-Stage ovarian cancer by meta-ana-lysis of 1525 patient samples. JNCI J Natl Cancer Inst., [Epup ahead of print, doi:10.1093/jnci/dju048, April 3, 2014].
29. Schemper, M. and Smith, T.L. (1996) A note on quantifying follow-up in studies of failure time. Clinical Trials, 17, 343-346.
30. Schmidt, M. et al. (2008) The humoral immune system has a key prognostic impact in node-negative breast cancer. Cancer Res., 68, 5405-5413.
31. Simon, R.M. et al. (2009) Use of archived specimens in evaluation of prognostic and predictive biomarkers. J. Natl Cancer Inst., 101, 1446-1452.
32. Simon, R.M. et al. (2011) Using cross-validation to evaluate predictive accuracy of survival risk classifiers based on high-dimensional data. Brief. Bioinform., 12, 203-217.
33. Sotiriou, C. et al. (2006) Gene expression profiling in breast cancer: understanding the molecular basis of histologic grade to improve prognosis. J. Natl Cancer Inst., 98, 262-272.
34. Subramanian, J. and Simon, R. (2010) Gene expression-based prognostic signatures in lung cancer: ready for clinical use? J. Natl Cancer Inst., 102, 464-474.
35. Symmans, W.F. et al. (2010) Genomic index of sensitivity to endocrine therapy for breast cancer. J. Clin. Oncol., 28, 4111-4119.
36. Taminau, J. et al. (2011) inSilicoDb: an R/Bioconductor package for accessing human affymetrix expert-curated datasets from GEO. Bioinformatics, 27, 3204-3205.
37. Tibshirani, R. (2009) uniCox: Univarate shrinkage prediction in the Cox model. R package version 1.0.
38. Varma, S. and Simon, R. (2006) Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics, 7, 91.
39. Waldron, L. et al. (2011) Optimized application of penalized regression methods to diverse genomic data. Bioinformatics, 27, 3399-3406.
40. Waldron, L. et al. (2014) Comparative meta-analysis of prognostic gene signatures for Late-Stage ovarian cancer. JNCI J Natl Cancer Inst., [Epub ahead of print, doi:10.1093/jnci/dju049, April 3, 2014].
41. Zhao, S. et al. (2013) Mas-o-menos: a simple sign averaging method for discrimination in genomic data analysis. http://biostats.bepress.com/ harvardbiostat/paper158/(24 October 2014, date last accessed).