On the validity of time-dependent AUC estimators

Briefings in Bioinformatics

Volumn 16, Issue 1, 2013, Pages 153-168

  Schmid, Matthias ^a,b   Kestler, Hans A ^c   Potapov, Sergej ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^c UNIVERSITY OF ULM   (Germany)

Author keywords

Molecular markers; Survival analysis; Time dependent AUC

Indexed keywords

BIOLOGICAL MARKER;

AREA UNDER THE CURVE; HUMAN; PROGNOSIS; STATISTICAL MODEL; SURVIVAL; VALIDATION STUDY;

AREA UNDER CURVE; BIOLOGICAL MARKERS; HUMANS; MODELS, STATISTICAL; PROGNOSIS; SURVIVAL ANALYSIS;

EID: 84896904787     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbt059     Document Type: Article

References (39)

1. Pepe MS, Zheng Y, Jin Y, et al. Evaluating the ROC performance of markers for future events. Lifetime Data Anal 2008;14:86-113.
2. Simon RM, Subramanian J, Li MC, et al. Using cross-validation to evaluate predictive accuracy of survival risk classifiers based on high-dimensional data. Brief Bioinform 2011;12:203-14.
3. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010;21:128-38.
4. van de Vijver MJ, He YD, van't Veer LJ, et al. A geneexpression signature as a predictor of survival in breast cancer. NEnglJMed 2002;347:1999-2009.
5. Desmedt C, Piette F, Loi S, et al. Strong time dependence of the 76-gene prognostic signature for node-negative breast cancer patients in the TRANSBIG multicenter independentvalidation series. Clin Cancer Res 2007;13:3207-14.
6. Kok M, Linn SC, Van Laar RK, et al. Comparison of gene expression profiles predicting progression in breast cancer patients treated with tamoxifen. Breast Cancer Res Treat 2009;13:275-83.
7. Li H, Gui J. Partial Cox regression analysis for high-dimensional microarray gene expression data. Bioinformatics 2004;20:i208-15.
8. Chang HY, Sneddon JB, Alizadeh AA, et al. Gene expression signature of fibroblast serum response predicts human cancer progression: similarities between tumors and wounds. PLoS Biol 2004;2:e7.
9. Cai T, Pepe MS, Zheng Y, et al. The sensitivity and specificity of markers for event times. Biostatistics 2006;7:182-97.
10. Uno H, Cai T, Tian L, et al. Evaluating prediction rules for t-year survivors with censored regression models. JAmStat Assoc 2007;102:527-37.
11. Eden P, Ritz C, Rose C, et al. "Good old" clinical markers have similar power in breast cancer prognosis as microarray gene expression profilers. Eur J Cancer 2004;40:1837-41.
12. Boulesteix A-L, Sauerbrei W. Added predictive value of high-throughput molecular data to clinical data and its validation. Brief Bioinform 2011;12:215-29.
13. Kaderali L, Zander T, Faigle U, et al. CASPAR: a hierarchical bayesian approach to predict survival times in cancer from gene expression data. Bioinformatics 2006;22:1495-502.
14. Heagerty PJ, Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics 2005;61:92-105.
15. Yu Y, Li J, Ma S. Adjusting confounders in ranking biomarkers:a model-based ROC approach. Brief Bioinform 2012;13:513-23.
16. Song X, Zhou XH. A semiparametric approach for the covariate specific ROC curve with survival outcome. Stat Sin 2008;18:947-65.
17. Uno H, Cai T, Pencina MJ, et al. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. StatMed 2011;30:1105-117.
18. Gui J, Li H. Penalized Cox regression analysis in the highdimensional and low-sample size settings, with applications to microarray gene expression data. Bioinformatics 2005;21:3001-8.
19. Subramanian J, Simon R. An evaluation of resampling methods for assessment of survival risk prediction in highdimensional settings. StatMed 2011;30:642-53.
20. van't Veer LJ, Dai HY, van de Vijver MJ, et al. Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002;415:530-6.
21. Wang Y, Klijn JG, Zhang Y, et al. Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 2005;365:671-9.
22. Gönen M, Heller G. Concordance probability and discriminatory power in proportional hazards regression. Biometrika 2005;92:965-70.
23. van der Laan MJ, Robins JM. Unified Methods for Censored LongitudinalData and Causality. Springer, New York. 2003.
24. Harrell FE, Califf RM, Pryor DB, et al. Evaluating the yield of medical tests. JAMA;247:2543-6.
25. Harrell FE, Lee KL, Califf RM, et al. Regression modeling strategies for improved prognostic prediction. Stat Med 1984;3:143-52.
26. Antolini L, Boracchi P, Biganzoli E. A time-dependent discrimination index for survival data. Stat Med 2005;24:3927-44.
27. Schmid M, Potapov S. A comparison of estimators to evaluate the discriminatory power of time-to-event models. Stat Med 2012;31:2588-609.
28. Chambless LE, Diao G. Estimation of time-dependent area under the ROC curve for long-term risk prediction. Stat Med 2006;25:3474-86.
29. Hung H, Chiang CT. Estimation methods for time-dependent AUC models with survival data. Can J Stat 2010;38:8-26.
30. R Core Team R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2013. http://www.r-project.org.
31. Heagerty PJ. RisksetROC: Riskset ROCCurve Estimation from Censored Survival Data 2012. R package version 1.0.4. http://cran.r-project.org/web/packages/risksetROC/index.html.
32. Potapov S, Adler W, Schmid M. SurvAUC: Estimators of PredictionAccuracyforTime-to-EventData 2012. R package version 1.0-5. http://cran.r-project.org/web/packages/survAUC/index.html.
33. Grambsch P, Therneau T. Proportional hazards tests and diagnostics based on weighted residuals. Biometrika 1994;81:515-26.
34. Goeman J. Penalized: L1 (Lasso) and L2 (Ridge) Penalized Estimation in GLMs and in the Cox Model 2012. R package version 0.9-42.
35. van Houwelingen HC, Bruinsma T, Hart AMM, et al. Cross-validated Cox regression on microarray gene expression data. StatMed 2006;25:3201-16.
36. Rosthoj S, Keiding N. Explained variation and predictive accuracy in general parametric statistical models: the role of model misspecification. LifetimeData Anal 2004;10:461-72.
37. Uno H, Tian L, Cai T, et al. A unified inference procedure for a class of measures to assess improvement in risk prediction systems with survival data. Stat Med 2013;32:2430-42.
38. Berrar D, Flach P. Caveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them). Brief Bioinform 2012;13:83-97.
39. Ma S, Song X. Ranking prognosis markers in cancer genomic studies. Brief Bioinform 2011;12:33-40.