Measures of prediction error for survival data with longitudinal covariates

Biometrical Journal

Volumn 53, Issue 2, 2011, Pages 275-293

  Schoop, Rotraut ^a,b   Schumacher, Martin ^b   Graf, Erika ^b  

^a UNIVERSITY OF FREIBURG   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Brier score; IPCW; Prediction error; Quadratic loss; Time dependent covariates

Indexed keywords

ERRORS; SAMPLING;

BRIER SCORE; CONDITIONAL PREDICTION ERRORS; COVARIATES; DYNAMIC PREDICTION; IPCW; PREDICTION ERRORS; PROGNOSTIC MODELING; QUADRATIC LOSS; SURVIVAL DATA; TIME-DEPENDENT COVARIATES;

FORECASTING;

EID: 79952275759     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.201000145     Document Type: Article

References (59)

1. Altman, D. and de Stavola, B. (1994). Practical problems in fitting a proportional hazards model to data with updated measurements of the covariates. Statistics in Medicine 13, 301-341.
2. Andersen, P., Borgan, Ø., Gill, R. D. and Keiding, N. (1993). Statistical Models Based on Counting Processes. Springer Series in Statistics. Springer-Verlag, New York.
3. Andersen, P. and Perme, M. (2008). Inference for outcome probabilities in multi-state models. Lifetime Data Analysis 14, 405-431.
4. Andersen, P. K., Hansen, L. S. and Keiding, N. (1991a). Assessing the influence of reversible disease indicators on survival. Statistics in Medicine 10, 1061-1067.
5. Andersen, P. K., Hansen, L. S. and Keiding, N. (1991b). Non- and semi-parametric estimation of transition probabilities from censored observation of a non-homogeneous markov process. Scandinavian Journal of Statistics 18, 153-167.
6. Antolini, L., Boracchi, P., and Biganzoli, E. (2005). A time-dependent discrimination index for survival data. Statistics in Medicine 24, 3927-3944.
7. Bernardo, J. and Smith, A. (1993). Bayesian Theory. Wiley, Chichester, England.
8. Boberg, K., Rocca, G., Egeland, T., Bergquist, A., Broome, U., Caballeria, L., Chapman, R., Hultcrantz, R., Mitchell, S., Pares, A., Rosina, F., and Schrumpf, E. (2002). Time-dependent Cox regression model is superior in prediction of prognosis in primary sclerosing cholangitis. Hepatology 35, 652-657.
9. Cai, T., Pepe, M., Zheng, Y., Lumley, T., and Jenny, N. (2006). The sensitivity and specificity of markers for event times. Biostatistics 7, 182-197.
10. Chambless, L. and Diao, G. (2006). Estimation of time-dependent area under the ROC curve for long term risk prediction. Statistics in Medicine 25, 3474-3486.
11. Christensen, E., Schlichting, P., Andersen, P., Fauerholdt, L., Schou, G., Pedersen, B., Juhl, E., Poulsen, H. and Tygstrup, N. (1986). Updating prognosis and therapeutic effect evaluation in cirrhosis with Cox multiple-regression model for time-dependent variables. Scandinavian Journal of Gastroenterology 21, 163-174.
12. DeLong, E., Vernon, W. and Bollinger, R. (1985). Sensitivity and specificity of a monitoring test. Biometrics 41, 947-958.
13. Emir, B., Wiand, S., Su, J., and Cha, S. (1998). Analysis of repeated markers used to predict progression of cancer. Statistics in Medicine 17, 2563-2578.
14. Emir, B., Wieand, S., Jung, S., and Ying, Z. (2000). Comparison of diagnostic markers with repeated measurements: a non-parametric ROC curve approach. Statistics in Medicine 19, 511-523.
15. Etzioni, R., Pepe, M., Longton, G., Hu, C., and Goodman, G. (1999). Incorporating the time dimension in receiver operating characteristic curves: a case study of prostate cancer. Medical Decision Making 19, 242-251.
16. Gerds, T. A. and Schumacher, M. (2006). Consistent estimation of the expected Brier score in general survival models with right-censored event times. Biometrical Journal 48, 1029-1040.
17. Gerds, T. A. and Schumacher, M. (2007). Efron-type measures of prediction error for survival analysis. Biometrics 63, 1283-1287.
18. Gneiting, T., Balabdaoui, F., and Raftery, A. (2007). Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society, Series B 69, 243-268.
19. Gneiting, T. and Raftery, A. (2007). Strictly proper scoring rules, prediction and estimation. Journal of the American Statistical Association 102, 359-378.
20. Graf, E., Schmoor, C., Sauerbrei, W., and Schumacher, M. (1999). Assessment and comparison of prognostic classification schemes for survival data. Statistics in Medicine 18, 2529-2545.
21. Hand, D. J. (1997). Construction and Assessment of Classification Rules. Wiley, Chichester, England.
22. Hanley, J. A. and McNeil, B. J. (1982). The meaning and use of the area under the receiver operating characteristic (ROC) curve. Radiology 143, 29-36.
23. Heagerty, P. and Zheng, Y. (2005). Survival model predictive accuracy and ROC curves. Biometrics 61, 92-105.
24. Heagerty, P. J., Lumley, T., and Pepe, M. S. (2000). Time-dependent ROC curves for censored survival data and a diagnostic marker. Biometrics 56, 337-344.
25. Held, L. (2008). Methoden der statistischen Inferenz: Likelihood und Bayes. Spektrum Akademischer Verlag, Heidelberg, Germany.
26. Henderson, R., Diggle, P., and Dobson, A. (2002). Identification and efficacy of longitudinal markers for survival. Biostatistics 3, 33-50.
27. Henderson, R., Jones, M., and Stare, J. (2001). Accuracy of point predictions in survival analysis. Statistics in Medicine 20, 3083-3096.
28. Huang, Y. and Pepe, M. (2010). Assessing risk prediction models in case-control studies using semiparametric and nonparametric methods. Statistics in Medicine 29, 1391-1410.
29. Huang, Y., Pepe, M., and Feng, Z. (2007). Evaluating the predictiveness of a continuous marker. Biometrics 63, 1181-1188.
30. Ibrahim, J., Chu, H., and Chen, L. (2010). Basic concepts and methods for joint models of longitudinal and survival data. Journal of Clinical Oncology 28, 2796-2801.
31. Janssen-Heijnen, M., Gondos, A., Bray, F., Hakulinen, T., Brewster, D., Brenner, H., and Coebergh, J. W. (2010). Clinical relevance of conditional survival of cancer patients in europe: age-specific analyses of 13 cancers. Journal of Clinical Oncology 28, 2520-2528.
32. Jolliffe, I. and Stephenson, D. (eds.) (2003). Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wiley, Chichester, England.
33. Kay, R. (1986). A Markov model for analysing cancer markers and disease states in survival studies. Biometrics 42, 855-866.
34. McIntosh, M. and Pepe, M. (2002). Combining several screening tests: optimality of the risk score. Biometrics 58, 657-664.
35. Moskowitz, C. and Pepe, M. (2004a). Quantifying and comparing the predictive accuracy of binary biomarkers when predicting a failure time outcome. Statistics in Medicine 23, 1555-1570.
36. Moskowitz, C. and Pepe, M. (2004b). Quantifying and comparing the predictive accuracy of continuous prognostic factors for binary outcomes. Biostatistics 5, 113-127.
37. Parker, C. and DeLong, E. (2003). ROC methodology within a monitoring framework. Statistics in Medicine 22, 3473-3488.
38. Parmar, M. and Machin, D. (1995). Survival Analysis - A Practical Approach. Wiley, Chichester, England.
39. Pencina, M., D'Agostino, R., Sr., D'Agostino, R., Jr. and Vasan, R. (2008). Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Statistics in Medicine 27, 157-172.
40. Pepe, M., Feng, Z., Huang, Y., Longton, G., Prentice, R., Thompson, I., and Zheng, Y. (2008). Integrating the predictiveness of a marker with its performance as a classifier. American Journal of Epidemiology 167, 362-368.
41. Pepe, M. S. (2000). An interpretation for the ROC curve and inference using GLM procedures. Biometrics 56, 352-359.
42. Proust-Lima, C. and Taylor, J. (2009). Development and validation of a dynamic prognostic tool for prostate cancer recurrence using repeated measures of posttreatment psa: a joint modelling approach. Biostatistics 10, 535-549.
43. R Development Core Team. (2010). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
44. Schemper, M. and Henderson, R. (2000). Predictive accuracy and explained variation in Cox regression. Biometrics 56, 249-255.
45. Schmid, M., Hielscher, T., Augustin, T., and Gefeller, O. (2010). A robust alternative to the Schemper-Henderson estimator of prediction error. Biometrics, DOI:10.1111/j.1541-0420.2010.01459.x.
46. Schoop, R. (2008). Predictive accuracy of failure time models with longitudinal covariates. Ph.D. thesis, University of Freiburg, Germany.
47. Schoop, R., Beyersmann, J., Schumacher, M. and Binder, H. (2011). Quantifying the predictive accuracy of time to event models in the presence of competing risks. Biometrical Journal.
48. Schoop, R., Graf, E., and Schumacher, M. (2008). Quantifying the predictive performance of prognostic models for censored survival data with time-dependent covariates. Biometrics 64, 603-610.
49. Selten, R. (1998). Axiomatic characterization of the quadratic scoring rule. Experimental Economics 1, 43-62.
50. Subtil, F., Pouteil-Noble, C., Toussaint, S., Villar, E. and Rabilloud, M. (2009). A simple modeling-free method provides accurate estimates of sensitivity and specificity of longitudinal disease biomarkers. Methods of Information in Medicine 48, 229-305.
51. Taylor, J., Yu, M. and Sandler, H. (2005). Individualized predictions of disease progression following radiation therapy for prostate cancer. Journal of Clinical Oncology 23, 816-825.
52. van Houwelingen, H. (2007). Dynamic prediction by landmarking in event history analysis. Scandinavian Journal of Statistics 34, 70-85.
53. van Walraven, C., Davis, D., Forster, A., and Wells, G. (2004). Time-dependent bias was common in survival analyses published in leading clinical journals. Journal of Clinical Epidemiology 57, 672-682.
54. Zamboni, B., Yothers, G., Choi, M., Fuller, C., Dignam, J., Raich, P., Thomas, C., O'Connell, M., Wolmark, N. and Wang, S. (2010). Conditional survival and the choice of conditioning set for patients with colon cancer: an analysis of NSABP trials C-03 through C-07. Journal of Clinical Oncology 28, 2544-2548.
55. Zheng, Y., Cai, T. and Feng, Z. (2006). Application of the time-dependent ROC curves for prognostic accuracy with multiple biomarkers. Biometrics 62, 279-287.
56. Zheng, Y., Cai, T., Pepe, M., and Levy, W. (2008). Time-dependent predictive values of prognostic biomarkers with failure time outcome. Journal of the American Statistical Association 103, 362-368.
57. Zheng, Y. and Heagerty, P. J. (2004). Semiparametric estimation of time-dependent ROC curves for longitudinal marker data. Biostatistics 5, 615-632.
58. Zheng, Y. and Heagerty, P. J. (2005). Partly conditional survival models for longitudinal data. Biometrics 61, 379-391.
59. Zheng, Y. and Heagerty, P. J. (2007). Prospective accuracy for longitudinal markers. Biometrics 63, 332-341.