Confidence scores for prediction models

Biometrical Journal

Volumn 53, Issue 2, 2011, Pages 259-274

  Gerds, Thomas A ^a   van de Wiel, Mark A ^a  

^a NONE   (Denmark)

Author keywords

Bootstrap; Brier score; Cross validation; Prediction performance; Survival analysis

Indexed keywords

FORECASTING;

BOOTSTRAP; BRIER SCORE; CONFIDENCE SCORE; CROSS VALIDATION; MODEL-BASED OPC; MODELLING STRATEGIES; PREDICTION MODELLING; PREDICTION PERFORMANCE; SURVIVAL ANALYSIS; TRAINING DATA;

STATISTICS;

EID: 79952230102     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.201000157     Document Type: Article

References (26)

1. Altman, D. G. and Andersen, P. K. (1989). Bootstrap investigation of the stability of a Cox regression model. Statistics in Medicine 8, 771-783.
2. Broët, P., Richardson, S. and Radvanyi, F. (2002). Bayesian hierarchical model for identifying changes in gene expression from microarray experiments. Journal of Computational Biology 9, 671-683.
3. Claeskens, G. and Hjort, N. L. (2008). Model Selection and Model Averaging. Cambridge University Press, New York.
4. Efron, B. and Tibshirani, R. (1997). Improvement on cross-validation: The .632+ bootstrap method. Journal of the American Statistical Association 92, 548-560.
5. Gerds, T. A., Cai, T. and Schumacher, M. (2008). The performance of risk prediction models. Biometrical Journal 50, 457-479.
6. Gerds, T. A. and Schumacher, M. (2006). Consistent estimation of the expected Brier score in general survival models with right-censored event times. Biometrical Journal 48, 1029-1040.
7. Gerds, T. A. and Schumacher, M. (2007). On Efron type measures of prediction error for survival analysis. Biometrics 63, 1283-1287.
8. Goeman, J. (2010). L1 penalized estimation in the Cox proportional hazards model. Biometrical Journal 52, 70-84.
9. Hanley, J. A. and McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148, 839-843.
10. Harrell, F. E. (2001). Regression Modeling Strategies. With Applications to Linear Models, Logistic Regression and Survival Analysis. Springer Series in Statistics. Springer, New York, NY.
11. Ishwaran, H., Kogalur, U., Blackstone, E. and Lauer, M. (2008). Random survival forests. Annals of Applied Statistics 2, 841-860.
12. Jiang, W. and Simon, R. (2007). A comparison of bootstrap methods and an adjusted bootstrap approach for estimating the prediction error in microarray classification. Statistics in Medicine 26, 5320-5334.
13. Kattan, M. W., Zelefsky, M. J., Kupelian, P. A., Cho, D., Scardino, P. T., Fuks, Z. and Leibel, S. A. (2003). Pretreatment nomogram that predicts 5-year probability of metastasis following three-dimensional conformal radiation therapy for localized prostate cancer. Journal of Clinical Oncology 21, 4568-4571.
14. Kattan, M. W., Zelefsky, M. J., Kupelian, P. A., Scardino, P. T., Fuks, Z. and Leibel, S. A. (2000). Pretreatment nomogram for predicting the outcome of three-dimensional conformal radiotherapy in prostate cancer. Journal of Clinical Oncology 18, 3352-3359.
15. Molinaro, A. M., Simon, R. and Pfeiffer, R. M. (2005). Prediction error estimation: a comparison of resampling methods. Bioinformatics 21, 3301-3307.
16. Pers, T. H., Albrechtsen, A., Holst, S., Claus, A. T. I. and Gerds, T. A. (2009). The validation and assessment of machine learning: A game of prediction from high-dimensional data. PLoS ONE 4, e6287.
17. Royston, P. and Sauerbrei, W. (2005). Building multivariable regression models with continuous covariates in clinical epidemiology - with an emphasis on fractional polynomials. Methods for Information and Medicine 44, 561-571.
18. Schumacher, M., Holländer, N., Schwarzer, G. and Sauerbrei, W. (2006). Prognostic factor studies. In: Crowley J. and Pauler Ankerst D. (Eds.). Handbook of Statistics in Clinical Oncology (2nd edn.) Chapman & Hall, London, pp. 289-333.
19. Sheather, S. J. and Jones, M. C. (1991). A reliable data-based bandwidth selection method for kernel density estimation. Journal of the Royal Statistical Society, Series B 53, 683-690.
20. Simon, R. (2003). Supervised analysis when the number of candidate features (p) greatly exceeds the number of cases (n). SIGKDD Explorations Newsletter 5, 31-36.
21. Stephenson, A. J., Smith, A., Kattan, M. W., Satagopan, J., Reuter, V. E., Scardino, P. T. and Gerald, W. L. (2005). Integration of gene expression profiling and clinical variables to predict prostate carcinoma recurrence after radical prostatectomy. Cancer 104, 290-298.
22. Steyerberg, E. W., Harrell, F. E. J., Borsboom, G. J., Eijkemans, M. J., Vergouwe, Y. and Habbema, J. D. (2001). Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. Journal of Clinical Epidemiology 54, 774-781.
23. Stute, W. (1984). Asymptotic normality of nearest neighbor regression function estimates. The Annals of Statistics 12, 917-926.
24. van de Vijver, M. J., He, Y. D., van't Veer, L. J., Dai, H., Hart, A. A., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., Parrish, M., Atsma, D., Witteveen, A., Glas, A., Delahaye, L., van der Velde, T., Bartelink, H., Rodenhuis, S., Rutgers, E. T., Friend, S. H. and Bernards, R. (2002). A gene-expression signature as a predictor of survival in breast cancer. New England Journal of Medicine 347, 1999-2009.
25. van de Wiel, M., Berkhof, J. and van Wieringen, W. (2009). Testing the prediction error difference between 2 predictors. Biostatistics 10, 550-560.
26. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B 67, 301-320.