Calibration of clinical prediction rules does not just assess bias

Journal of Clinical Epidemiology

Volumn 66, Issue 11, 2013, Pages 1296-1301

  Vach, Werner ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Bias; Calibration; External validation; Prognosis; Prognostic model; Residual variation

Indexed keywords

ARTICLE; CALIBRATION; CONSTANTS AND COEFFICIENTS; HIGH RISK PATIENT; LINEAR REGRESSION ANALYSIS; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PROGNOSIS; SYSTEMATIC ERROR;

BIAS; CALIBRATION; EXTERNAL VALIDATION; PROGNOSIS; PROGNOSTIC MODEL; RESIDUAL VARIATION;

BIAS (EPIDEMIOLOGY); CALIBRATION; DECISION SUPPORT TECHNIQUES; HUMANS; MODELS, STATISTICAL;

EID: 84885021922     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2013.06.003     Document Type: Article

References (21)

1. F. Harrell, K. Lee, and D. Mark Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors Stat Med 15 1996 361 387
2. W. Sauerbrei The use of resampling methods to simplify regression models in medical statistics J R Stat Soc Ser C Applied Stat 48 1999 313 329
3. E. Steyerberg, M. Eijkemans, F. Harrell, and J. Habbema Prognostic modeling with logistic regression analysis: In search of a sensible strategy in small data sets Med Decis Making 21 2001 45 56
4. S. Bleeker, H. Moll, E. Steyerberg, A. Donders, G. Derksen-Lubsen, and D. Grobbee External validation is necessary in prediction research: a clinical example J Clin Epidemiol 56 2003 826 832
5. K.G.M. Moons, A.P. Kengne, D.E. Grobbee, P. Royston, Y. Vergouwe, and D.G. Altman Risk prediction models: II. External validation, model updating, and impact assessment Heart 98 2012 691 698
6. P. Schuetz, M. Koller, M. Christ-Crain, E. Steyerberg, D. Stolz, and C. Mueller Predicting mortality with pneumonia severity scores: importance of model recalibration to local settings Epidemiol Infect 136 2008 1628 1637
7. D. Altman, and P. Royston What do we mean by validating a prognostic model? Stat Med 19 2000 453 473
8. D.G. Altman, Y. Vergouwe, P. Royston, and K.G.M. Moons Prognosis and prognostic research: validating a prognostic model BMJ 338 2009 b605
9. A. Justice, K. Covinsky, and J. Berlin Assessing the generalizability of prognostic information Ann Intern Med 130 1999 515 524
10. K.G.M. Moons Criteria for scientific evaluation of novel markers: a perspective Clin Chem 56 2010 537 541
11. E. Bartfay, and W.J. Bartfay Accuracy assessment of prediction in patient outcomes J Eval Clin Pract 14 2008 1 10
12. W. Bouwmeester, N.P.A. Zuithoff, S. Mallett, M.I. Geerlings, Y. Vergouwe, and E.W. Steyerberg Reporting and methods in clinical prediction research: a systematic review PLoS Med 9 2012 e1001221
13. Y. Vergouwe, E. Steyerberg, M. Eijkemans, and J. Habbema Substantial effective sample sizes were required for external validation studies of predictive logistic regression models J Clin Epidemiol 58 2005 475 483
14. M. Miller, C. Langefeld, W. Tierney, S. Hui, and C. McDonald Validation of probabilistic predictions Med Decis Making 13 1993 49 58
15. D. Cox Two further applications of a model for binary regression Biometrika 45 1958 562 565
16. J. Hanley, and B. McNeil The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 143 1982 29 36
17. K.J.M. Janssen, K.G.M. Moons, C.J. Kalkman, D.E. Grobbee, and Y. Vergouwe Updating methods improved the performance of a clinical prediction model in new patients J Clin Epidemiol 61 2008 76 86
18. W. Cleveland Robust locally weighted regression and smoothing scatterplots J Am Stat Assoc 74 1979 829 836
19. Y. Vergouwe, K.G.M. Moons, and E.W. Steyerberg External validity of risk models: use of benchmark values to disentangle a case-mix effect from incorrect coefficients Am J Epidemiol 172 2010 971 980
20. W. Vach On the relation between the shrinkage effect and a shrinkage method Comput Stat 12 1997 279 292
21. P. Royston, and W. Sauerbrei A new measure of prognostic separation in survival data Stat Med 23 2004 723 748