메뉴 건너뛰기




Volumn 27, Issue 1, 2018, Pages 185-197

A review of statistical updating methods for clinical prediction models

Author keywords

Clinical prediction model; Model recalibration; Model updating; Model validation; Risk score

Indexed keywords

ARTICLE; CALIBRATION; HEART SURGERY; HUMAN; MORTALITY; PREDICTION; STATISTICAL ANALYSIS; UNITED KINGDOM; VALIDATION PROCESS; FORECASTING; REGISTER; REGRESSION ANALYSIS; REPRODUCIBILITY; STATISTICAL MODEL;

EID: 85041430479     PISSN: 09622802     EISSN: 14770334     Source Type: Journal    
DOI: 10.1177/0962280215626466     Document Type: Article
Times cited : (93)

References (54)
  • 2
    • 84874455291 scopus 로고    scopus 로고
    • Prognosis research strategy (PROGRESS) 4: Stratified medicine research
    • Hingorani AD, van Windt DA, Riley RD, et al. Prognosis research strategy (PROGRESS) 4: Stratified medicine research. Br Med J 2013; 346: e5793.
    • (2013) Br Med J , vol.346
    • Hingorani, A.D.1    Van Windt, D.A.2    Riley, R.D.3
  • 3
    • 33748489353 scopus 로고    scopus 로고
    • Clinical prediction rules: What are they and what do they tell us?
    • Beattie P, Nelson R, et al. Clinical prediction rules: What are they and what do they tell us? Aust J Physiother 2006; 52: 157–163.
    • (2006) Aust J Physiother , vol.52 , pp. 157-163
    • Beattie, P.1    Nelson, R.2
  • 4
    • 73849094087 scopus 로고    scopus 로고
    • Assessing the performance of prediction models: A framework for traditional and novel measures
    • Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010; 21: 128–138.
    • (2010) Epidemiology , vol.21 , pp. 128-138
    • Steyerberg, E.W.1    Vickers, A.J.2    Cook, N.R.3
  • 5
    • 0030716953 scopus 로고    scopus 로고
    • Monitoring the results of cardiac surgery by variable life-adjusted display
    • Lovegrove J, Valencia O, Treasure T, et al. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet 1997; 350: 1128–1130.
    • (1997) Lancet , vol.350 , pp. 1128-1130
    • Lovegrove, J.1    Valencia, O.2    Treasure, T.3
  • 6
    • 9644255547 scopus 로고    scopus 로고
    • Control chart methods for monitoring cardiac surgical performance and their interpretation
    • Rogers CA, Reeves BC, Caputo M, et al. Control chart methods for monitoring cardiac surgical performance and their interpretation. J Thorac Cardiovasc Surg 2004; 128: 811–819.
    • (2004) J Thorac Cardiovasc Surg , vol.128 , pp. 811-819
    • Rogers, C.A.1    Reeves, B.C.2    Caputo, M.3
  • 7
    • 84874484807 scopus 로고    scopus 로고
    • Prognosis research strategy (PROGRESS) 1: A framework for researching clinical outcomes
    • Hemingway H, Croft P, Perel P, et al. Prognosis research strategy (PROGRESS) 1: A framework for researching clinical outcomes. BMJ 2013; 346: e5595.
    • (2013) BMJ , vol.346
    • Hemingway, H.1    Croft, P.2    Perel, P.3
  • 8
    • 84874455583 scopus 로고    scopus 로고
    • Prognosis research strategy (PROGRESS) 2: Prognostic factor research
    • Riley RD, Hayden JA, Steyerberg EW, et al. Prognosis research strategy (PROGRESS) 2: Prognostic factor research. PLoS Med 2013; 10: e1001380.
    • (2013) Plos Med , vol.10
    • Riley, R.D.1    Hayden, J.A.2    Steyerberg, E.W.3
  • 9
    • 84874505367 scopus 로고    scopus 로고
    • Prognosis research strategy (PROGRESS) 3: Prognostic model research
    • Steyerberg EW, Moons KG, van der Windt DA, et al. Prognosis research strategy (PROGRESS) 3: prognostic model research. PLoS Med 2013; 10: e1001381.
    • (2013) Plos Med , vol.10
    • Steyerberg, E.W.1    Moons, K.G.2    Van Der Windt, D.A.3
  • 10
    • 84923923813 scopus 로고    scopus 로고
    • Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement
    • Collins GS, Reitsma JB, Altman DG, et al. Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement. Ann Intern Med 2015; 162: 55–63.
    • (2015) Ann Intern Med , vol.162 , pp. 55-63
    • Collins, G.S.1    Reitsma, J.B.2    Altman, D.G.3
  • 12
    • 36849089158 scopus 로고    scopus 로고
    • Updating methods improved the performance of a clinical prediction model in new patients
    • Janssen K, Moons K, Kalkman C, et al. Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol 2008; 61: 76–86.
    • (2008) J Clin Epidemiol , vol.61 , pp. 76-86
    • Janssen, K.1    Moons, K.2    Kalkman, C.3
  • 13
  • 14
    • 67650082402 scopus 로고    scopus 로고
    • Prognosis and prognostic research: Validating a prognostic model
    • Altman DG, Vergouwe Y, Royston P, et al. Prognosis and prognostic research: validating a prognostic model. BMJ 2009; 338: 1432–1435.
    • (2009) BMJ , vol.338 , pp. 1432-1435
    • Altman, D.G.1    Vergouwe, Y.2    Royston, P.3
  • 15
    • 33646023117 scopus 로고    scopus 로고
    • An introduction to ROC analysis
    • Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett 2006; 27: 861–874.
    • (2006) Pattern Recognit Lett , vol.27 , pp. 861-874
    • Fawcett, T.1
  • 16
    • 0020083498 scopus 로고
    • The meaning and use of the area under a receiver operating characteristic (ROC) curve
    • Hanley JA and McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29–36.
    • (1982) Radiology , vol.143 , pp. 29-36
    • Hanley, J.A.1    McNeil, B.J.2
  • 17
    • 43949083703 scopus 로고    scopus 로고
    • Comparison of non-parametric confidence intervals for the area under the ROC curve of a continuous-scale diagnostic test
    • Gengsheng Q and Hotilovac L. Comparison of non-parametric confidence intervals for the area under the ROC curve of a continuous-scale diagnostic test. Stat Methods Med Res 2008; 17: 207–221.
    • (2008) Stat Methods Med Res , vol.17 , pp. 207-221
    • Gengsheng, Q.1    Hotilovac, L.2
  • 19
    • 0023710206 scopus 로고
    • Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach on JSTOR
    • DeLong ER, DeLong DM and Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach on JSTOR. Biometrics 1988; 44: 837–844.
    • (1988) Biometrics , vol.44 , pp. 837-844
    • Delong, E.R.1    Delong, D.M.2    Clarke-Pearson, D.L.3
  • 20
    • 84872170445 scopus 로고
    • Goodness of fit tests for the multiple logistic regression model
    • Hosmer DW and Lemeshow S. Goodness of fit tests for the multiple logistic regression model. Commun Stat Methods 1980; 9: 1043–1069.
    • (1980) Commun Stat Methods , vol.9 , pp. 1043-1069
    • Hosmer, D.W.1    Lemeshow, S.2
  • 21
    • 0000149045 scopus 로고
    • Two futher applications of a model for binary regression
    • Cox DR. Two futher applications of a model for binary regression. Biometrika 1958; 45: 562–565.
    • (1958) Biometrika , vol.45 , pp. 562-565
    • Cox, D.R.1
  • 22
    • 84891834902 scopus 로고    scopus 로고
    • Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers
    • Austin PC and Steyerberg EW. Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Stat Med 2014; 33: 517–535.
    • (2014) Stat Med , vol.33 , pp. 517-535
    • Austin, P.C.1    Steyerberg, E.W.2
  • 23
    • 4344696163 scopus 로고    scopus 로고
    • Validation and updating of predictive logistic regression models: A study on sample size and shrinkage
    • Steyerberg EW, Borsboom GJJM, van Houwelingen HC, et al. Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med 2004; 23: 2567–2586.
    • (2004) Stat Med , vol.23 , pp. 2567-2586
    • Steyerberg, E.W.1    Borsboom, G.J.J.M.2    Van Houwelingen, H.C.3
  • 24
    • 53449089345 scopus 로고    scopus 로고
    • The risk of severe postoperative pain: Modification and validation of a clinical prediction rule
    • Janssen KJM, Kalkman CJ, Grobbee DE, et al. The risk of severe postoperative pain: modification and validation of a clinical prediction rule. Anesth Analg 2008; 107: 1330–1339.
    • (2008) Anesth Analg , vol.107 , pp. 1330-1339
    • Janssen, K.J.M.1    Kalkman, C.J.2    Grobbee, D.E.3
  • 25
    • 84883447119 scopus 로고    scopus 로고
    • Simple dichotomous updating methods improved the validity of polytomous prediction models
    • Van Hoorde K, Vergouwe Y, Timmerman D, et al. Simple dichotomous updating methods improved the validity of polytomous prediction models. J Clin Epidemiol 2013; 66: 1158–1165.
    • (2013) J Clin Epidemiol , vol.66 , pp. 1158-1165
    • Van Hoorde, K.1    Vergouwe, Y.2    Timmerman, D.3
  • 26
    • 0029123293 scopus 로고
    • Construction, validation and updating of a prognostic model for kidney graft survival
    • Van Houwelingen HC and Thorogood J. Construction, validation and updating of a prognostic model for kidney graft survival. Stat Med 1995; 14: 1999–2008.
    • (1995) Stat Med , vol.14 , pp. 1999-2008
    • Van Houwelingen, H.C.1    Thorogood, J.2
  • 27
    • 0034736564 scopus 로고    scopus 로고
    • Validation, calibration, revision and combination of prognostic survival models
    • Van Houwelingen HC. Validation, calibration, revision and combination of prognostic survival models. Stat Med 2000; 19: 3401–3415.
    • (2000) Stat Med , vol.19 , pp. 3401-3415
    • Van Houwelingen, H.C.1
  • 28
    • 61449115659 scopus 로고    scopus 로고
    • A simple method to adjust clinical prediction models to local circumstances
    • Janssen KJM, Vergouwe Y, Kalkman CJ, et al. A simple method to adjust clinical prediction models to local circumstances. Can J Anaesth 2009; 56: 194–201.
    • (2009) Can J Anaesth , vol.56 , pp. 194-201
    • Janssen, K.J.M.1    Vergouwe, Y.2    Kalkman, C.J.3
  • 29
    • 0030069896 scopus 로고    scopus 로고
    • Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors
    • Harrell FE, Lee KL and Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996; 15: 361–387.
    • (1996) Stat Med , vol.15 , pp. 361-387
    • Harrell, F.E.1    Lee, K.L.2    Mark, D.B.3
  • 30
    • 84861793982 scopus 로고    scopus 로고
    • Adaptation of clinical prediction models for application in local settings
    • Kappen TH, Vergouwe Y, van Klei WA, et al. Adaptation of clinical prediction models for application in local settings. Med Decis Making 2012; 32: E1–E10.
    • (2012) Med Decis Making , vol.32 , pp. EE1-E10
    • Kappen, T.H.1    Vergouwe, Y.2    Van Klei, W.A.3
  • 31
    • 67649827173 scopus 로고    scopus 로고
    • The Society of Thoracic Surgeons 2008 cardiac surgery risk models: Part 1– coronary artery bypass grafting surgery
    • Shahian DM, O’Brien SM, Filardo G, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1– coronary artery bypass grafting surgery. Ann Thorac Surg 2009; 88(1 Suppl): S2–S22.
    • (2009) Ann Thorac Surg , vol.88 , pp. SS2-S22
    • Shahian, D.M.1    O’Brien, S.M.2    Filardo, G.3
  • 32
    • 67649816665 scopus 로고    scopus 로고
    • The Society of Thoracic Surgeons 2008 cardiac surgery risk models: Part 2– isolated valve surgery
    • O’Brien SM, Shahian DM, Filardo G, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2– isolated valve surgery. Ann Thorac Surg 2009; 88(1 Suppl): S23–S42.
    • (2009) Ann Thorac Surg , vol.88 , pp. S23-S42
    • O’Brien, S.M.1    Shahian, D.M.2    Filardo, G.3
  • 33
    • 67649786427 scopus 로고    scopus 로고
    • The Society of Thoracic Surgeons 2008 cardiac surgery risk models: Part 3– valve plus coronary artery bypass grafting surgery
    • Shahian DM, O’Brien SM, Filardo G, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 3– valve plus coronary artery bypass grafting surgery. Ann Thorac Surg 2009; 88(1 Suppl): S43–S62.
    • (2009) Ann Thorac Surg , vol.88 , pp. S43-S62
    • Shahian, D.M.1    O’Brien, S.M.2    Filardo, G.3
  • 34
    • 84866440887 scopus 로고    scopus 로고
    • Aggregating published prediction models with individual participant data: A comparison of different approaches
    • Debray TPA, Koffijberg H, Vergouwe Y, et al. Aggregating published prediction models with individual participant data: a comparison of different approaches. Stat Med 2012; 31: 2697–2712.
    • (2012) Stat Med , vol.31 , pp. 2697-2712
    • Debray, T.P.A.1    Koffijberg, H.2    Vergouwe, Y.3
  • 35
    • 84880044696 scopus 로고    scopus 로고
    • A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis
    • Debray TPA, Moons KGM, Ahmed I, et al. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Stat Med 2013; 32: 3158–3180.
    • (2013) Stat Med , vol.32 , pp. 3158-3180
    • Debray, T.P.A.1    Moons, K.G.M.2    Ahmed, I.3
  • 36
    • 84922392234 scopus 로고    scopus 로고
    • Meta-analysis and aggregation of multiple published prediction models
    • Debray TPA, Koffijberg H, Nieboer D, et al. Meta-analysis and aggregation of multiple published prediction models. Stat Med 2014; 33: 2341–2362.
    • (2014) Stat Med , vol.33 , pp. 2341-2362
    • Debray, T.P.A.1    Koffijberg, H.2    Nieboer, D.3
  • 37
    • 77949408057 scopus 로고    scopus 로고
    • Ka´rný M and Ettler P. Online prediction under model uncertainty via dynamic model averaging: Application to a cold rolling mill
    • Raftery AE, Ka´rný M and Ettler P. Online prediction under model uncertainty via dynamic model averaging: Application to a cold rolling mill. Technometrics 2010; 52: 52–66.
    • (2010) Technometrics , vol.52 , pp. 52-66
    • Raftery, A.E.1
  • 38
    • 84858860139 scopus 로고    scopus 로고
    • Dynamic logistic regression and dynamic model averaging for binary classification
    • McCormick TH, Raftery AE, Madigan D, et al. Dynamic logistic regression and dynamic model averaging for binary classification. Biometrics 2012; 68: 23–30.
    • (2012) Biometrics , vol.68 , pp. 23-30
    • McCormick, T.H.1    Raftery, A.E.2    Madigan, D.3
  • 39
    • 20444497873 scopus 로고    scopus 로고
    • Using Bayesian model averaging to calibrate forecast ensembles
    • Raftery AE, Gneiting T, Balabdaoui F, et al. Using Bayesian model averaging to calibrate forecast ensembles. Mon Weather Rev 2005; 133: 1155–1174.
    • (2005) Mon Weather Rev , vol.133 , pp. 1155-1174
    • Raftery, A.E.1    Gneiting, T.2    Balabdaoui, F.3
  • 40
    • 84938573721 scopus 로고    scopus 로고
    • Improving patient prostate cancer risk assessment: Moving from static, globally-applied to dynamic, practice-specific cancer risk calculators
    • Strobl AN, Vickers AJ, van Calster B, et al. Improving patient prostate cancer risk assessment: Moving from static, globally-applied to dynamic, practice-specific cancer risk calculators. J Biomed Inform 2015; 56: 87–93.
    • (2015) J Biomed Inform , vol.56 , pp. 87-93
    • Strobl, A.N.1    Vickers, A.J.2    Van Calster, B.3
  • 41
    • 0038303186 scopus 로고    scopus 로고
    • The logistic EuroSCORE
    • Roques F. The logistic EuroSCORE. Eur Heart J 2003; 24: 882–883.
    • (2003) Eur Heart J , vol.24 , pp. 882-883
    • Roques, F.1
  • 42
    • 0032801163 scopus 로고    scopus 로고
    • European system for cardiac operative risk evaluation (EuroSCORE)
    • Nashef SAM, Roques F, Michel P, et al. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardio-Thoracic Surg 1999; 16: 9–13.
    • (1999) Eur J Cardio-Thoracic Surg , vol.16 , pp. 9-13
    • Nashef, S.A.M.1    Roques, F.2    Michel, P.3
  • 43
    • 84878182367 scopus 로고    scopus 로고
    • Dynamic trends in cardiac surgery: Why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models
    • Hickey GL, Grant SW, Murphy GJ, et al. Dynamic trends in cardiac surgery: why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models. Eur J Cardio-Thoracic Surg 2013; 43: 1146–1152.
    • (2013) Eur J Cardio-Thoracic Surg , vol.43 , pp. 1146-1152
    • Hickey, G.L.1    Grant, S.W.2    Murphy, G.J.3
  • 44
    • 84878182367 scopus 로고    scopus 로고
    • Dynamic trends in cardiac surgery: Why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models
    • Hickey GL, Grant SW, Murphy GJ, et al. Dynamic trends in cardiac surgery: why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models. Eur J Cardio-Thoracic Surg 2013; 43: 1146–1152.
    • (2013) Eur J Cardio-Thoracic Surg , vol.43 , pp. 1146-1152
    • Hickey, G.L.1    Grant, S.W.2    Murphy, G.J.3
  • 45
    • 84867905609 scopus 로고    scopus 로고
    • How does EuroSCORE II perform in UK cardiac surgery; an analysis of 23 740 patients from the Society for Cardiothoracic Surgery in Great Britain and Ireland National Database
    • Grant SW, Hickey GL, Dimarakis I, et al. How does EuroSCORE II perform in UK cardiac surgery; an analysis of 23 740 patients from the Society for Cardiothoracic Surgery in Great Britain and Ireland National Database. Heart 2012; 98: 1568–1572.
    • (2012) Heart , vol.98 , pp. 1568-1572
    • Grant, S.W.1    Hickey, G.L.2    Dimarakis, I.3
  • 46
    • 84874878139 scopus 로고    scopus 로고
    • Clinical registries: Governance, management, analysis and applications
    • Hickey GL, Grant SW, Cosgriff R, et al. Clinical registries: governance, management, analysis and applications. Eur J Cardiothorac Surg 2013; 44: 605–614.
    • (2013) Eur J Cardiothorac Surg , vol.44 , pp. 605-614
    • Hickey, G.L.1    Grant, S.W.2    Cosgriff, R.3
  • 47
    • 79953732420 scopus 로고    scopus 로고
    • Mice: Multivariate imputation by chained equations in R
    • van Buuren S and Groothuis-Oudshoorn K. mice: Multivariate imputation by chained equations in R. J Stat Softw 2011; 45: 1–67.
    • (2011) J Stat Softw , vol.45 , pp. 1-67
    • Van Buuren, S.1    Groothuis-Oudshoorn, K.2
  • 49
    • 0033574245 scopus 로고    scopus 로고
    • Assessing the generalizability of prognostic information
    • Justice AC. Assessing the generalizability of prognostic information. Ann Intern Med 1999; 130: 515–524.
    • (1999) Ann Intern Med , vol.130 , pp. 515-524
    • Justice, A.C.1
  • 51
    • 79952709519 scopus 로고    scopus 로고
    • PROC: An open-source package for R and Sþ to analyze and compare ROC curves
    • Robin X, Turck N, Hainard A, et al. pROC: an open-source package for R and Sþ to analyze and compare ROC curves. BMC Bioinform 2011; 12: 77.
    • (2011) BMC Bioinform , vol.12 , pp. 77
    • Robin, X.1    Turck, N.2    Hainard, A.3
  • 53
    • 85018749650 scopus 로고    scopus 로고
    • Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models
    • Austin PC and Steyerberg EW. Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models. Stat Methods Med Res 2017; 26: 796–808.
    • (2017) Stat Methods Med Res , vol.26 , pp. 796-808
    • Austin, P.C.1    Steyerberg, E.W.2
  • 54
    • 76749086088 scopus 로고    scopus 로고
    • Using Society of Thoracic Surgeons risk models for risk-adjusting cardiac surgery results
    • Jin R, Furnary AP, Fine SC, et al. Using Society of Thoracic Surgeons risk models for risk-adjusting cardiac surgery results. Ann Thorac Surg 2010; 89: 677–682.
    • (2010) Ann Thorac Surg , vol.89 , pp. 677-682
    • Jin, R.1    Furnary, A.P.2    Fine, S.C.3


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.