Calibration strategies to validate predictive models: Is new always better?

Intensive Care Medicine

Volumn 38, Issue 8, 2012, Pages 1246-1248

  Serrano, Nicolás ^a  

^a HOSPITAL UNIVERSITARIO DE CANARIAS   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

CALIBRATION; CLINICAL ASSESSMENT; CRITICALLY ILL PATIENT; EDITORIAL; HEALTH CARE QUALITY; HUMAN; INTENSIVE CARE UNIT; INTERMETHOD COMPARISON; INTERRATER RELIABILITY; MORTALITY; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; RISK FACTOR; SIMPLIFIED ACUTE PHYSIOLOGY SCORE 3; SIMPLIFIED ACUTE PHYSIOLOGY SCORE II; VALIDATION STUDY;

HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS; SEVERITY OF ILLNESS INDEX;

EID: 84864277424     PISSN: 03424642     EISSN: 14321238     Source Type: Journal    
DOI: 10.1007/s00134-012-2579-z     Document Type: Editorial

References (29)

1. Le Gall JR, Lemeshow S, Saulnier F (1993) A new simplified acute physiology score (SAPS II) based on A european/north american multicenter study. JAMA 270:2957-2963 (Pubitemid 24000804)
2. Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3-from evaluation of the patient to evaluation of the intensive care unit. Part 1: objectives, methods and cohort description. Intensive Care Med 31:1336-1344 (Pubitemid 41437727)
3. Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3-from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345-1355 (Pubitemid 41437728)
4. Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29-36 (Pubitemid 12142173)
5. Hosmer DW, Lemeshow S (2000) Applied logistic regression, 2nd edn. Wiley, New York
6. Kramer AA, Zimmerman JE (2007) Assessing the calibration of mortality benchmarks in critical care: the hosmer-lemeshow test revisited. Crit Care Med 35:2052-2056 (Pubitemid 47326440)
7. Hosmer DW, Hosmer T, Le CS, Lemeshow S (1997) A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 16:965-980 (Pubitemid 27198985)
8. Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J (1993) Mortality probability models (MPM II) based on an international cohort of intensive care unit patients. JAMA 270:2478-2486 (Pubitemid 23342299)
9. Finazzi S, Poole D, Luciani D, Cogo PE, Bertolini G (2011) Calibration belt for quality-of-care assessment based on dichotomous outcomes. PLoS One 6:e16110
10. Poole D, Rossi C, Latronico N, Rossi G, Finazzi S, Bertolini G (2012) Comparison between SAPS II and SAPS 3 in predicting hospital mortality in a cohort of 103 Italian ICUs. Is new always better? Intensive Care Med. doi:10.1007/s00134-012-2578-0
11. Nassar AP Jr, Mocelin AO, Nunes AL, Giannini FP, Brauer L, Andrade FM, Dias CA (2011) Caution when using prognostic models: A prospective comparison of 3 recent prognostic models. J Crit Care. doi: 10.1016/j.jcrc.2011.08.016
12. Khwannimit B, Bhurayanontachai R (2010) The performance and customization of SAPS 3 admission score in a Thai medical intensive care unit. Intensive Care Med 36:342-346
13. Poole D, Rossi C, Anghileri A, Giardino M, Latronico N, Radrizzani D, Langer M, Bertolini G (2009) External validation of the simplified acute physiology score (SAPS) 3 in a cohort of 28,357 patients from 147 italian intensive care units. Intensive Care Med 35:1916-1924
14. Khwannimit B, Bhurayanontachai R (2011) A comparison of the performance of Simplified Acute Physiology Score 3 with old standard severity scores and customized scores in a mixed medical-coronary care unit. Minerva Anestesiol 77:305-312
15. Capuzzo M, Scaramuzza A, Vaccarini B, Gilli G, Zannoli S, Farabegoli L, Felisatti G, Davanzo E, Alvisi R (2009) Validation of SAPS 3 admission score and comparison with SAPS II. Acta Anaesthesiol Scand 53:589-594
16. Sakr Y, Krauss C, Amaral AC, Rea-Neto A, Specht M, Reinhart K, Marx G (2008) Comparison of the performance of SAPS II, SAPS 3, APACHE II, and their customized prognostic models in a surgical intensive care unit. Br J Anaesth 101:798-803
17. Ledoux D, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34:1873-1877
18. Silva Junior JM, Malbouisson LM, Nuevo HL, Barbosa LG, Marubayashi LY, Teixeira IC, Nassar Junior AP, Carmona MJ, Silva IF, Auler Junior JO, Rezende E (2010) Applicability of the Simplified Acute Physiology Score (SAPS 3) in Brazilian hospitals. Rev Bras Anestesiol 60:20-31
19. Mbongo CL, Monedero P, Guillen-Grima F, Yepes MJ, Vives M, Echarri G (2009) Performance of SAPS 3, compared with APACHE II and SOFA, to predict hospital mortality in a general ICU in Southern Europe. Eur J Anaesthesiol 26:940-945
20. Costa e Silva VT, de Castro I, Liano F, Muriel A, Rodriguez-Palomares JR, Yu L (2011) Performance of the third-generation models of severity scoring systems (APACHE IV, SAPS 3 and MPM-III) in acute kidney injury critically ill patients. Nephrol Dial Transplant 26:3894-3901
21. Lim SY, Ham CR, Park SY, Kim S, Park MR,JeonK,UmSW,ChungMP,KimH, Kwon OJ, Suh GY (2011) Validation of the Simplified Acute Physiology Score 3 scoring systemin a Korean intensive care unit. Yonsei Med J 52:59-64
22. Soares M, Silva UV, Teles JM, Silva E, Caruso P, Lobo SM, Dal PF, Azevedo LP, de Carvalho FB, Salluh JI (2010) Validation of four prognostic scores in patients with cancer admitted to brazilian intensive care units: results from a prospective multicenter study. Intensive Care Med 36:1188-1195
23. Maccariello E, Valente C, Nogueira L, Bonomo H, Ismael M, Machado JE, Baldotto F, Godinho M, Valenca R, Rocha E, Soares M (2010) SAPS 3 scores at the start of renal replacement therapy predict mortality in critically ill patients with acute kidney injury. Kidney Int 77:51-56
24. Metnitz B, Schaden E, Moreno R, Le Gall JR, Bauer P, Metnitz PG (2009) Austrian validation and customization of the SAPS 3 admission score. Intensive Care Med 35:616-622
25. Tsai CW, Lin YF, Wu VC, Chu TS, Chen YM, Hu FC, Wu KD, Ko WJ (2008) SAPS 3 at dialysis commencement is predictive of hospital mortality in patients supported by extracorporeal membrane oxygenation and acute dialysis. Eur J Cardiothorac Surg 34:1158-1164
26. Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839-1844 (Pubitemid 44607374)
27. Strand K, Soreide E, Aardal S, Flaatten H (2009) A comparison of SAPS II and SAPS 3 in A norwegian intensive care unit population. Acta Anaesthesiol Scand 53:595-600
28. Zajac K, Andres J, Zajac M (2009) A comparison of SAPS 2 and SAPS 3. Acta Anaesthesiol Scand 53:1230-1231
29. Strand K, Strand LI, Flaatten H (2010) The interrater reliability of SAPS II and SAPS 3. Intensive Care Med 36:850-853