Outcome prediction in critical care: The mortality probability models

Current Opinion in Critical Care

Volumn 14, Issue 5, 2008, Pages 498-505

  Higgins, Thomas L ^a,b   Teres, Daniel ^b   Nathanson, Brian ^c  

^a BAYSTATE MEDICAL CENTER   (United States)

^b TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c OptiStatim LLC   (United States)

Author keywords

Intensive care; Length of stay; Mortality probability model; Severity adjustment; Transparency

Indexed keywords

DISEASE SEVERITY; HEALTH CARE QUALITY; HOSPITAL ADMISSION; HOSPITALIZATION; HUMAN; INTENSIVE CARE; INTENSIVE CARE UNIT; INTERMETHOD COMPARISON; MORBIDITY; MORTALITY; PATIENT CODING; PROCESS MODEL; PROGNOSIS; REVIEW;

APACHE; CRITICAL CARE; FORECASTING; HOSPITAL MORTALITY; HUMANS; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); SEVERITY OF ILLNESS INDEX;

EID: 55349132746     PISSN: 10705295     EISSN: 15317072     Source Type: Journal    
DOI: 10.1097/MCC.0b013e3283101643     Document Type: Review

References (57)

1. Halpern NA, Pastores SM, Thaler HT, Greenstein RJ. Changes in critical care beds and occupancy in the United States 1985-2000: differences attributable to hospital size. Crit Care Med 2006; 34:2105-2112.
2. Goodman JC. Transparency in Healthcare: brief analysis, no. 548. National Center for Policy Analysis. 29 March 2006.
3. Higgins TL, McGee WT, Circeo LE, Teres D. Total quality management in the intensive care unit. In: Irwin RS, Rippe JM, editors. Intensive care medicine, 5th ed. Philadelphia, PA: Lippincott Williams and Wilkins; 2003 pp. 2232-2242.
4. Lemeshow S, Teres D, Pastides H, et al. A method for predicting survival and mortality of ICU patients using objectively derived weights. Crit Care Med 1985; 13:519-525.
5. Lemeshow S, Teres D, Klar J, et al. Mortality Probability Model (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993; 270:2478-2486.
6. 0-III model is covered in this recent article. An important point is that every one of the major severity-of-illness models have demonstrated deterioration in calibration over time suggesting that contemporary evaluation requires models to be updated at 5-10 year periods.
7. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med 1985; 13:818-825.
8. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III Prognostic System: Risk prediction of hospital mortality for critically ill hospitalized adults. CHEST 1991; 100:1619-1636.
9. Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med 2006; 34:1297-1310.
10. Le Gall J-R, Loirat P, Alperovitch A, et al. a Simplified Acute Physiology score for ICU patients. Crit Care Med 1984; 12:975-977.
11. Le Gall J-R, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 1993:2957-2963.
12. Moreno RP, Metnitz PGH, Almeida E, et al. SAPS 3 - from evaluation of the patient to evaluation of the intensive care unit. Part 2. Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005; 31:1345-1355.
13. Harrison DA, Brady AR, Parry GJ, et al. Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 2006; 34:1378-1388.
14. Lemeshow S, Klar J, Teres D, et al. Mortality Probability Models for patients in the intensive care unit for 48 to 72 h: a prospective, multicenter study. Crit Care Med 1994; 22:1351-1358.
15. Murphy-Filkins RL, Teres D, Lemeshow S, Hosmer DW. Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: how to distinguish a general from a specialty intensive care unit. Crit Care Med 1996; 24:1968-1973.
16. Project IMPACT. www.cerner.com/PICCM. [Accessed on 23 January 2008].
17. Glance LG, Osier TM, Dick A. Rating the quality of intensive care units: is it a function of the intensive care unit scoring system? Crit Care Med 2002; 30:1976-1982.
18. Rapoport J, Teres D, Lemeshow S, et al. Explaining variability of cost using a severity-of-illness measure for ICU patients. Med Care 1990; 28:338-348.
19. Lemeshow S, Hosmer DW. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 1982; 115:92-106.
20. Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240:1285-1293.
21. 0-III) for specialized patient populations. Poster presentation at Chest 2005; 29 October-3 November 2005; Montreal. CHEST 2005;128(4 Suppl):349S.
22. Wagner DP, Knaus WA, Harrell FE, et al. Daily prognostic estimates for critically ill adults in intensive care units: results from a prospective, multicenter, inception cohort analysis. Crit Care Med 1994; 11:1359-1372.
23. Barie PS, Hydo IJ, Fischer E. Development of multiple organ dysfunction syndromes in critically ill patients with perforated viscus. Arch Surg 1996; 131:37-43.
24. Timsit JF, Fosse JP, Trouché G, et al. Accuracy of a composite score using daily SAPS II and LOD scores for predicting hospital mortality in ICU patients hospitalized for more than 72 h. Intensive Care Med 2001; 27:1012-1021.
25. Chang RWS, Jacobs S, Lee B. use of APACHE II severity of disease classification to identify intensive care unit patients who would not benefit from total parenteral nutrition. Lancet 1986; 1:1483-1487.
26. Rogers J, Fuller HD. Use of daily Acute Physiology and Chronic health Evaluation (APACHE) II scores to predict individual patient survival rate. Crit Care Med 1994; 22:1402-1405.
27. Zimmerman JE, Wagner DP, Draper EA, et al. Improving intensive care unit discharge decisions: supplementing physician judgment with predictions of next day risk for life support. Crit Care Med 1994; 22:1373-1384.
28. Glance LG, Osler TM, Papadakos P. Effect of mortality rate on the performance of the Acute Physiology and Chronic Health Evaluation II: a simulation study. Crit Care Med 2000; 28:3424-3428.
29. Nathanson B, Higgins TL, Teres D, et al. A revised method to assess ICU clinical performance and resource utilization. Crit Care Med 2007; 35:1853-1862. The Rapoport-Teres graph is used to assess ICU performance in Project IMPACT. With the updating of the MPM model to the third edition, it was also to update the Rapoport-Teres model that is discussed in this article by Nathanson and colleagues.
30. Teres D, Higgins T, Steingrub J, et al. Defining a high-performance ICU system for the 21st century: a position paper. J Intensive Care Med 1998; 13:195-205.
31. Higgins TL, Estafanous FG, Loop FD, et al. Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. A clinical severity score. JAMA 1992; 267:2344-2348.
32. Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med 2007; 35:2052-2056. Early prognostic models were based on hundreds or a few thousand patients. With the advent of large, multicenter databases it now is possible to develop models on 100 000 patients or more. With such large numbers, even clinically inconsequential differences can reach statistical significance. In addition, the statistical techniques for evaluating model calibration are affected by the sample size. Kramer and Zimmerman discuss the pitfalls of using the Hosmer-Lemeshow goodness-of-fit test when models are developed using extremely large databases.
33. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983; 148:839-843.
34. Castella X, Artigas A, Bion J, Kari A. A comparison of severity of illness scoring systems for intensive care unit patients: results of a multicenter, multinational study. The European/North American Severity Study Group. Crit Care Med 1995; 23:1327-1335.
35. Higgins TL, Kramer AA, Nathanson BH, et al. Prospective validation of the Mortality Probability Model, Version II. Presented at the European Society for Intensive Care Medicine (ESICM) 20th Annual Congress; Berlin; 9 October 2007.
36. Escarce JJ, Kelley MA. Admission source to the medical intensive care unit predicts hospital death independent of APACHE II score. JAMA 1990; 264:2389-2394.
37. McQuillan P, Pilkington S, Allan A, et al. Confidential inquiry into quality of care before admission to intensive care. Br Med J 1998; 316:1853-1858.
38. Cook SF, Visscher WA, Hobbs CL, et al. Project IMPACT: results from a pilot validity study of a new observational database. Grit Care Med 2002; 34:2302-2308.
39. Teres D, Rapoport J, Lemeshow S, et al. Effects of severity of illness on resource use by survivors and nonsurvivors of severe sepsis at intensive care unit admission. Crit Care Med 2002; 30:2413-2419.
40. 0. Crit Care Med 2002; 30:1995-2002.
41. Cominotti S, Chiaranda M, Mascetti P, et al. Comparison of SAPS II, MPM1124 and SAPS in intensive care. Minerva Anestesiol 1999; 65:717-723.
42. Rue M, Valero C, Quintana S, et al. Interobserver variability of the measurement of the mortality probability models (MPM II) in the assessment of severity of illness. Intensive Care Med 2000; 26:286-291.
43. Kim EK, Kwon YD, Hwang JH. Comparing the performance of three severity systems for ICU patients: APACHE III, SAPS II, MPM II. J Prev Med Pub Health 2005; 38:276-282.
44. Arabi Y, Goraj R, Al-Shimemeri A, Al-Malik S. Can we predict prognosis using mortality probability model IIo? Saudi Med J 2002; 23:1115-1119.
45. Rue M, Artigas A, Alvarez M, et al. Performance of the Mortality Probability Models in assessing severity of illness during the first week in the intensive care unit. Crit Care Med 2000; 28:2819-2824.
46. Chao C-L Comparison of predictive accuracy among six prognosis prediction systems for patient mortality in intensive care units. J Formos Med Assoc 2002; 101:406-415.
47. Patel PA, Grant BJ. Application of mortality prediction systems to individual intensive care units. Intensive Care Med 1999; 25:977-982.
48. Puig-Junoy J. Technical efficiency in the clinical management of critically ill patients. Health Econ 1998; 7:263-277.
49. Tremblay A, Bandi V. Impact of body mass index on outcomes following critical care. Chest 2003; 123:1202-1207.
50. Aggarwal AN, Sarkar P, Gupta D, Jindal SK. Performance of standard severity scoring systems for outcome prediction in patients admitted to a respiratory intensive care unit in North India. Respirology 2006; 11:196-204.
51. Carson SS, Bach PB. Predicting mortality in patients suffering from prolonged critical illness: an assessment of four severity-of-illness measures. Chest 2001; 120:928-933.
52. Saadat-Niaki A, Abtahi D. Predicting the risk of death in patients in intensive care unit. Arch Iranian Med 2007; 10:321-326.
53. Hyam JA, Welch CA, Harrison DA, Menon DK. Case mix, outcomes and comparison of risk prediction models for admissions to adult, general and specialist critical care units for head injury: a secondary analysis of the ICNARC Case Mix Programme Database. Crit Care 2006; 10:S2.
54. Moreno R, Miranda DR, Fidler V, et al. Evaluation of two outcome prediction models on an independent database. Crit Care Med 1998; 26:50-61.
55. Livingston BM, MacKirdy FN, Howie JC, et al. Assessment of the performance of five intensive care scoring models within a large Scottish database. Crit Care Med 2000; 28:1820-1827.
56. Fischler L, Lelais F, Young J, et al. Assessment of three different mortality prediction models in four well defined critical care patient groups at two points in time: a prospective cohort study. Eur J Anaesthesiol 2007; 24:676-683.
57. 0-III is a viable alternative and can be collected at lower cost and in about one-third the amount of time as APACHE-IV without substantial loss in accuracy.