Outcome prediction in critical care: The Acute Physiology and Chronic Health Evaluation models

Current Opinion in Critical Care

Volumn 14, Issue 5, 2008, Pages 491-497

  Zimmerman, Jack E ^a,b   Kramer, Andrew A ^b,c  

^a GEORGE WASHINGTON UNIVERSITY   (United States)

^b CERNER CORPORATION   (United States)

^c NONE   (United States)

Author keywords

Intensive care unit; Patient outcome assessment; Quality assessment; Risk adjustment; Severity of illness index

Indexed keywords

ACCURACY; DATA BASE; DIAGNOSTIC ACCURACY; DISEASE SEVERITY; HEALTH CARE QUALITY; HOSPITAL EQUIPMENT; HOSPITALIZATION; HUMAN; INTENSIVE CARE; INTENSIVE CARE UNIT; MORTALITY; OUTCOME ASSESSMENT; PROCESS MODEL; PROGNOSIS; RESOURCE MANAGEMENT; REVIEW; RISK ASSESSMENT;

APACHE; CRITICAL CARE; HUMANS; OUTCOME ASSESSMENT (HEALTH CARE); SEVERITY OF ILLNESS INDEX;

EID: 55349117148     PISSN: 10705295     EISSN: 15317072     Source Type: Journal    
DOI: 10.1097/MCC.0b013e32830864c0     Document Type: Review

References (44)

1. Knaus WA, Draper EA, Wagner DP, et al. Evaluating outcome from intensive care: a preliminary multihospital comparison. Crit Care Med 1982; 10:491-496.
2. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med 1985; 13:818-828.
3. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991; 100:1619-1638.
4. Becker RB, Zimmerman JE, Knaus WA, et al. The use of APACHE III to evaluate ICU length of stay, resource use, and mortality after coronary artery bypass surgery. J Cardiovasc Surg 1995; 36:1-11.
5. Zimmerman JE, Wagner DP, Draper EA, et al. Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med 1998; 26:1317-1326.
6. Rosenberg AL, Zimmerman JE, Alzola C, et al. Intensive care unit length of stay: recent changes and future challenges. Crit Care Med 2000; 28:3465-3473.
7. Glance LG, Osler TM, Dick A. Rating the quality of intensive care units: is it a function of the intensive care unit scoring system? Crit Care Med 2002; 30:1976-1982.
8. Harrison DA, Brady AR, Parry GJ, et al. Recalibration of risk prediction models In a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 2006; 34:1378-1388. This study describes a head-to head comparison of the accuracy of APACHE II, APACHE III, SAPS II, and MPM II for predicting mortality among 231 930 ICU admissions in the UK. The results demonstrate the limitations of recalibration, the need to use quantitative measures to assess calibration, and the hazards of using risk-adjustment models internationally.
9. Kramer A. Predictive mortality models are not like fine wine. Crit Care 2005; 9:636-637.
10. Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med 2006; 34:1297-1310. This study describes the APACHE IV model for predicting group hospital mortality. The obsolescence of APACHE II and III for mortality prediction, the importance of ICU admission diagnosis as an outcome predictor, and the value of including new variables in enhancing prognostic accuracy are documented.
11. Kramer AA, Zimmerman JE. Predicting outcomes for cardiac surgery patients after intensive care admission. J Cardiothorac Vasc Anesth (in press). A comprehensive review of the models used to predict hospital mortality and resource use based on data obtained after CABG surgery and cardiac valve surgery. This study describes the evolution, rationale, and accuracy of APACHE models used for cardiac surgery patients as well as patients who have had vascular and thoracic procedures.
12. Junker C, Zimmerman JE, Alzola C, et al. A multicenter description of intermediate care patients: comparison with ICU low risk monitor patients. Chest 2002; 121:1253-1261.
13. Kahn JM, Goss CH, Heagerty PJ, et al. Hospital volume and the outcomes of mechanical ventilation. N Engl J Med 2006; 355:41-50.
14. Zimmerman JE, Kramer AA, McNair DS, et al. Intensive care unit length of stay: benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV. Crit Care Med 2006; 34:2517-2529.
15. Marik PE, Hedman L. What's in a day? Determining intensive care unit length of stay. Crit Care Med 2000; 28:2090-2093.
16. Render ML, Kim HM, Deddens J, et al. Variation in outcomes in Veterans Affairs intensive care units with a computerized severity measure. Crit Care Med 2005; 33:930-939.
17. Zimmerman JE, Alzola C, Von Rueden KT. The use of benchmarking to identify top performing critical care units: a preliminary assessment of their policies and practices. J Crit Care 2003; 18:76-86.
18. Wagner DP, Knaus WA, Harrell FE, et al. Daily prognostic estimates for critically ill adults in intensive care units: results from a prospective multicenter, inception cohort analysis. Crit Care Med 1994; 22:1359-1372.
19. Zimmerman JE, Wagner DP, Seneff MG, et al. Intensive care unit admissions with cirrhosis: risk stratifying patient groups and predicting individual survival. Hepatology 1996; 23:1393-1401.
20. Esserman L, Beklora J, Lenart L. Potentially ineffective care: a new outcome to assess the limits of critical care. JAMA 1995; 274:1544-1551.
21. Fleegler BM, Jackson DK, Turnbull J, et al. Identifying potentially ineffective care in a community hospital. Crit Care Med 2002; 30:1803-1807.
22. Moreno RP, Metnitz PGH, Almeida E, et al. SAPS 3: from evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005; 31:1345-1355.
23. o-III). Crit Care Med 2007; 35:827-835. This manuscript describes the extent of over prediction by the 1993 version of the Mortality Probability Admission Model in contemporary practice and the development and validation of an updated and revised version.
24. Harrison DA, Parry GJ, Carpenter JR, et al. A new risk prediction model for critical care: the Intensive Care National Audit & Research Centre (ICNARC) model. Crit Care Med 2007; 35:1091-1098. Using a database comprised of data used for APACHE II, APACHE III, SAPS II, and MPM II mortality predictions, this model was developed to provide risk adjustment among UK ICUs.
25. Nathanson BH, Higgins TL, Teres D, et al. A revised method to assess intensive care unit clinical performance and resource utilization. Crit Care Med 2007; 35:1853-1862.
26. Rothen HU, Stricker K, Einfalt J, et al. Variability in outcome and resource use in intensive care units. Intensive Care Med 2007; 33:1329-1336. This article describes differences in standardized mortality ratios and resource use based on ICU LOS among ICUs that were part of the SAPS 3 database.
27. Bakhshi-Raiez F, Peek N, Bosman RJ, et al. The impact of different prognostic models and their customization on institutional comparison of intensive care units. Crit Care Med 2007; 35:2553-2560. The results from this study show that ICU performance rankings based on case-mix adjusted league tables are sensitive to the prognostic model used, but not to customization. The study also documents the importance of displaying the uncertainty associated with performance ranking based on league tables.
28. Moreno R, Miranda DR, Fidler V, Schilfgaarde RV. Evaluation of two outcome prediction models on an independent database. Crit Care Med 1998; 26:50-61.
29. Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med 2007; 35:2052-2056. This study describes information that must be considered when evaluating model calibration using the Hosmer-Lemeshow test. It highlights the importance of the number of patients, observed and predicted probabilities by decile, and quantitative measures of calibration.
30. Zimmerman JE, Draper EA, Wagner DP. Comparing ICU populations: background and current methods. In: Sibbald WJ, Bion JF, editors. Evaluating critical care. Berlin: Springer Verlag; 2001. pp. 121-139.
31. Beck DH, Smith GB, Pappachan JV, et al. External validation of the SAPS II, APACHE II, and APACHE III prognostic models in South England: a multicentre study. Intensive Care Med 2003; 29:249-256.
32. Render ML, Deddens J, Freyberg R, et al. The VA ICU risk adjustment model: validation, updating, recalibration. Crit Care Med 2008; 36:1031-1042. This article describes and updates the fully automated Veterans Administration ICU risk adjustment model. This model demonstrates the power of computerized measurement and its utility for widespread evaluation of variability in ICU outcomes.
33. Golestanian E, Scruggs JE, Gagnon RE, et al. Effect of interhospital transfer on resource utilization and outcomes at a tertiary care referral center. Crit Care Med 2007; 35:1470-1476. This analysis confirms the accuracy of the adjustments used by APACHE III for predicting mortality and length of stay among patients transferred to a large tertiary care center. It includes an excellent discussion of why these results differ from those of prior studies.
34. Azoulay E, Pochard F, Garrouste-Orgeas M, et al. Decisions to forgo life-sustaining therapy in ICU patients independently predict hospital death. Intensive Care Med 2003; 29:1895-1901.
35. Angstwurm MWA, Dempfle CE, Spannagl M. New disseminated intravascular coagulation score: a useful tool to predict mortality in comparison with Acute Physiology and Chronic Health Evaluation II and Logistic Organ Dysfunction scores. Crit Care Med 2006; 34:314-320.
36. Strauss R, Wehler M, Mehler K, et al. Thrombocytomenia in patients in the medical intensive care unit: bleeding prevalence, transfusion requirements, and outcome. Crit Care Med 2002; 30:1765-1771.
37. Nasraway SA, Albert M, Donnelly AM, et al. Morbid obesity is an independent determinant of death among surgical critically ill patients. Crit Care Med 2006; 34:964-970.
38. O'Brien JM, Phillips GS, Ali N, et al. Body mass index is independently associated with hospital mortality in mechanically ventilated adults with acute lung injury. Crit Care Med 2006; 34:738-744.
39. Cartin-Ceba R, Afessa B, Gajic O. Low baseline serum creatinine concentration predicts mortality in critically ill patients independent of body mass index. Crit Care Med 2007; 34:2420-2423.
40. Chalfin DB, Trzeciak S, Likourezos A, et al. Impact of delayed transfer of critically ill patients from the emergency department to the intensive care unit. Crit Care Med 2007; 35:1477-1483. This analysis suggests that for critically ill emergency room patients, a delay in ICU admission hour of 6 h or greater is associated with increased hospital mortality and length of stay. This article highlights the need to consider admission delays as a cause of excess mortality and ICU stay compared to expected benchmarks.
41. Render ML, Kim HM, Welsh OE, et al. Automated intensive care unit risk adjustment: results from a National Veterans Affairs study. Crit Care Med 2003; 31:1638-1646.
42. Kahn JM, Kramer AA, Rubenfeld GD. Transferring critically ill patients out of the hospital improves the standardized mortality ratio. Chest 2007; 131:68-75. A simulation study that shows how a small increase in out of hospital transfers can bias an ICU's standardized mortality ratio. A 2 or 6% increase in transfers can make a low performing ICU appear to be high performing.
43. Sirio CA. Critical care performance measurement: the time has come for all [editorial]. Crit Care Med 2006; 34:1538-1539.
44. Lilford R, Mohammed MA, Spiegelhalter D, et al. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet 2004; 363:1147-1154.