The ANZROD model: Better benchmarking of ICU outcomes and detection of outliers

Critical Care and Resuscitation

Volumn 18, Issue 1, 2016, Pages 25-36

  Paul, Eldho ^a   Bailey, Michael ^a   Kasza, Jessica ^a   Pilcher, David ^a,b,c  

^a MONASH UNIVERSITY   (Australia)

^b Australian and New Zealand Intensive Care Society   (Australia)

^c ALFRED HOSPITAL   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANIMAL MODEL; APACHE; BENCHMARKING; CLINICAL STUDY; CONTROLLED STUDY; DATA BASE; DEATH; DISEASE MODEL; HUMAN; INTENSIVE CARE UNIT; LOGISTIC REGRESSION ANALYSIS; NEW ZEALAND; PEER GROUP; STANDARDIZED MORTALITY RATIO; ARTICLE; INTENSIVE CARE; MORTALITY; OUTCOME ASSESSMENT; PRIVATE HOSPITAL; AUSTRALIA; DIAGNOSIS RELATED GROUP; QUALITY CONTROL; THEORETICAL MODEL;

APACHE; AUSTRALIA; BENCHMARKING; CRITICAL CARE; HUMANS; MODELS, THEORETICAL; NEW ZEALAND; OUTCOME ASSESSMENT (HEALTH CARE); OUTLIERS, DRG;

EID: 84979865060     PISSN: 14412772     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (40)

1. Pilcher DV, Hoffman T, Thomas C, et al. Risk-adjusted continuous outcome monitoring with an EWMA chart: could it have detected excess mortality among intensive care patients at Bundaberg Base Hospital? Crit Care Resusc 2010; 12: 36-41.
2. Knaus WA, Zimmerman JE, Wagner DP, et al. APACHE — acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med 1981; 9: 591-7.
3. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med 1985; 13: 818-29.
4. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991; 100: 1619-36.
5. Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med 2006; 34: 1297-310.
6. Le Gall JR, Loirat P, Alperovitch A, et al. A simplified acute physiology score for ICU patients. Crit Care Med 1984; 12: 975-7.
7. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 1993; 270: 2957-63.
8. Metnitz PG, Moreno RP, Almeida E, et al. SAPS 3 — From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 2005; 31: 1336-44.
9. Moreno RP, Metnitz PG, Almeida E, et al. SAPS 3 — from evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005; 31: 1345-55.
10. Lemeshow S, Teres D, Pastides H, et al. A method for predicting survival and mortality of ICU patients using objectively derived weights. Crit Care Med 1985; 13: 519-25.
11. Lemeshow S, Teres D, Klar J, et al. Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993; 270: 2478-86.
12. Lemeshow S, Klar J, Teres D, et al. Mortality probability models for patients in the intensive care unit for 48 or 72 hours: a prospective, multicenter study. Crit Care Med 1994; 22: 1351-8.
13. Higgins TL, Teres D, Copes WS, et al. Assessing contemporary intensive care unit outcome: an updated Mortality Probability Admission Model (MPM0-III). Crit Care Med 2007; 35: 827-35.
14. Zimmerman D. Benchmarking: measuring yourself against the best. Trustee 1999; 52: 22-3.
15. Zimmerman JE, Alzola C, Von Rueden KT. The use of benchmarking to identify top performing critical care units: a preliminary assessment of their policies and practices. J Crit Care 2003; 18: 76-86.
16. Duke GJ, Santamaria J, Shann F, et al. Critical care outcome prediction equation (COPE) for adult intensive care. Crit Care Resusc 2008; 10: 35-41.
17. Paul E, Bailey M, Van Lint A, Pilcher D. Performance of APACHE III over time in Australia and New Zealand: a retrospective cohort study. Anaesth Intensive Care 2012; 40: 980-94.
18. Paul E, Bailey M, Pilcher D. Risk prediction of hospital mortality for adult patients admitted to Australian and New Zealand intensive care units: development and validation of the Australian and New Zealand Risk of Death model. J Crit Care 2013; 28: 935-41.
19. Spiegelhalter D. Funnel plots for institutional comparison. Qual Saf Health Care 2002; 11: 390-1.
20. Spiegelhalter DJ. Funnel plots for comparing institutional performance. Stat Med 2005; 24: 1185-202.
21. Armitage P, Berry G, Matthews J. Statistical methods in medical research. 4th ed. Blackwell Science, 2002.
22. Moran JL, Bristow P, Solomon PJ, et al. Mortality and lengthof- stay outcomes, 1993-2003, in the binational Australian and New Zealand intensive care adult patient database. Crit Care Med 2008; 36: 46-61.
23. Stow PJ, Hart GK, Higlett T, et al. Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. J Crit Care 2006; 21: 133-41.
24. Seaton SE, Barker L, Lingsma HF, et al. What is the probability of detecting poorly performing hospitals using funnel plots? BMJ Qual Saf 2013; 22: 870-6.
25. Spiegelhalter DJ. Handling over-dispersion of performance indicators. Qual Saf Health Care 2005; 14: 347-51.
26. Akaike H. A new look at the statistical model identification. IEEE Trans Automat Cont 1974; 19: 716-23.
27. Schwarz G. Estimating the dimension of a model. Ann Statistics 1978; 6: 461-4.
28. Afessa B, Keegan MT, Hubmayr RD, et al. Evaluating the performance of an institution using an intensive care unit benchmark. Mayo Clin Proc 2005; 80: 174-80.
29. Beck DH, Smith GB, Taylor BL. The impact of low-risk intensive care unit admissions on mortality probabilities by SAPS II, APACHE II and APACHE III. Anaesthesia 2002; 57: 21-6.
30. Glance LG, Osler TM, Dick A. Rating the quality of intensive care units: is it a function of the intensive care unit scoring system? Crit Care Med 2002; 30: 1976-82.
31. Zimmerman JE, Shortell SM, Rousseau DM, et al. Improving intensive care: observations based on organizational case studies in nine intensive care units: a prospective, multicenter study. Crit Care Med 1993; 21: 1443-51.
32. Moreno R, Apolone G, Miranda DR. Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 1998; 24: 40-7.
33. Glance LG, Osler TM, Papadakos P. Effect of mortality rate on the performance of the Acute Physiology and Chronic Health Evaluation II: a simulation study. Crit Care Med 2000; 28: 3424-8.
34. Metnitz PG, Lang T, Vesely H, et al. Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 2000; 26: 1466-72.
35. Kasza J, Moran JL, Solomon PJ; ANZICS Centre for Outcome and Resource Evaluation (CORE) of Australian and New Zealand Intensive Care Society (ANZICS). Evaluating the performance of Australian and New Zealand intensive care units in 2009 and 2010. Stat Med 2013; 32: 3720-36.
36. Moran JL, Solomon PJ; ANZICS Centre for Outcome and Resource Evaluation (CORE) of Australian and New Zealand Intensive Care Society (ANZICS). Fixed effects modelling for provider mortality outcomes: analysis of the Australia and New Zealand Intensive Care Society (ANZICS) Adult Patient Database. PLoS One 2014; 9: e102297.
37. Solomon PJ, Kasza J, Moran JL; ANZICS Centre for Outcome and Resource Evaluation (CORE) of Australian and New Zealand Intensive Care Society (ANZICS). Identifying unusual performance in Australian and New Zealand intensive care units from 2000 to 2010. BMC Med Res Methodol 2014; 14: 53.
38. Australian and New Zealand Intensive Care Society Centre for Outcome and Resource Evaluation. Annual report 2012–13. Melbourne: ANZICS CORE, 2014.
39. Kramer AA, Higgins TL, Zimmerman JE. Comparing observed and predicted mortality among ICUs using different prognostic systems: why do performance assessments differ? Crit Care Med 2015; 43: 261-9.
40. Wunsch H, Brady AR, Rowan K. Impact of exclusion criteria on case mix, outcome, and length of stay for the severity of disease scoring methods in common use in critical care. J Crit Care 2004; 19: 67-74.