Evaluating the performance of Australian and New Zealand intensive care units in 2009 and 2010

Statistics in Medicine

Volumn 32, Issue 21, 2013, Pages 3720-3736

  Kasza, J ^a   Moran, J L ^b   Solomon, P J ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b QUEEN ELIZABETH HOSPITAL   (Australia)

Author keywords

Hierarchical models; Institutional comparisons; Intensive care; Mortality rates; Regression to the mean

Indexed keywords

ADULT; AREA UNDER THE CURVE; ARTICLE; AUSTRALIA; BAYES THEOREM; COMPARATIVE STUDY; CONTROLLED STUDY; DATA BASE; FEMALE; HEALTH CARE QUALITY; HUMAN; INTENSIVE CARE UNIT; KERNEL METHOD; LOGISTIC REGRESSION ANALYSIS; MAJOR CLINICAL STUDY; MALE; NEW ZEALAND; PERFORMANCE; PREDICTION; PRIVATE HOSPITAL; RECEIVER OPERATING CHARACTERISTIC; RISK ASSESSMENT; RURAL HEALTH CARE; STANDARDIZED MORTALITY RATIO; STATISTICAL MODEL; TERTIARY HEALTH CARE;

HIERARCHICAL MODELS; INSTITUTIONAL COMPARISONS; INTENSIVE CARE; MORTALITY RATES; REGRESSION-TO-THE-MEAN;

AUSTRALIA; DATABASES, FACTUAL; FEMALE; HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS; MALE; MODELS, STATISTICAL;

EID: 84883133414     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.5779     Document Type: Article

References (40)

1. Australian Government. A national health and hospitals network for Australia's future: Delivering the reforms. Technical Report, Commonwealth of Australia, Canberra, 2010.
2. Australian Government. National health reform: Progress and delivery. Technical Report, Commonwealth of Australia, September 2011.
3. Moran JL, Solomon PJ, Hart GK. Mortality and length-of-stay outcomes, 1993-2003, in the binational Australian and New Zealand Intensive Care Adult Patient Database. Critical Care Medicine 2008; 36(1):46-61.
4. Stow PJ, Hart GK, Higlett T, George C, Herkes R, McWilliam D, Bellomo R, ANZICS Database Management Committee. Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. Journal of Critical Care 2006; 21:133-141.
5. Ohlssen DI, Sharples LD, Spiegelhalter DJ. A hierarchical modelling framework for identifying unusual performance in health care providers. Journal of the Royal Statistical Society. Series A 2007; 170(4):865-890.
6. Jones HE, Spiegelhalter DJ. Accounting for regression-to-the-mean in tests for recent changes in institutional performance: analysis and power. Statistics in Medicine 2009; 28:1645-1667.
7. Spiegelhalter DJ. Funnel plots for comparing institutional performance. Statistics in Medicine 2005; 24:1185-1202.
8. Breslow MJ, Badawi O. Severity scoring in the critically ill: part 1- interpretation and accuracy of outcome prediction scoring systems. Chest 2012; 141:245-252.
9. Glance LG, Dick AW, Osler TM, Mukamel D. Using hierarchical modeling to measure ICU quality. Intensive Care Medicine 2003; 29:2223-2229.
10. Kuzniewicz MW, Vasilevskis EE, Lane R, Dean ML, Trivedi NG, Rennie DJ, Clay T, Kotler PL, Dudley RA. Variation in ICU risk-adjusted mortality: impact of methods of assessment and potential confounders. Chest 2008; 133(6):1319-1327.
11. Cook DA, Duke G, Hart GK, Pilcher D, Mullany D. Review of the application of risk-adjusted charts to analyse mortality outcomes in critical care. Critical Care and Resuscitation 2008; 10(3):239-251.
12. ANZICS Centre of Outcome and Resource Evaluation. 2010 annual report, Technical Report Technical Report, ANZICS Centre of Outcome and Resource Evaluation, 2010. Available from: http://www.anzics.com.au/downloads/cat_view/4-centre-for-outcome-and-resource-evaluation-core/84-core-annual-reports (accessed March 2013).
13. DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, Mark DB. Comparing risk-adjustment methods for provider profiling. Statistics in Medicine 1997; 16:2645-2664.
14. Jones HE, Spiegelhalter DJ. The identification of "unusual" health-care providers from a hierarchical model. The American Statistician 2011; 65(3):154-163.
15. Normand SLT, Glickman ME, Gatsonis CA. Statistical methods for profiling providers of medical care: issues and applications. Journal of the American Statistical Association 1997; 92(439):803-814.
16. Goldstein H, Spiegelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. Journal of the Royal Statistical Society. Series A 1996; 159(3):385-443.
17. Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A, Harrell FE Jr. The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized patients. Chest 1991; 100:1619-1636.
18. Hosmer DW, Lemeshow S. Confidence interval estimates of an index of quality performance based on logistic regression models. Statistics in Medicine 1995; 14:2161-2172.
19. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B. 1995; 57:289-300.
20. Jones HE, Ohlssen DI, Spiegelhalter DJ. Use of the false discovery rate when comparing multiple health care providers. Journal of Clinical Epidemiology 2008; 61:232-240.
21. Moran JL, Solomon PJ, ANZICS Centre for Outcome and Resource Evaluation (CORE) of the Australian and New Zealand Intensive Care Society. Mortality and intensive care volume in ventilated patients, 1995-2009, in the Australian and New Zealand bi-national adult patient intensive care database. Critical Care Medicine 2012; 40(3):800-812.
22. Moran JL, Solomon PJ, Adult Database Management Committee (ADMC) of the Australian and New Zealand Intensive Care Society (ANZICS). Global quantitative indices reflecting provider process-of-care: data-base derivation. BMC Medical Research Methodology 2010; 10:32.
23. StataCorp. Stata: Release 12. StataCorp LP., Statistical Software: College Station, TX, 2011.
24. Hosmer DW, Lemeshow S. Applied Logistic Regression, 2nd edn., Wiley: New York, 2000.
25. Glance LG, Osler TM, Dick A. Rating the quality of intensive care units: is it a function of the intensive care unit scoring system? Critical Care Medicine 2002; 30(9):1976-1982.
26. ANZICS Centre of Outcome and Resource Evaluation. 2008 annual report. Technical Report, ANZICS Centre of Outcome and Resource Evaluation, 2008. Available from: http://www.anzics.com.au/downloads/cat_view/4-centre-for-outcome-and-resource-evaluation-core/84-core-annual-reports (accessed March 2013).
27. 0. Critical Care Medicine 2002; 30(9):1995-2002.
28. Afessa B, Keegan MT, Hubmayr RD, Naessens JM, Gajic O, Hall Long K, Peters SG. Evaluating the performance of an institution using an intensive care unit benchmark. Mayo Clinic Proceedings 2005; 80(2):174-180.
29. Vincent JL, Moreno R. Clinical review: scoring systems in the critically ill. Critical Care 2010; 14:207.
30. Goldstein H, Healy MJR. The graphical representation of a collection of means. Journal of the Royal Statistical Society. Series A 1995; 158(1):175-177.
31. Alexandrescu R, Jen MH, Bottle A, Jarman B, Aylin P. Logistic versus hierarchical modeling: an analysis of a statewide inpatient sample. Journal of the American College of Surgeons 2011; 213(3):392-401.
32. Burgess JF Jr., Christiansen CL, Michalak SE, Morris CN. Medical profiling: improving standards and risk adjustments using hierarchical models. Journal of Health Economics 2000; 19(3):291-309.
33. Storey JD. The positive false discovery rate: a Bayesian interpretation and the q-value. The Annals of Statistics 2003; 13(6):2013-2035.
34. Farcomeni A. A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion. Statistical Methods in Medical Research 2008; 17(4):347-388.
35. Pinheiro JC, Chao EC. Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. Journal of Computational and Graphical Statistics 2006; 15(1):58-81.
36. Rabe-Hesketh S, Skrondal A. Multilevel and Longitudinal Modeling Using Stata, 2nd edn., Stata Press: College Station, TX, 2008.
37. Langford IH, Lewis T. Outliers in multilevel data. Journal of the Royal Statistical Society. Series A 1998; 161(2):121-160.
38. Bronskill SE, Normand SLT, Landrum MB, Rosenheck RA. Longitudinal profiles of health care providers. Statistics in Medicine 2002; 21:1067-1088.
39. ANZICS CORE. ANZICS Centre for Outcome and Resource Evaluation (ANZICS CORE) - Outlier Management Policy October 2011. (Available from: http://www.anzics.com.au/core/core-management-governance [Accessed on January2013]).
40. Goldstein H. Multilevel Statistical Models, 4th edn., Wiley series in probability and statistics. Wiley: Chichester, West Sussex, 2010.