Prognostic models based on administrative data alone inadequately predict the survival outcomes for critically ill patients at 180 days post-hospital discharge

Journal of Critical Care

Volumn 27, Issue 4, 2012, Pages 422.e11-422.e21

  Bohensky, Megan A ^a   Jolley, Damien ^a   Pilcher, David V ^b   Sundararajan, Vijaya ^a   Evans, Sue ^a   Brand, Caroline A ^a  

^a MONASH UNIVERSITY   (Australia)

^b Australian and New Zealand Intensive Care Society   (Australia)

Author keywords

APACHE; Critical illness mortality; Hospital mortality; Humans; Intensive care units; Outcome assessment (health care); Risk adjustment methods

Indexed keywords

ADMINISTRATIVE DATABASE; ADOLESCENT; ADULT; AGED; APACHE; ARTICLE; AUSTRALIA; CLINICAL DATA REPOSITORY; CLINICAL STUDY; COHORT ANALYSIS; CRITICALLY ILL PATIENT; DATA ANALYSIS; DATA BASE; FEMALE; HOSPITAL ADMISSION; HOSPITAL DISCHARGE; HUMAN; INTENSIVE CARE UNIT; INTERMETHOD COMPARISON; MAJOR CLINICAL STUDY; MALE; MORTALITY; OUTCOME ASSESSMENT; OUTCOME VARIABLE; POPULATION RESEARCH; PREDICTIVE VALUE; PROCESS MODEL; PROGNOSIS; RISK ASSESSMENT; SURVIVAL PREDICTION;

EID: 84864117440     PISSN: 08839441     EISSN: 15578615     Source Type: Journal    
DOI: 10.1016/j.jcrc.2012.03.008     Document Type: Article

References (49)

1. Angus D.C., Carlet J. Surviving Intensive Care: a report from the 2002 Brussels Roundtable. Intensive Care Med 2003, 29:368-377.
2. Vasilevskis E.E., Kuzniewicz M.W., Cason B.A., et al. Mortality probability model III and simplified acute physiology score II: assessing their value in predicting length of stay and comparison to APACHE IV. Chest 2009, 136:89-101.
3. Zimmerman J., Kramer A., McNair D., Malila F., Shaffer V. Intensive care unit length of stay: benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV. Med Care 2006, 2517-2529.
4. Knaus W.A., Harrell F.E., Lynn J., et al. The SUPPORT prognostic model. Objective estimates of survival for seriously ill hospitalized adults. Study to understand prognoses and preferences for outcomes and risks of treatments. Ann Intern Med 1995, 122:191-203.
5. Ho K.M., Knuiman M., Finn J., Webb S.A. Estimating long-term survival of critically ill patients: the PREDICT model. PLoS ONE 2008, 3:e3226.
6. Aylin P., Bottle A., Majeed A. Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models. Br Med J 2007, 334:1044.
7. The Bristol Royal Infirmary Inquiry. Learning from Bristol: the report of the public inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995 London, U.K.; 2001.
8. Taori G., Ho K.M., George C., et al. Landmark survival as an end-point for trials in critically ill patients-comparison of alternative durations of follow-up: an exploratory analysis. Crit Care 2009, 13:R128.
9. Victorian Department of Human Services Acute Health Division. The Victorian Admitted Episodes Dataset: an overview. Melbourne; 2001.
10. Victorian Government Department of Human Services Victoria, public hospitals, policy and funding guidelines 1997-1998 1997, Victorian Government Department of Human Services, Melbourne, Australia.
11. Henderson T., Shepheard J., Sundararajan V. Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care 2006, 44:1011-1019.
12. National Centre for Classification in Health The international statistical classification of diseases and related health problems. Australian modification (ICD-10-AM) 2002, NCCH, Sydney, Australia. Tenth Revision.
13. Stow P.J., Hart G.K., Higlett T., et al. Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. J Crit Care 2006, 21:133-141.
14. van Lint A., Pilcher D., Hart G.K. APD data audit program report cycle 1: 2007-2009 2010, Australian New Zealand Intensive Care Society Centre for Outcome and Resource Evaluation, Melbourne.
15. Bohensky M., Jolley D., Sundarajan V., Pilcher D., Evans S., Brand C. Empirical aspects of linking intensive care registry data to hospital discharge data without the use of direct patient identifiers. Anaesth Intensive Care 2011, 39(2):202-208.
16. Kelman C.W., Bass A.J., Holman C.D. Research use of linked health data-a best practice protocol. Aust N Z J Public Health 2002, 26:251-255.
17. Wright J.C., Plenderleith L., Ridley S.A. Long-term survival following intensive care: subgroup analysis and comparison with the general population. Anaesthesia 2003, 58:637-642.
18. Hosmer D., Lemeshow S. Applied logistic regression 1989, Wiley, New York.
19. Elixhauser A., Steiner C., Harris D.R., Coffey R.M. Comorbidity measures for use with administrative data. Med Care 1998, 36:8-27.
20. Quan H., Sundararajan V., Halfon P., et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care 2005, 43:1130-1139.
21. Quail J.M., Lix L.M., Osman B.A., Teare G.F. Comparing comorbidity measures for predicting mortality and hospitalization in three population-based cohorts. BMC Health Serv Res 2011, 11:146.
22. Australian Bureau of Statistics Technical paper census of population and housing: Socio-Economic Indexes for Area's (SEIFA), Australia, 2001 2004, Australian Bureau of Statistics, Canberra.
23. Williams R.L. A note on robust variance estimation for cluster-correlated data. Biometrics 2000, 56:645-646.
24. Multivariable model-building: a pragmatic approach to regression analysis based on fractional polynomials for modelling continuous variables 2008, 185-186. John Wiley, Hoboken, NJ. P. Royston, W. Sauerbrei (Eds.).
25. Hanley J.A., McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143:29-36.
26. Hosmer D.W., Hosmer T., Le Cessie S., Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 1997, 16:965-980.
27. Redelmeier D.A., Bloch D.A., Hickam D.H. Assessing predictive accuracy: how to compare Brier scores. J Clin Epidemiol 1991, 44:1141-1146.
28. Spiegelhalter D.J. Probabilistic prediction in patient management and clinical trials. Statistics in Medicine 1986, 5:421-433.
29. Quach S., Hennessy D.A., Faris P., Fong A., Quan H., Doig C. A comparison between the APACHE II and Charlson Index Score for predicting hospital mortality in critically ill patients. BMC Health Serv Res 2009, 9:129.
30. Vasilevskis E.E., Kuzniewicz M.W., Dean M.L., et al. Relationship between discharge practices and intensive care unit in-hospital mortality performance: evidence of a discharge bias. Med Care 2009, 47:803-812.
31. Shahian D.M., Silverstein T., Lovett A.F., Wolf R.E., Normand S.L.T. Comparison of clinical and administrative data sources for hospital coronary artery bypass graft surgery report cards. Circulation 2007, 115:1518-1527.
32. Aylin P., Lees T., Baker S., Prytherch D., Ashley S. Descriptive study comparing routine hospital administrative data with the Vascular Society of Great Britain and Ireland's National Vascular Database. Eur J Vasc Endovasc Surg 2007, 33:461-465.
33. Poses R.M., McClish D.K., Smith W.R., Bekes C., Scott W.E. Prediction of survival of critically ill patients by admission comorbidity. J Clin Epidemiol 1996, 49:743-747.
34. Phillips A. Health status differentials across rural and remote Australia. Aust J Rural Health 2009, 17:2-9.
35. Garout M., Tilney H.S., Tekkis P.P., Aylin P. Comparison of administrative data with the Association of Coloproctology of Great Britain and Ireland (ACPGBI) colorectal cancer database. Int J Colorectal Dis 2008, 23:155-163.
36. Westaby S., Archer N., Manning N., et al. Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality. BMJ 2007, 335:759-764.
37. Parker J.P., Li Z., Damberg C.L., Danielsen B., Carlisle D.M. Administrative versus clinical data for coronary artery bypass graft surgery report cards: the view from California. J Clin Epidemiol 2006, 44:687-695.
38. Hannan E.L., Kilburn H., Lindsey M.L., Lewis R. Clinical versus administrative data bases for CABG surgery. Does it matter. Med Care 1992, 30:892-907.
39. Ho K., Finn J., Knuiman M., Webb S. Combining multiple comorbidities with Acute Physiology Score to predict hospital mortality of critically ill patients: a linked data cohort study. Anaesthesia 2007, 62:1095-1100.
40. Ghali W.A., Hall R.E., Rosen A.K., Ash A.S., Moskowitz M.A. Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. J Clin Epidemiol 1996, 49:273-278.
41. Johnston J.A., Wagner D.P., Timmons S., Welsh D., Tsevat J., Render M.L. Impact of different measures of comorbid disease on predicted mortality of intensive care unit patients. Med Care 2002, 40:929-940.
42. Duke G.J., Graco M., Santamaria J., Shann F. Validation of the hospital outcome prediction equation (HOPE) model for monitoring clinical performance. Intern Med J 2009, 39:283-289.
43. Umegaki T., Sekimoto M., Hayashida K., Imanaka Y. An outcome prediction model for adult intensive care. Crit Care Resusc 2010, 12:96-103.
44. Chu Y.T., Ng Y.Y., Wu S.C. Comparison of different comorbidity measures for use with administrative data in predicting short- and long-term mortality. BMC Health Serv Res 2010, 10:140.
45. 2008/9 Performance ratings. 2009. (Accessed at (accessed March 2010). http://www.cqc.org.uk.
46. Romano P.S., Zach A., Luft H.S., Rainwater J., Remy L.L., Campa D. The California Hospital Outcomes Project: using administrative data to compare hospital performance. Jt Comm J Qual Improv 1995, 21:668-682.
47. Duke G.J., Santamaria J., Shann F., et al. Critical care outcome prediction equation (COPE) for adult intensive care. Crit Care Resusc 2008, 10:41.
48. Bersten A.D., Soni N., Oh T.E. Oh's intensive care manual, fifth ed., Edinburgh 2003, Butterworth Heinemanns, Toronto.
49. Kraus W.A., Draper E.A., Bergner M., Murphy D.J., Harrell F.E. The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100:1619-1636.