Review of the acuity scoring systems for the pediatric intensive care unit and their use in quality improvement

Journal of Intensive Care Medicine

Volumn 22, Issue 3, 2007, Pages 131-140

  Marcin, James P ^a,c   Pollack, Murray M ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b GEORGE WASHINGTON UNIVERSITY SCHOOL OF MEDICINE AND HEALTH SCIENCES   (United States)

^c University of California at Davis School of Medicine   (United States)

Author keywords

Acuity scoring systems; Benchmarking; Critical care; Intensive care; Mortality; Pediatrics; Quality improvement; Quality of care; Severity of illness

Indexed keywords

DISEASE SEVERITY; HEALTH CARE COST; HEALTH CARE QUALITY; INTENSIVE CARE UNIT; MEDICAL ASSESSMENT; MEDICAL ERROR; PRIORITY JOURNAL; PROFESSIONAL KNOWLEDGE; REVIEW; RISK REDUCTION; SCORING SYSTEM;

BENCHMARKING; HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS, PEDIATRIC; QUALITY OF HEALTH CARE;

EID: 34250204164     PISSN: 08850666     EISSN: 15251489     Source Type: Journal    
DOI: 10.1177/0885066607299492     Document Type: Review

References (107)

1. Institute of Medicine: Committee on Quality of Health Care in America. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press ; 2000.
2. Institute of Medicine: Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press ; 2001.
3. AHRQ Quality Indicators. Prevention Quality Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/ pqi_overview.htm. Accessed November 2005.
4. AHRQ Quality Indicators. Patient Safety Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/psi_overview. htm. Accessed November 2005.
5. AHRQ Quality Indicators. Inpatient Quality Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/ iqi_overview.htm. Accessed November 2005.
6. Institute of Medicine: Committee on Identifying Priority Areas for Quality Improvement. Priority Areas for National Action: Transforming Health Care Quality. Washington, DC: National Academies Press ; 2003.
7. Berwick DM A primer on leading the improvement of systems. BMJ. 1996 ; 312: 619-622.
8. Institute for Healthcare Improvement. Critical Care. Available at: http://www.ihi.org/IHI/Topics/CriticalCare. Accessed November 2004.
9. Vincent JL, de Mendonca A., Cantraine F., et al. Use of the SOFA score to assess the incidence of organ dysfunction/ failure in intensive care units: results of a multicenter, prospective study: working group on "sepsis-related problems" of the European Society of Intensive Care Medicine. Crit Care Med. 1998 ; 26: 1793-1800.
10. Leteurtre S., Martinot A., Duhamel A., et al. Validation of the Paediatric Logistic Organ Dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003 ; 362: 192-197.
11. Leclerc F., Leteurtre S., Duhamel A., et al. Cumulative influence of organ dysfunctions and septic state on mortality of critically ill children. Am J Respir Crit Care Med. 2005 ; 171: 348-353.
12. Leteurtre S., Martinot A., Duhamel A., et al. Development of a pediatric multiple organ dysfunction score: use of two strategies. Med Decis Making. 1999 ; 19: 399-410.
13. Le Gall JR, Klar J., Lemeshow S., et al. The logistic organ dysfunction system: a new way to assess organ dysfunction in the intensive care unit: ICU Scoring Group. JAMA. 1996 ; 276: 802-810.
14. Laupacis A., Sekar N., Stiell IG Clinical prediction rules: a review and suggested modifications of methodological standards. JAMA. 1997 ; 277: 488-494.
15. Randolph AG, Guyatt GH, Calvin JE, Doig G., Richardson WS Understanding articles describing clinical prediction tools: evidence based medicine in critical care group. Crit Care Med. 1998 ; 26: 1603-1612.
16. Marcin JP, Pollack MM Review of the methodologies and applications of scoring systems in neonatal and pediatric intensive care. Pediatr Crit Care Med. 2000 ; 1: 20-27.
17. Soeken KL, Prescott PA Issues in the use of kappa to estimate reliability. Med Care. 1986 ; 24: 733-741.
18. Fleiss J. Statistical Methods for Rates and Proportions. 2 nd ed. New York: John Wiley & Sons ; 1981.
19. Roberts C., McNamee R. A matrix of kappa-type coefficients to assess the reliability of nominal scales. Stat Med. 1998 ; 17: 471-488.
20. Fleiss J. The Design and Analysis of Clinical Experiments. New York: John Wiley & Sons ; 1986.
21. Landis J., Gg K. The measurement of observer agreement for categorical data. Biometrics. 1977 ; 33: 159-174.
22. Jennett B., Bond M. Assessment of outcome after severe brain damage. Lancet. 1975 ; 1: 480-484.
23. Apgar V. A proposal for a new method of evaluation of the newborn infant. Curr Res Anesth Analg. 1953 ; 32: 260-267.
24. Hand DJ Statistical methods in diagnosis. Stat Methods Med Res. 1992 ; 1: 49-67.
25. Tu JV Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol. 1996 ; 49: 1225-1231.
26. Breiman L. Classification and Regression Trees. Belmont, Calif: Wadsworth International Group ; 1984.
27. Cleveland WS LOWESS: a program for smoothing scatter-plots by robust locally weighted regression. Am Stat. 1981 ; 35: 54.
28. Lemeshow S., Le Gall JR Modeling the severity of illness of ICU patients: a systems update. JAMA. 1994 ; 272: 1049-1055.
29. Swets JA Measuring the accuracy of diagnostic systems. Science. 1988 ; 240: 1285-1293.
30. Hanley JA, McNeil BJ A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983 ; 148: 839-843.
31. Hanley JA, McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982 ; 143: 29-36.
32. Hosmer DW, Lemeshow S. Applied Logistic Regression. New York: Wiley ; 1989.
33. Hosmer DW, Hosmer T., Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997 ; 16: 965-980.
34. Bertolini G., D'Amico R., Nardi D., Tinazzi A., Apolone G. One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostat. 2000 ; 5: 251-253.
35. Pollack MM, Ruttimann UE, Getson PR Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988 ; 16: 1110-1116.
36. Pollack MM, Patel KM, Ruttimann UE PRISM III: an updated pediatric risk of mortality score. Crit Care Med. 1996 ; 24: 743-752.
37. Shann F., Pearson G., Slater A., Wilkinson K. Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care. Intensive Care Med. 1997 ; 23: 201-207.
38. Slater A., Shann F., Pearson G. PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med. 2003 ; 29: 278-285.
39. Pediatric Intensive Care Unit Evaluations: Assessing Quality and Efficiency: Scientific Background and Research. Available at: http://www.childrensnationalmedicalcenter.com/picues/scientific_quality.aspx. Accessed November 2005.
40. Randolph AG, Gonzales CA, Cortellini L., Yeh TS Growth of pediatric intensive care units in the United States from 1995 to 2001. J Pediatr. 2004 ; 144: 792-798.
41. Pollack MM, Patel KM, Ruttimann UE The Pediatric Risk of Mortality III-Acute Physiology Score (PRISM III- APS): a method of assessing physiologic instability for pediatric intensive care unit patients. J Pediatr. 1997 ; 131: 575-581.
42. van Keulen JG, Gemke RJ, Polderman KH Effect of training and strict guidelines on the reliability of risk adjustment systems in paediatric intensive care. Intensive Care Med. 2005 ; 31: 1229-1234.
43. van Keulen JG, Polderman KH, Gemke RJ Reliability of PRISM and PIM scores in paediatric intensive care. Arch Dis Child. 2005 ; 90: 211-214.
44. Gemke RJ, van Vught J. Scoring systems in pediatric intensive care: PRISM III versus PIM. Intensive Care Med. 2002 ; 28: 204-207.
45. Slater A., Shann F. The suitability of the Pediatric Index of Mortality (PIM), PIM2, the Pediatric Risk of Mortality (PRISM), and PRISM III for monitoring the quality of pediatric intensive care in Australia and New Zealand. Pediatr Crit Care Med. 2004 ; 5: 447-454.
46. Brady AR, Harrison D., Black S., et al. Assessment and optimization of mortality prediction tools for admissions to pediatric intensive care in the United kingdom. Pediatrics. 2006 ; 117: e733 - e742.
47. Pediatric Intensive Care Unit Evaluations. Available at: http://www.dcchildrens.com/picues/. Accessed November 2005.
48. Sibbald WJ, Bion J. Evaluating Critical Care: Using Health Services Research to Improve Quality. New York: Springer ; 2001.
49. Fiser DH Outcome evaluations as measures of quality in pediatric intensive care. Pediatr Clin North Am. 1994 ; 41: 1423-1438.
50. Fiser DH, Long N., Roberson PK, Hefley G., Zolten K., Brodie-Fowler M. Relationship of pediatric overall performance category and pediatric cerebral performance category scores at pediatric intensive care unit discharge with outcome measures collected at hospital discharge and 1- and 6-month follow-up assessments. Crit Care Med. 2000 ; 28: 2616-2620.
51. Fiser DH, Tilford JM, Roberson PK Relationship of illness severity and length of stay to functional outcomes in the pediatric intensive care unit: a multi-institutional study. Crit Care Med. 2000 ; 28: 1173-1179.
52. Lacroix J., Cotting J. Severity of illness and organ dysfunction scoring in children. Pediatr Crit Care Med. 2005 ; 6 (3 suppl). S126 - S134.
53. Graciano AL, Balko JA, Rahn DS, Ahmad N., Giroir BP The Pediatric Multiple Organ Dysfunction Score (P-MODS): development and validation of an objective scale to measure the severity of multiple organ dysfunction in critically ill children. Crit Care Med. 2005 ; 33: 1484-1491.
54. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991 ; 100: 1619-1636.
55. Zimmerman JE, Wagner DP, Draper EA, Wright L., Alzola C., Knaus WA Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med. 1998 ; 26: 1317-1326.
56. Zimmerman JE, Kramer AA, McNair DS, Malila FM Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med. 2006 ; 34: 1297-1310.
57. Lemeshow S., Teres D., Klar J., Avrunin JS, Gehlbach SH, Rapoport J. Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993 ; 270: 2478-2486.
58. Champion HR, Sacco WJ, Copes WS, Gann DS, Gennarelli TA, Flanagan ME A revision of the trauma score. J Trauma. 1989 ; 29: 623-629.
59. Eichelberger MR, Bowman LM, Sacco WJ, Mangubat EA, Lowenstein AD, Gotschall CS Trauma score versus revised trauma score in TRISS to predict outcome in children with blunt trauma. Ann Emerg Med. 1989 ; 18: 939-942.
60. Eichelberger MR, Champion HR, Sacco WJ, Gotschall CS, Copes WS, Bowman LM Pediatric coefficients for TRISS analysis. J Trauma. 1993 ; 34: 319-322.
61. Baker SP, O'Neill B. The injury severity score: an update. J Trauma. 1976 ; 16: 882-885.
62. Baker SP, O'Neill B., Haddon W. Jr, Long WB The injury severity score: a method for describing patients with multiple injuries and evaluating emergency care. J Trauma. 1974 ; 14: 187-196.
63. Boyd CR, Tolson MA, Copes WS Evaluating trauma care: the TRISS method: Trauma Score and the Injury Severity Score. J Trauma. 1987 ; 27: 370-378.
64. Champion HR, Copes WS, Sacco WJ, et al. The Major Trauma Outcome Study: establishing national norms for trauma care. J Trauma. 1990 ; 30: 1356-1365.
65. Champion HR, Copes WS, Sacco WJ, et al. A new characterization of injury severity. J Trauma. 1990 ; 30: 539-545.
66. Osler T., Rutledge R., Deis J., Bedrick E. ICISS: an international classification of disease-9 based injury severity score. J Trauma. 1996 ; 41: 380-386.
67. Osler TM, Rogers FB, Badger GJ, Healey M., Vane DW, Shackford SR A simple mathematical modification of TRISS markedly improves calibration. J Trauma. 2002 ; 53: 630-634.
68. Kaufmann CR, Maier RV, Rivara FP, Carrico CJ Evaluation of the Pediatric Trauma Score. JAMA. 1990 ; 263: 69-72.
69. Tepas JJ 3rd, Ramenofsky ML, Mollitt DL, Gans BM, DiScala C. The Pediatric Trauma Score as a predictor of injury severity: an objective assessment. J Trauma. 1988 ; 28: 425-429.
70. Tepas JJ 3rd, Mollitt DL, Talbert JL, Bryant M. The pediatric trauma score as a predictor of injury severity in the injured child. J Pediatr Surg. 1987 ; 22: 14-18.
71. Westley CR, Cotton EK, Brooks JG Nebulized racemic epinephrine by IPPB for the treatment of croup: a double-blind study. Am J Dis Child. 1978 ; 132: 484-487.
72. Leipzig B., Oski FA, Cummings CW, Stockman JA, Swender P. A prospective randomized study to determine the efficacy of steroids in treatment of croup. J Pediatr. 1979 ; 94: 194-196.
73. Carroll CL, Sekaran AK, Lerer TJ, Schramm CM A modified pulmonary index score with predictive value for pediatric asthma exacerbations. Ann Allergy Asthma Immunol. 2005 ; 94: 355-359.
74. Gorelick MH, Stevens MW, Schultz TR, Scribano PV Performance of a novel clinical score, the Pediatric Asthma Severity Score (PASS), in the evaluation of acute asthma. Acad Emerg Med. 2004 ; 11: 10-18.
75. Smith SR, Baty JD, Hodge D. III. Validation of the pulmonary score: an asthma severity score for children. Acad Emerg Med. 2002 ; 9: 99-104.
76. Wood DW, Downes JJ, Lecks HI A clinical scoring system for the diagnosis of respiratory failure: preliminary report on childhood status asthmaticus. Am J Dis Child. 1972 ; 123: 227-228.
77. Timmons OD, Havens PL, Fackler JC Predicting death in pediatric patients with acute respiratory failure: Pediatric Critical Care Study Group: Extracorporeal Life Support Organization. Chest. 1995 ; 108: 789-797.
78. Sinclair JF, Skeoch CH, Hallworth D. Prognosis of meningococcal septicaemia. Lancet. 1987 ; 2: 38.
79. Kahn A., Blum D. Factors for poor prognosis in fulminating meningococcemia: conclusions from observations of 67 childhood cases. Clin Pediatr. 1978 ; 17: 680-682, 687.
80. Stiehm ER, Damrosch DS Factors in the prognosis of meningococcal infection: review of 63 cases with emphasis on recognition and management of the severely ill patient. J Pediatr. 1966 ; 68: 457-467.
81. Flaegstad T., Kaaresen PI, Stokland T., Gutteberg T. Factors associated with fatal outcome in childhood meningococcal disease. Acta Paediatr. 1995 ; 84: 1137-1142.
82. Tuysuz B., Ozlu I., Aji DY, Erginel A. Prognostic factors in meningococcal disease and a new scoring system. Acta Paediatr. 1993 ; 82: 1053-1056.
83. Slonim AD, Pollack MM Integrating the Institute of Medicine's six quality aims into pediatric critical care: relevance and applications. Pediatr Crit Care Med. May 2005 ; 6: 264-269.
84. Nipshagen MD, Polderman KH, DeVictor D., Gemke RJ Pediatric intensive care: result of a European survey. Intensive Care Med. 2002 ; 28: 1797-1803.
85. Pearson G., Shann F., Barry P., et al. Should paediatric intensive care be centralised? Trent versus Victoria. Lancet. 1997 ; 349: 1213-1217.
86. Pollack MM, Cuerdon TT, Patel KM, Ruttimann UE, Getson PR, Levetown M. Impact of quality-of-care factors on pediatric intensive care unit mortality. JAMA. 1994 ; 272: 941-946.
87. Tenner PA, Dibrell H., Taylor RP Improved survival with hospitalists in a pediatric intensive care unit. Crit Care Med. 2003 ; 31: 847-852.
88. Cimino MA, Kirschbaum MS, Brodsky L., Shaha SH Assessing medication prescribing errors in pediatric intensive care units. Pediatr Crit Care Med. 2004 ; 5: 124-132.
89. Kaushal R., Bates DW, Landrigan C., et al. Medication errors and adverse drug events in pediatric inpatients. JAMA. 2001 ; 285: 2114-2120.
90. Singh-Naz N., Sprague BM, Patel KM, Pollack MM Risk factors for nosocomial infection in critically ill children: a prospective cohort study. Crit Care Med. 1996 ; 24: 875-878.
91. Marcin JP, Rutan E., Rapetti PM, Brown JP, Rahnamayi R., Pretzlaff RK Nurse staffing and unplanned extubation in the pediatric intensive care unit. Pediatr Crit Care Med. 2005 ; 6: 254-257.
92. Pollack MM, Ruttimann UE, Getson PR Accurate prediction of the outcome of pediatric intensive care: a new quantitative method. N Engl J Med. 1987 ; 316: 134-139.
93. Marcin JP, Song J., Leigh JP The impact of pediatric intensive care unit volume on mortality: a hierarchical instrumental variable analysis. Pediatr Crit Care Med. 2005 ; 6: 136-141.
94. Pollack MM, Getson PR, Ruttimann UE, et al. Efficiency of intensive care: a comparative analysis of eight pediatric intensive care units. JAMA. 1987 ; 258: 1481-1486.
95. Marcin JP, Slonim AD, Pollack MM, Ruttimann UE Long-stay patients in the pediatric intensive care unit. Crit Care Med. 2001 ; 29: 652-657.
96. Tilford JM, Simpson PM, Yeh TS, et al. Variation in therapy and outcome for pediatric head trauma patients. Crit Care Med. 2001 ; 29: 1056-1061.
97. Pollack MM, Alexander SR, Clarke N., Ruttimann UE, Tesselaar HM, Bachulis AC Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities. Crit Care Med. 1991 ; 19: 150-159.
98. Pollack MM, Patel KM, Ruttimann E. Pediatric critical care training programs have a positive effect on pediatric intensive care mortality. Crit Care Med. 1997 ; 25: 1637-1642.
99. Marcin JP, Pollack MM, Patel KM, Ruttimann UE Decision support issues using a physiology based score. Intensive Care Med. 1998 ; 24: 1299-1304.
100. Field MJ, Behrman RE, Institute of Medicine (US). Committee on Palliative and End-of-Life Care for Children and Their Families. When Children Die: Improving Palliative and End-of-Life Care for Children and Their Families. Washington, DC: National Academy Press ; 2003.
101. Pon S., Notterman DA, Martin K. Pediatric critical care and hospital costs under reimbursement by diagnosis-related group: effect of clinical and demographic characteristics. J Pediatr. 1993 ; 123: 355-364.
102. Slonim AD, Pollack MM An approach to costs in critical care: macro- versus microeconomics. Crit Care Med. 1999 ; 27: 2286-2287.
103. Ruttimann UE, Patel KM, Pollack MM Length of stay and efficiency in pediatric intensive care units. J Pediatr. 1998 ; 133: 79-85.
104. Naclerio AL, Gardner JW, Pollack MM Socioeconomic factors and emergency pediatric ICU admissions. Ann N Y Acad Sci. 1999 ; 896: 379-382.
105. Marcin JP, Schembri MS, He J., Romano PS A population-based analysis of socioeconomic status and insurance status and their relationship with pediatric trauma hospitalization and mortality rates. Am J Public Health. 2003 ; 93: 461-466.
106. Howard I., Joseph JG, Natale JE Pediatric traumatic brain injury: do racial/ethnic disparities exist in brain injury severity, mortality, or medical disposition ? Ethn Dis. 2005 ; 15 (4 suppl 5). S5-51 - 56.
107. Lopez AM, Tilford JM, Anand KJ, et al. Variation in pediatric intensive care therapies and outcomes by race, gender, and insurance status. Pediatr Crit Care Med. 2006 ; 7: 2-6.