Severity Scoring Systems: Tools for the Evaluation of Patients and Intensive Care Units

Critical Care Medicine: Principles of Diagnosis and Management in the Adult

Volumn , Issue , 2008, Pages 1547-1565

  Moreno, Rui P ^a   Metnitz, Philipp G H ^b  

^a Centro Hospitalar de Lisboa Central   (Portugal)

^b MEDICAL UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84884420894     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-032304841-5.50076-5     Document Type: Chapter

References (221)

1. Apgar V A proposal for a new method of evaluation of the newborn infant. Anesth Analg 1953, 32:260-267.
2. Child CG, Turcotte JG Surgery and portal hypertension. Major Probl Clin Surg 1964, 1:1-85.
3. Killip TK, Kimball JT Treatment of myocardial infarction in a coronary care unit. Am J Cardiol 1967, 20:457-464.
4. Teasdale G, Jennett B Assessment of coma and impaired consciousness. Lancet 1974, 2:81-84.
5. Bastos PG, Sun X, Wagner DP, et al. Glasgow Coma Scale score in the evaluation of outcome in the intensive care unit: Findings from the Acute Physiology and Chronic Health Evaluation III study. Crit Care Med 1993, 21:1459-1465.
6. Knaus WA, Zimmerman JE, Wagner DP, et al. APACHE-Acute Physiology And Chronic Health Evaluation: A physiologically based classification system. Crit Care Med 1981, 9:591-597.
7. Le Gall J-R, Loirat P, Alperovitch A Simplified acute physiological score for intensive care patients. Lancet 1983, 2:741.
8. Knaus WA, Draper EA, Wagner DP, Zimmerman JE APACHE II: A severity of disease classification system. Crit Care Med 1985, 13:818-829.
9. Lemeshow S, Teres D, Pastides H, et al. A method for predicting survival and mortality of ICU patients using objectively derived weights. Crit Care Med 1985, 13:519-525.
10. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100:1619-1636.
11. Le Gall JR, Lemeshow S, Saulnier F A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270:2957-2963.
12. Lemeshow S, Teres D, Klar J, et al. Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993, 270:2478-2486.
13. Marshall JC, Cook DA, Christou NV, et al. Multiple organ dysfunction score: A reliable descriptor of a complex clinical outcome. Crit Care Med 1995, 23:1638-1652.
14. Le Gall JR, Klar J, Lemeshow S, et al. The logistic organ dysfunction system. A new way to assess organ dysfunction in the intensive care unit. JAMA 1996, 276:802-810.
15. Vincent J-L, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med 1996, 22:707-710.
16. Knaus WA, Draper EA, Wagner DP, et al. Evaluating outcome from intensive care: A preliminary multihospital comparison. Crit Care Med 1982, 10:491-496.
17. Knaus WA, Le Gall, Wagner DP, et al. A comparison of intensive care in the U.S.A. and France. Lancet 1982, 642-646.
18. Wagner DP, Draper EA, Abizanda Campos R, et al. Initial international use of APACHE: An acute severity of disease measure. Med Dec Making 1984, 4:297.
19. Le Gall JR, Loirat P, Alperovitch A, et al. A simplified acute physiologic score for ICU patients. Crit Care Med 1984, 12:975-977.
20. Lemeshow S, Teres D, Avrunin J, Gage RW Refining intensive care unit outcome by using changing probabilities of mortality. Crit Care Med 1988, 16:470-477.
21. Castella X, Artigas A, Bion J, for the The European/North American Severity Study Group A comparison of severity of illness scoring systems for intensive care unit patients: Results of a multicenter, multinational study. Crit Care Med 1995, 23:1327-1335.
22. Bertolini G, D'Amico R, Apolone G, et al. Predicting outcome in the intensive care unit using scoring systems: Is new better?. A comparison of SAPS and SAPS II in a cohort of 1,393 patients. Med Care 1998, 36:1371-1382.
23. Moreno R, Matos R The "new" scores: What problems have been fixed, and what remain?. Curr Opin Crit Care 2000, 6:158-165.
24. Angus DC, Linde-Zwirble WT, Lidicker J, et al. Epidemiology of severe sepsis in the United States: Analysis of incidence, outcome and associated costs of care. Crit Care Med 2001, 29:1303-1310.
25. Martin GS, Mannino DM, Eaton S, Moss M The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med 2003, 348:1546-1554.
26. Bernard GR, Vincent J-L, Laterre P-F, et al. Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med 2001, 344:699-709.
27. Ely EW, Laterre P-F, Angus DC, et al. Drotrecogin alfa (activated) administration across clinically important subgroups of patients with severe sepsis. Crit Care Med 2003, 31:12-19.
28. Moreno R, Metnitz P, Jordan B, et al. SAPS 3 28 days score: A prognostic model to estimate patient survival during the first 28 days in the ICU. Intensive Care Med 2006, 32:S203. (Abstract).
29. 0). Crit Care 2005, 9:S97. (Abstract).
30. Render ML, Kim M, Deddens J, et al. Variation in outcomes in Veterans Affairs intensive care units with a computerized severity measure. Crit Care Med 2005, 33:930-939.
31. Zimmerman JE, Kramer AA, McNair DS, Malila FM Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today's critically ill patients. Crit Care Med 2006, 34:1297-1310.
32. Metnitz PG, Moreno RP, Almeida E, et al. SAPS 3. From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 2005, 31:1336-1344.
33. Moreno RP, Metnitz PG, Almeida E, et al. SAPS 3. From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005, 31:1345-1355.
34. Dybowski R, Weller P, Chang R, Gant V Prediction of outcome in critically ill patients using artificial neural network, synthesised by genetic algorithm. Lancet 1996, 347:1146-1150.
35. Engoren M, Moreno R, Reis Miranda D A genetic algorithm to predict hospital mortality in an ICU population. Crit Care Med 1999, 27:A52.
36. Moreno R, Afonso S Ethical, legal and organizational issues in the ICU: Prediction of outcome. Curr Opin Crit Care 2006, 12:619-623.
37. Moreno R, Apolone G The impact of different customization strategies in the performance of a general severity score. Crit Care Med 1997, 25:2001-2008.
38. Zhu B-P, Lemeshow S, Hosmer DW, et al. Factors affecting the performance of the models in the mortality probability model and strategies of customization: A simulation study. Crit Care Med 1996, 24:57-63.
39. Le Gall J-R, Lemeshow S, Leleu G, et al. Customized probability models for early severe sepsis in adult intensive care patients. JAMA 1995, 273:644-650.
40. Apolone G, D'Amico R, Bertolini G, et al. The performance of SAPS II in a cohort of patients admitted in 99 Italian ICUs: Results from the GiViTI. Intensive Care Med 1996, 22:1368-1378.
41. Metnitz PG, Valentin A, Vesely H, et al. Prognostic performance and customization of the SAPS II: Results of a multicenter Austrian study. Intensive Care Med 1999, 25:192-197.
42. Moreno R, Apolone G, Reis Miranda D Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 1998, 24:40-47.
43. Knaus WA, Harrell FE, Fisher CJ, et al. The clinical evaluation of new drugs for sepsis. A prospective study design based on survival analysis. JAMA 1993, 270:1233-1341.
44. Knaus WA, Harrell FE, LaBrecque JF, et al. Use of predicted risk of mortality to evaluate the efficacy of anticytokine therapy in sepsis. Crit Care Med 1996, 24:46-56.
45. Le Galll J-R, Neumann A, Hemery F, et al. Mortality prediction using SAPS II: An update for French intensive care units. Crit Care 2005, 9:R645-R652.
46. Aegerter P, Boumendil A, Retbi A, et al. SAPS II revisited. Intensive Care Med 2005, 31:416-423.
47. Harrison DA, Brady AR, Parry GJ, et al. Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 2006, 34:1378-1388.
48. Rowan KM, Kerr JH, Major E, et al. Intensive Care Society's APACHE II study in Britain and Ireland-II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. BMJ 1993, 307:977-981.
49. Zimmerman JE, Kramer AA, McNair DS, et al. Intensive care unit length of stay: Benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV. Crit Care Med 2006, 34:2517-2529.
50. Sirio CA, Shepardson LB, Rotondi AJ, et al. Community-wide assessment of intensive care outcomes using a physiologically based prognostic measure: Implications for critical care delivery from Cleveland Health Quality Choice. Chest 1999, 115:793.
51. Knaus WA, Wagner DP, Zimmerman JE, Draper EA Variations in mortality and length of stay in intensive care units. Ann Intern Med 1993, 118:753-761.
52. Montaner JSG, Lawson LM, Levitt N, et al. Corticosteroids prevent early deterioration in patients with moderate severe Pneumocystis carinii pneumonia and the acquired immunodeficiency syndrome. Ann Intern Med 1990, 113:14-20.
53. Moreno R, Miranda DR, Matos R, Fevereiro T Mortality after discharge from intensive care: The impact of organ system failure and nursing workload use at discharge. Intensive Care Med 2001, 27:999-1004.
54. Abizanda Campos R, Balerdi B, Lopez J, et al. Fallos de prediccion de resultados mediante APACHE II. Analisis de los errores de prediction de mortalidad en pacientes criticos. Med Clin Barc 1994, 102:527-531.
55. Fery-Lemmonier E, Landais P, Kleinknecht D, Brivet F Evaluation of severity scoring systems in ICUs: Translation, conversion and definition ambiguities as a source of interobserver variability in APACHE II, SAPS, and OSF. Intensive Care Med 1995, 21:356-360.
56. Rowan K The reliability of case mix measurements in intensive care. Curr Opin Crit Care 1996, 2:209-213.
57. Bosman RJ, Oudemane van Straaten HM, Zandstra DF The use of intensive care information systems alters outcome prediction. Intensive Care Med 1998, 24:953-958.
58. Suistomaa M, Kari A, Ruokonen E, Takala J Sampling rate causes bias in APACHE II and SAPS II scores. Intensive Care Med 2000, 26:1773-1778.
59. Cleveland WS LOWESS: A program for smoothing scatterplots by robust locally weighted regression. Am Stat 1981, 35:54.
60. Ridgeway G The state of boosting. Comput Sci Statist 1999, 31:172-181.
61. Damiano AM, Bergner M, Draper EA, et al. Reliability of a measure of severity of illness: Acute physiology and chronic health evaluation II. J Clin Epidemiol 1992, 45:93-101.
62. Moreno R, Reis Miranda D, Fidler V, Van Schilfgaarde R Evaluation of two outcome predictors on an independent database. Crit Care Med 1998, 26:50-61.
63. Guyatt GH, Meade MO Outcome measures: Methodologic principles. Sepsis 1997, 1:21-25.
64. Marshall JD, Bernard G, Le Gall J-R, Vincent J-L The measurement of organ dysfunction/failure as an ICU outcome. Sepsis 1997, 1:41.
65. Flora JD A method for comparing survival of burn patients to a standard survival curve. J Trauma 1978, 18:701-705.
66. Hosmer DW, Lemeshow S Applied Logistic Regression 1989, John Wiley & Sons, New York.
67. Lemeshow S, Hosmer DW A review of goodness of fit statistics for use in the development oflogistic regression models. Am J Epidemiol 1982, 115:92-106.
68. Hosmer DW, Lemeshow S A goodness-of-fit test for the multiple logistic regression model. Comm Stat 1980, A10:1043-1069.
69. Hadorn DC, Keeler EB, Rogers WH, Brook RH Assessing the Performance of Mortality Prediction Models 1993, RAND/UCLA/Harvard Center for Health Care Financing Policy Research, Santa Monica, CA.
70. Champion HR, Copes WS, Sacco WJ, et al. Improved predictions from a severity characterization of trauma (ASCOT) over trauma and injury severity score (TRISS): Results of an independent evaluation. J Trauma 1996, 40:42-49.
71. Bertolini G, D'Amico R, Nardi D, et al. One model, several results: The paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostatistics 2000, 5:251-253.
72. Harrell FE, Califf RM, Pryor DB, et al. Evaluating the yield of medical tests. JAMA 1982, 247:2543-2546.
73. Hanley J, McNeil B The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143:29-36.
74. Ma G, Hall WJ Confidence bands for receiver operating characteristic curves. Med Decis Making 1993, 13:191-197.
75. Hanley J, McNeil B A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983, 148:839-843.
76. McClish DK Comparing the areas under more than two independent ROC curves. Med Decis Making 1987, 7:149-155.
77. DeLong ER, DeLong DM, Clarke-Pearson DL Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 1988, 44:837-845.
78. Hilden J The area under the ROC curve and its competitors. Med Decis Making 1991, 11:95-101.
79. Schuster DP Predicting outcome after ICU admission. The art and science of assessing risk. Chest 1992, 102:1861-1870.
80. Kollef MH, Schuster DP Predicting intensive care unit outcome with scoring systems. Underlying concepts and principles. Crit Care Clin 1994, 10:1-18.
81. Miller ME, Hui SL Validation techniques for logistic regression models. Stat Med 1991, 10:1213-1226.
82. Goldhill DR, Withington PS The effects of casemix adjustment on mortality as predicted by APACHE II. Intensive Care Med 1996, 22:415-419.
83. Sicignano A, Carozzi C, Giudici D, et al. The influence of length of stay in the ICU on power of discrimination of a multipurpose severity score (SAPS). Intensive Care Med 1996, 22:1048-1051.
84. Castella X, Gilabert J, Torner F, Torres C Mortality prediction models in intensive care: Acute Physiology and Chronic Health Evaluation II and Mortality Prediction Model compared. Crit Care Med 1991, 19:191-197.
85. Sirio CA, Tajimi K, Tase C, et al. An initial comparison of intensive care in Japan and United States. Crit Care Med 1992, 20:1207-1215.
86. Bastos PG, Sun X, Wagner DP, for the Brazil APACHE III Study Group, et al. Application of the APACHE III prognostic system in Brazilian intensive care units: A prospective multicenter study. Intensive Care Med 1996, 22:564-570.
87. Moreno R, Morais P Outcome prediction in intensive care: Results of a prospective, multicentre, Portuguese study. Intensive Care Med 1997, 23:177-186.
88. Rivera-Fernandez R, Vazquez-Mata G, Bravo M, et al. The Apache III prognostic system: Customized mortality predictions for Spanish ICU patients. Intensive Care Med 1998, 24:574-581.
89. Moreno R From the evaluation of the individual ptient to the evaluation of the ICU. Réanimation 2003, 12:47S-48S.
90. Perkins HS, Jonsen AR, Epstein WV Providers as predictors: Using outcome predictions in intensive care. Crit Care Med 1986, 14:105-110.
91. Silverstein MD Prediction instruments and clinical judgement in critical care. JAMA 1988, 260:1758-1759.
92. Dawes RM, Faust D, Mechl PE Clinical versus actuarial judgement. Sci Med Man 1989, 243:1674-1688.
93. Kleinmuntz B Why we still use our heads instead of formulas: Toward an integrative approach. Psychol Bull 1990, 107:296-310.
94. McClish DK, Powell SH How well can physicians estimate mortality in a medical intensive care unit?. Med Decis Making 1989, 9:125-132.
95. Poses RM, Bekes C, Winkler RL, et al. Are two (inexperienced) heads better than one (experienced) head?. Averaging house officers prognostic judgement for critically ill patients. Arch Intern Med 1990, 150:1874-1878.
96. Poses RM, Bekes C, Copare FJ, et al. The answer to "what are my chances, doctor?" depends on whom is asked: Prognostic disagreement and inaccuracy for critically ill patients. Crit Care Med 1989, 17:827-833.
97. Winkler RL, Poses RM Evaluating and combining physicians' probabilities of survival in an intensive care unit. Manag Sci 1993, 39:1526-1543.
98. Chang RWS, Lee B, Jacobs S, Lee B Accuracy of decisions to withdraw therapy in critically ill patients: Clinical judgement versus a computer model. Crit Care Med 1989, 17:1091-1097.
99. Knaus WA, Rauss A, Alperovitch A, et al. Do objective estimates of chances for survival influence decisions to withhold or withdraw treatment?. Med Decis Making 1990, 10:163-171.
100. Zimmerman JE, Wagner DP, Draper EA, Knaus WA Improving intensive care unit discharge decisions: Supplementary physician judgment with predictions of next day risk for life support. Crit Care Med 1994, 22:1373-1384.
101. Branner AL, Godfrey LJ, Goetter WE Prediction of outcome from critical illness: A comparison of clinical judgement with a prediction rule. Arch Intern Med 1989, 149:1083-1086.
102. Kruse JA, Thill-Baharozin MC, Carlson RW Comparison of clinical assessment with APACHE II for predicting mortality risk in patients admitted to a medical intensive care unit. JAMA 1988, 260:1739-1742.
103. Marks RJ, Simons RS, Blizzard RA, et al. Predicting outcome in intensive therapy units-a comparison of APACHE II with subjective assessments. Intensive Care Med 1991, 17:159-163.
104. Knaus WA, Wagner DP, Lynn J Short-term mortality predictions for critically ill hospitalized adults: science and ethics. Sci Med Man 1991, 254:389-394.
105. Lemeshow S, Klar J, Teres D Outcome prediction for individual intensive care patients: Useful, misused, or abused?. Intensive Care Med 1995, 21:770-776.
106. Suter P, Armagandis A, Beaufils F, et al. Predicting outcome in ICU patients: Consensus conference organized by the ESICM and the SRLF. Intensive Care Med 1994, 20:390-397.
107. Chang RW, Jacobs S, Lee B Use of APACHE II severity of disease classification to identify intensive-care-unit patients who would not benefit from total parenteral nutrition. Lancet 1986, 1:1483-1486.
108. Atkinson S, Bihari D, Smithies M, et al. Identification of futility in intensive care. Lancet 1994, 344:1203-1206.
109. Murray LS, Teasdale GM, Murray GD, et al. Does prediction of outcome alter patient management?. Lancet 1993, 341:1487-1491.
110. Gattinoni L, Brazzi L, Pelosi P, et al. A trial of goal orientated hemodynamic therapy in critically ill patients. N Engl J Med 1995, 333:1025-1032.
111. Henning RJ, McClish D, Daly B, et al. Clinical characteristics and resource utilization of ICU patients: Implementation for organization of intensive care. Crit Care Med 1987, 15:264-269.
112. Wagner DP, Knaus WA, Draper EA Identification of low-risk monitor admissions to medical-surgical ICUs. Chest 1987, 92:423-428.
113. Wagner DP, Knaus WA, Draper EA, et al. Identification of low-risk monitor patients within a medical-surgical ICU. Med Care 1983, 21:425-433.
114. Zimmerman JE, Wagner DP, Knaus WA, et al. The use of risk predictors to identify candidates for intermediate care units. Implications for intensive care unit utilization. Chest 1995, 108:490-499.
115. Zimmerman JE, Wagner DP, Sun X, et al. Planning patient services for intermediate care units: Insights based on care for intensive care unit low-risk monitor admissions. Crit Care Med 1996, 24:1626-1632.
116. Strauss MJ, LoGerfo JP, Yeltatzie JA, et al. Rationing of intensive care unit services. An everyday occurrence. JAMA 1986, 255:1143-1146.
117. Civetta JM, Hudson-Civetta JA, Nelson LD Evaluation of APACHE II for cost containment and quality assurance. Ann Surg 1990, 212:266-276.
118. Jones AE, Fitch MT, Kline JA Operational performance of validated physiologic scoring systems for predicting in-hospital mortality among critically ill emergency department patients. Crit Care Med 2005, 33:974-978.
119. MERIT Study Investigators Introduction of the medical emergency team (MET) system: A cluster-randomised controlled trial. Lancet 2005, 365:2091-2097.
120. Moreno R, Reis Miranda D Nursing staff in intensive care in Europe. The mismatch between planning and practice. Chest 1998, 113:752-758.
121. Moreno R, Vincent J-L, Matos R, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Intensive Care Med 1999, 25:686-696.
122. Clermont G, Kaplan V, Moreno R, et al. Dynamic microsimulation to model multiple outcomes in cohorts of critically ill patients. Intensive Care Med 2004, 30:2237-2244.
123. Zimmerman JE, Shortell SM, Knaus WA, et al. Value and cost of teaching hospitals: A prospective, multicenter, inception cohort study. Crit Care Med 1993, 21:1432-1442.
124. Rapoport J, Teres D, Lemeshow S, Gehlbach S A method for assessing the clinical performance and cost-effectiveness of intensive care units: A multicenter inception cohort study. Crit Care Med 1994, 22:1385-1391.
125. Teres D, Rapoport J Identifying patients with high risk of high cost. Chest 1991, 99:530-531.
126. Cerra FB, Negro F, Abrams J APACHE II score does not predict multiple organ failure or mortality in postoperative surgical patients. Arch Surg 1990, 125:519-522.
127. Rapoport J, Teres D, Lemeshow S, et al. Explaining variability of cost using a severity of illness measure for ICU patients. Med Care 1990, 28:338-348.
128. Oye RK, Bellamy PF Patterns of resource consumption in medical intensive care. Chest 1991, 99:689-695.
129. Knaus WA, Draper EA, Wagner DP, Zimmerman JE An evaluation of outcome from intensive care in major medical centers. Ann Intern Med 1986, 104:410-418.
130. Hosmer DW, Lemeshow S Confidence interval estimates of an index of quality performance based on logistic regression estimates. Stat Med 1995, 14:2161-2172.
131. Rapoport J, Teres D, Barnett R, et al. A comparison of intensive care unit utilization in Alberta and Western Massachusetts. Crit Care Med 1995, 23:1336-1346.
132. Wong DT, Crofts SL, Gomez M, et al. Evaluation of predictive ability of APACHE II system and hospital outcome in Canadian intensive care unit patients. Crit Care Med 1995, 23:1177-1183.
133. Le Gall JR, Loirat P, Nicolas F, et al. Utilisation d'un indice de gravité dans huit services de réanimation multidisciplinaire. Presse Med 1983, 12:1757-1761.
134. Zimmerman JE, Rousseau DM, Duffy J, et al. Intensive care at two teaching hospitals: An organizational case study. Am J Crit Care 1994, 3:129-138.
135. Chisakuta AM, Alexander JP Audit in intensive care. The APACHE II classification of severity of disease. Ulster Med J 1990, 59:161-167.
136. Marsh HM, Krishan I, Naessens JM, et al. Assessment of prediction of mortality by using the APACHE II scoring system in intensive care units. Mayo Clin Proc 1990, 65:1549-1557.
137. Turner JS, Mudaliar YM, Chang RW, Morgan CJ Acute Physiology and Chronic Health Evaluation (APACHE II) scoring in a cardiothoracic intensive care unit. Crit Care Med 1991, 19:1266-1269.
138. Oh TE, Hutchinson R, Short S, et al. Verification of the acute physiology and chronic health evaluation scoring system in a Hong Kong intensive care unit. Crit Care Med 1993, 21:698-705.
139. Zimmerman JE, Shortell SM, Rousseau DM, et al. Improving intensive care: Observations based on organizational case studies in nine intensive care units: A prospective, multicenter study. Crit Care Med 1993, 21:1443-1451.
140. Shortell SM, Zimmerman JE, Rousseau DM, et al. The performance of intensive care units: does good management make a difference?. Med Care 1994, 32:508-525.
141. Organization and Management of Intensive Care: A Prospective Study in 12 European Countries 1997, Vol 29. Springer-Verlag, Berlin/Heidelberg. D. Reis Miranda, D.W. Ryan, W.B. Schaufeli, V. Fidler (Eds.).
142. Moreno R, Matos R New issues in severity scoring: Interfacing the ICU and evaluating it. Curr Opin Crit Care 2001, 7:469-474.
143. Teres D, Lemeshow S Using severity measures to describe high performance intensive care units. Crit Care Clin 1993, 9:543-554.
144. Teres D, Lemeshow S Why severity models should be used with caution. Crit Care Clin 1994, 10:93-110.
145. Teres D, Lieberman S Are we ready to regionalize pediatric intensive care?. Crit Care Med 1991, 19:139-140.
146. Pollack MM, Alexander SR, Clarke N, et al. Improved outcomes from tertiary center pediatric intensive care: A statewide comparison of tertiary and nontertiary care facilities. Crit Care Med 1990, 19:150-159.
147. Goldstein H, Spiegelhalter DJ League tables and their limitations: Statistical issues in comparisons of institutional performance. J R Stat Soc A 1996, 159:385-443.
148. Polderman KH, Thijs LG, Girbes AR Interobserver variability in the use of APACHE II scores. Lancet 1999, 353:380. (Letter).
149. Fry DE, Pearlstein L, Fulton RL, Polk HC Multiple system organ failure. The role of uncontrolled infection. Arch Surg 1980, 115:136-140.
150. Elebute EA, Stoner HB The grading of sepsis. Br J Surg 1983, 70:29-31.
151. Stevens LE Gauging the severity of surgical sepsis. Arch Surg 1983, 118:1190-1192.
152. Goris RJA, te Boekhorst TP, Nuytinck JKS, Gimbrère JSF Multiple-organ failure. Generalized autodestructive inflammation?. Arch Surg 1985, 120:1109-1115.
153. Knaus WA, Draper EA, Wagner DP, Zimmerman JE Prognosis in acute organ-system failure. Ann Surg 1985, 202:685-693.
154. Chang RW, Jacobs S, Lee B Predicting outcome among intensive care unit patients using computerised trend analysis of daily Apache II scores corrected for organ system failure. Intensive Care Med 1988, 14:558-566.
155. Meek M, Munster AM, Winchurch RA, et al. The Baltimore Sepsis Scale: Measurement of sepsis in patients with burns using a new scoring system. J Burn Care Rehabil 1991, 12:564.
156. Baumgartner JD, Bula C, Vaney C, et al. A novel score for predicting the mortality of septic shock patients. Crit Care Med 1992, 20:953.
157. Bernard GR, Doig BG, Hudson G, et al. Quantification of organ failure for clinical trials and clinical practice. Am J Respir Crit Care Med 1995, 151:A323. (Abstract).
158. Bertleff MJ, Bruining HA How should multiple organ dysfunction syndrome be assessed?. A review of the variations in current scoring systems. Eur J Surg 1997, 163:405-409.
159. Jacobs S, Zuleika M, Mphansa T The multiple organ dysfunction score as a descriptor of patient outcome in septic shock compared with two other scoring systems. Crit Care Med 1999, 27:741-744.
160. Gonçalves JA, Hydo LJ, Barie PS Factors influencing outcome of prolonged norepinephrine therapy for shock in critical surgical illness. Shock 1998, 10:231-236.
161. Maziak DE, Lindsay TF, Marshall JC, et al. The impact of multiple organ dysfunction on mortality following ruptured abdominal aortic aneurysm repair. Ann Vasc Surg 1998, 12:93-100.
162. Pinilla JC, Hayes P, Laverty W, et al. The C-reactive protein to prealbumin ratio correlates with the severity of multiple organ dysfunction. Surgery 1998, 124:799-805.
163. Staubach KH, Schroder J, Stuber F, et al. Effect of pentoxifylline in severe sepsis: Results of a randomized, double-blind, placebo-controlled study. Arch Surg 1998, 133:94-100.
164. Vincent J-L, de Mendonça A, Cantraine F, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: Results of a multicentric, prospective study. Crit Care Med 1998, 26:1793-1800.
165. Di Filippo A, De Gaudio AR, Novelli A, et al. Continuous infusion of vancomycin in methicillin-resistant staphylococcus infection. Chemotherapy 1998, 44:63-68.
166. Fiore G, Donadio PP, Gianferrari P, et al. CVVH in postoperative care of liver transplantation. Minerva Anestesiol 1998, 64:83-87.
167. Briegel J, Forst H, Haller M, et al. Stress doses of hydrocortisone reverse hyperdynamic septic shock: Aprospective, randomized, double-blind, single-center study. Crit Care Med 1999, 27:723-732.
168. Hynninen M, Valtonen M, Markkanen H, et al. Interleukin 1 receptor antagonist and E-selectin concentrations: A comparison in patients with severe acute pancreatitis and severe sepsis. J Crit Care 1999, 14:63-68.
169. Soufir L, Timsits JF, Mahe C, et al. Attributable morbidity and mortality of catheter-related septicemia in critically ill patients: A matched, risk-adjusted, cohort study. Infect Control Hosp Epidemiol 1999, 20:396-401.
170. Moreno R, Pereira E, Matos R, Fevereiro T The evaluation of cardiovascular dysfunction/failure in multiple organ failure [abstract]. Intensive Care Med 1997, 23:S153.
171. Timsit JF, Fosse JP, Troche G, et al. Accuracy of a composite score using daily SAPS II and LOD scores for predicting hospital mortality in ICU patients hospitalized for more than 72 h. Intensive Care Med 2001, 27:1012-1021.
172. Meade MO, Cook DJ A critical appraisal and systematic review of illness severity scoring systems in the intensive care unit. Curr Opin Crit Care 1995, 1:191.
173. Reis Miranda D, Moreno R ICU models and their role in management and utilization programs. Curr Opin Crit Care 1997, 3:183-187.
174. Boyd O, Grounds M Can standardized mortality ratio be used to compare quality of intensive care unit performance?. Crit Care Med 1994, 22:1706-1708. (Letter).
175. Moreno R Performance of the ICU. Are we able to measure it?. 1998 Yearbook of Intensive Care and Emergency Medicine 1998, 729-743. Springer-Verlag, New York. J.L. Vincent (Ed.).
176. Hopfel AW, Taaffe CL, Herrmann VM Failure of APACHE II alone as a predictor of mortality in patients receiving total parenteral nutrition. Crit Care Med 1989, 17:414-417.
177. Esserman L, Belkora J, Lenert L Potentially ineffective care. A new outcome to assess the limits of critical care. JAMA 1995, 274:1544-1551.
178. Moreno R, Matos R, Fevereiro T, Pereira ME À procura de um éndice de gravidade na sépsis. Rev Port Med Intensiva 1999, 8:43-52.
179. Carlet J, Nicolas F Specific severity of illness scoring systems. Curr Opin Crit Care 1995, 1:233.
180. Abecasis PB Quantificação das alterações sistémicas como éndice prognóstico em Medicina Intensiva 1997, Universidade Nova de Lisboa, Lisbon.
181. Casey LC, Balk RA, Bone RC Plasma cytokine and endotoxin levels correlate with survival in patients with the sepsis syndrome. Ann Intern Med 1993, 119:771.
182. Alberti C, Brun-Buisson C, Chevret S, et al. Systemic inflammatory response and progression to severe sepsis in critically ill infected patients. Am J Respir Crit Care Med 2005, 171:461-468.
183. Backer S, O'Neill B, Haddon W, Long WN The injury severity score: A method for describing patients with multiple injuries and evaluating emergency care. J Trauma 1974, 14:187-196.
184. Champion HR, Sacco WJ, Carnazzo AJ, et al. Trauma score. Crit Care 1981, 9:672-676.
185. Champion HR, Sacco WJ, Copes WS, et al. A revision of the Trauma Score. J Trauma 1989, 29.
186. Champion HR, Sacco WJ, Hunt TK Trauma severity scoring to predict mortality. World J Surg 1983, 7:4-11.
187. Pickering SAW, Esberger D, Moran CG The outcome following major trauma in the elderly. Predictors of survival. Injury 1999, 30:703-706.
188. Sicignano A, Giudici D Probability model of hospital death for severe trauma patients based on the Simplified Acute Physiology Score I: Development and validation. J Trauma 1997, 43:585-589.
189. Unertl K, Kottler BM [Prognostic scores in intensive care]. Anaesthesist 1997, 46:471-480.
190. Barbieri S, Michieletto E, Feltracco P, et al. [Prognostic systems in intensive care: TRISS, SAPS II, APACHE III]. Minerva Anestesiol 2001, 67:519.
191. Reiter A, Mauritz W, Jordan B, et al. Improving risk adjustment in critically ill trauma patients: The TRISS-SAPS score. J Trauma 2004, 57:375-380.
192. Champion HR, Copes WS, Sacco WJ, et al. A new characterization of injury severity. J Trauma 1990, 30:539-545.
193. Markle J, Cayten CG, Byrne DW, et al. Comparison between TRISS and ASCOT methods in controlling for injury severity. J Trauma 1992, 33:326-332.
194. Hannan EL, Mendeloff J, Farrell LS, et al. Validation of TRISS and ASCOT using a non-MTOS trauma registry. J Trauma 1995, 38:83-88.
195. Gabbe BJ, Cameron PA, Wolfe R, et al. Predictors of mortality, length of stay and discharge destination in blunt trauma. Austr N Z J Surg 2005, 75:650-656.
196. Hannan EL, Farrell LS, Cayten CG Predicting survival of victims of motor vehicle crashes in New York state. Injury 1997, 28:607-615.
197. Schall LC, Potoka DA, Ford HR A new method for estimating probability of survival in pediatric patients using revised TRISS methodology based on age-adjusted weights. J Trauma 2002, 52:235-241.
198. Davis EG, MacKenzie EJ, Sacco WJ, et al. A new "TRISS-like" probability of survival model for intubated trauma patients. J Trauma 2003, 55:53-61.
199. Osler TM, Rogers FB, Badger GJ, et al. A simple mathematical modification of TRISS markedly improves calibration. J Trauma 2002, 53:630-634.
200. Glance LG, Osler TM, Dick AW Evaluating trauma center quality: Does the choice of the severity-adjustment model make a difference?. J Trauma 2005, 58:1265-1271.
201. Parsonnet V, Dean D, Bernstein A A method for uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 1989, 79:I3-I12.
202. Higgins TL, Estafanous FG, Loop FD, et al. Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. A clinical severity score. JAMA 1992, 267:2344-2348.
203. Roques F, Gabrielle F, Michel P, et al. Quality of care in adult heart surgery: Proposal for a self-assessment approach based on a French multicenter study. Eur J Cardiothorac Surg 1995, 9:439-440.
204. Tuman KJ, McCarthy RJ, March RJ, et al. Morbidity and duration of ICU stay after cardiac surgery. A model for preoperative risk assessment. Chest 1992, 102:36-44.
205. Shroyer AL, Plomondon ME, Grover FL, Edwards FH The 1996 coronary artery bypass risk model: The Society of Thoracic Surgeons Adult Cardiac National Database. Ann Thorac Surg 1999, 67:1205-1208.
206. Hannan EL, Kilburn H, O'Donnell JF, et al. Adult open heart surgery in New York State. An analysis of risk factors and hospital mortality rates. JAMA 1990, 264:2768-2774.
207. Grover FL, Shroyer AL, Hammermeister KE Calculating risk and outcome: The Veterans Affairs database. Ann Thorac Surg 1996, 62:S6-S11.
208. O'Connor GT, Plume SK, Olmstead EM, et al. Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Northern New England Cardiovascular Disease Study Group. Circulation 1992, 85:2110-2118.
209. Nashef SA, Roques F, Michel P, et al. European System for Cardiac Operative Risk Evaluation (EuroSCORE). Eur J Cardiothorac Surg 1999, 16:9-13.
210. Kawachi Y, Nakashima A, Toshima Y, et al. Risk stratification analysis of operative mortality in heart and thoracic aorta surgery: Comparison between Parsonnet and EuroSCORE additive model. Eur J Cardiothorac Surg 2001, 20:961-966.
211. Sergeant P, de Worm E, Meyns B Single centre, single domain validation of the EuroSCORE on a consecutive sample of primary and repeat CABG. Eur J Cardiothorac Surg 2001, 20:1176-1182.
212. Kurki TS, Jarvinen O, Kataja MJ, et al. Performance of three preoperative risk indices; CABDEAL, EuroSCORE and Cleveland models in a prospective coronary bypass database. Eur J Cardiothorac Surg 2002, 21:406-410.
213. Nashef SA, Roques F, Hammill BG, et al. Validation of European System for Cardiac Operative Risk Evaluation (EuroSCORE) in North American cardiac surgery. Eur J Cardiothorac Surg 2002, 22:101-105.
214. Sokolovic E, Schmidlin D, Schmid ER, et al. Determinants of costs and resource utilization associated with open heart surgery. Eur J Cardiothorac Surg 2002, 23:574-578.
215. Chung DA, Sharples LD, Nashef SA A case-control analysis of readmissions to the cardiac surgical intensive care unit. Eur J Cardiothorac Surg 2002, 22:282-286.
216. Gurler S, Gebhard A, Godehardt E, et al. EuroSCORE as a predictor for complications and outcome. Eur J Cardiothorac Surg 2003, 51:73-77.
217. De Maria R, Mazzoni M, Parolini M, et al. Predictive value of EuroSCORE on long term outcome in cardiac surgery patients: A single institution study. Heart 2005, 91:779-784.
218. Roques F, Michel P, Goldstone AR, Nashef SA The logistic EuroSCORE. Eur Heart J 2003, 24:881-882. (Letter).
219. Gogbashian A, Sedrakyan A, Treasure T EuroSCORE: A systematic review of international performance. Eur J Cardiothorac Surg 2004, 25:695-700.
220. Sinuff T, Adhikari NKJ, Cook DJ, et al. Mortality predictions in the intensive care unit: Comparing physicians with scoring systems. Crit Care Med 2006, 34:878-885.
221. Booth FV, Short M, Shorr AF, et al. Application of a population-based severity scoring system to individual patients results in frequent misclassification. Crit Care 2006, 9:R522-R529.