Why the C-statistic is not informative to evaluate early warning scores and what metrics to use

Critical Care

Volumn 19, Issue 1, 2015, Pages

  Romero Brufau, Santiago ^a   Huddleston, Jeanne M ^a   Escobar, Gabriel J ^b   Liebow, Mark ^c  

^a MAYO CLINIC   (United States)

^b DIVISION OF RESEARCH   (United States)

^c Mayo Clinic College of Medicine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL PARAMETERS; AREA UNDER THE CURVE; ARTICLE; BIOMETRY; C STATISTIC; CUTOFF VALUE; DETERIORATION; DIAGNOSTIC TEST; EARLY WARNING SCORE; HUMAN; LIKELIHOOD RATIO; PREDICTION; PREDICTIVE VALUE; PREVALENCE; PRIORITY JOURNAL; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; DECISION SUPPORT SYSTEM; INTENSIVE CARE; PROCEDURES; STANDARDS; STATISTICS;

CRITICAL CARE; DECISION SUPPORT TECHNIQUES; HUMANS; ROC CURVE; STATISTICS AS TOPIC;

EID: 84939187754     PISSN: 13648535     EISSN: 1466609X     Source Type: Journal    
DOI: 10.1186/s13054-015-0999-1     Document Type: Article

References (23)

1. Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84:465-70.
2. Tirkkonen J, Olkkola KT, Huhtala H, Tenhunen J, Hoppu S. Medical emergency team activation: performance of conventional dichotomised criteria versus national early warning score. Acta Anaesth Scand. 2014;58:411-9.
3. Acutely ill patients in hospital: recognition of and response to acute illness in adults in hospital. National Institute for Health and Care Excellence. 2007. www.nice.org.uk/guidance/cg50. Accessed 02 Jul 2015.
4. National Early Warning Score (NEWS): standardising the assessment of acute-illness severity in the NHS-report of a working party. Royal College of Physicians of London. 2012. www.rcplondon.ac.uk/resources/national-early-warning-score-news. Accessed 02 Jul 2015.
5. D'Cruz R, Rubulotta F. Implementation of the National Early Warning Score in a teaching hospital [Abstract 0567]. Intensive Care Med. 2014;40 Suppl:160.
6. Gleeson L, Reynolds O, O'Connor P, Byrne D. Attitudes of doctors and nurses to the National Early Warning Score System. Irish J Med Sci. 2014;183 Suppl 4:193.
7. Jones M. NEWSDIG: The National Early Warning Score Development and Implementation Group. Clin Med. 2012;12:501-3.
8. Romero-Brufau S, Huddleston JM, Naessens JM, Johnson MG, Hickman J, Morlan BW, et al. Widely used track and trigger scores: are they ready for automation in practice? Resuscitation. 2014;85:549-52.
9. Escobar GJ, LaGuardia JC, Turk BJ, Ragins A, Kipnis P, Draper D. Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record. J Hosp Med. 2012;7:388-95.
10. Donlon J, Levy H, Scriver C. Hyperphenylalaninemia: phenylalanine hydroxylase deficiency. In: Scriver CEA, editor. The metabolic and molecular bases of inherited disease. New York: McGraw-Hill; 2004.
11. Dodd RY, Notari EP, Stramer SL. Current prevalence and incidence of infectious disease markers and estimated window-period risk in the American Red Cross blood donor population. Transfusion. 2002;42:975-9.
12. Burkhardt U, Mertens T, Eggers HJ. Comparison of two commercially available anti-HIV ELISAs: Abbott HTLV III EIA and Du Pont HTLV III-ELISA. J Med Virol. 1987;23:217-24.
13. Stetler HC, Granade TC, Nunez CA, Meza R, Terrell S, Amador L, et al. Field evaluation of rapid HIV serologic tests for screening and confirming HIV-1 infection in Honduras. Aids. 1997;11:369-75.
14. McAlpine L, Gandhi J, Parry JV, Mortimer PP. Thirteen current anti-HIV-1/HIV-2 enzyme immunoassays: how accurate are they? J Med Virol. 1994;42:115-8.
15. Smith GB, Prytherch DR, Schmidt PE, Featherstone PI. Review and performance evaluation of aggregate weighted "track and trigger" systems. Resuscitation. 2008;77:170-9.
16. Smith GB, Prytherch DR, Schmidt PE, Featherstone PI, Higgins B. A review, and performance evaluation, of single-parameter "track and trigger" systems. Resuscitation. 2008;79:11-21.
17. Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation. 2007;115:928-35.
18. Graham KC, Cvach M. Monitor alarm fatigue: standardizing use of physiological monitors and decreasing nuisance alarms. Am J Crit Care. 2010;19:28-34. quiz 35.
19. Hannibal GB. Monitor alarms and alarm fatigue. AACN Adv Crit Care. 2011;22:418-20.
20. Early warning systems: scorecards that save lives. Institute for Healthcare Improvement. http://www.ihi.org/resources/Pages/ImprovementStories/EarlyWarningSystemsScorecardsThatSaveLives.aspx. Accessed 02 Jul 2015.
21. Jund J, Rabilloud M, Wallon M, Ecochard R. Methods to estimate the optimal threshold for normally or log-normally distributed biological tests. Med Decis Making. 2005;25:406-15.
22. Hand DJ, Whitrow C, Adams NM, Juszczak P, Weston D. Performance criteria for plastic card fraud detection tools. J Oper Res Soc. 2008;59:956-62.
23. Srikureja W, Kyulo NL, Runyon BA, Hu KQ. MELD score is a better prognostic model than Child-Turcotte-Pugh score or discriminant function score in patients with alcoholic hepatitis. J Hepatol. 2005;42:700-6.