Development and validation of a continuous measure of patient condition using the Electronic Medical Record

Journal of Biomedical Informatics

Volumn 46, Issue 5, 2013, Pages 837-848

  Rothman, Michael J ^a   Rothman, Steven I ^a,b   Beals, Joseph ^a  

^a PeraHealth Inc   (United States)

^b FAR Institute   (United States)

Author keywords

Acuity score; Deterioration; Electronic health records; Health status indicators; Nursing assessments; Patient condition

Indexed keywords

ACUITY SCORE; CLINICAL MEASUREMENTS; ELECTRONIC HEALTH RECORD; ELECTRONIC MEDICAL RECORD; HEALTH STATUS; LOGISTIC REGRESSIONS; PATIENT CONDITION; RECEIVER OPERATING CHARACTERISTIC CURVES;

COMMUNICATION; DETERIORATION; INTENSIVE CARE UNITS; MEDICAL COMPUTING; NURSING; RISK PERCEPTION; SURGERY;

DIAGNOSIS;

ARTICLE; CANCER RESEARCH; ELECTRONIC MEDICAL RECORD; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; MEDICAL INFORMATION SYSTEM; MEDICAL RESEARCH; PRIORITY JOURNAL; SEARCH ENGINE;

ACUITY SCORE; DETERIORATION; ELECTRONIC HEALTH RECORDS; HEALTH STATUS INDICATORS; NURSING ASSESSMENTS; PATIENT CONDITION;

APACHE; HEALTH STATUS; HUMANS; LOGISTIC MODELS; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; MODELS, THEORETICAL; MORTALITY; PATIENT DISCHARGE; PATIENT READMISSION; PATIENTS; ROC CURVE;

EID: 84883746095     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2013.06.011     Document Type: Article

References (65)

1. Adams ST, Leveson SH. Clinical prediction rules. BMJ 2012;344.
2. Fraser D.D., Singh R.N., Frewen T. The PEWS score: potential calling criteria for critical care response teams in children's hospitals. J Crit Care 2006, 21:278-279.
3. Cuthbertson B.H., Smith G.B. A warning on early-warning scores!. Br J Anaesth 2007, 98:704-706.
4. Liao L., Mark D.B. Clinical prediction models: are we building better mousetraps?. J Am Coll Cardiol 2003, 42:851-853.
5. Cuthbertson B.H., Boroujerdi M., McKie L., et al. Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient?. Crit Care Med 2007, 35:402-409.
6. Cretikos M., Chen J., Hillman K., et al. The objective medical emergency team activation criteria: a case-control study. Resuscitation 2007, 73:62-72.
7. Devita M.A., Bellomo R., Hillman K., et al. Findings of the first consensus conference on medical emergency teams. Crit Care Med 2006, 34:2463-2478.
8. Gao H., McDonnell A., Harrison D.A., et al. Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med 2007, 33:667-679.
9. Hillman K., Chen J., Cretikos M., et al. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet 2005, 365:2091-2097.
10. Subbe C.P., Davies R.G., Williams E., et al. Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia 2003, 58:797-802.
11. Winters B.D., Pham J., Pronovost P.J. Rapid response teams-walk, don't run. JAMA 2006, 296:1645-1647.
12. Egevad L., Granfors T., Karlberg L., et al. Prognostic value of the Gleason score in prostate cancer. BJU Int 2002, 89:538-542.
13. Berman M., Stamler A., Sahar G., et al. Validation of the 2000 Bernstein-Parsonnet score versus the EuroSCORE as a prognostic tool in cardiac surgery. Ann Thorac Surg 2006, 81:537-540.
14. Gogbashian A., Sedrakyan A., Treasure T. EuroSCORE: a systematic review of international performance. Eur J Cardiothorac Surg 2004, 25:695-700.
15. Pollack M.M., Patel K.M., Ruttimann U.E. PRISM III: an updated pediatric risk of mortality score. Crit Care Med 1996, 24:743-752.
16. Rexius H., Brandrup-Wognsen G., Nilsson J., et al. A simple score to assess mortality risk in patients waiting for coronary artery bypass grafting. Ann Thorac Surg 2006, 81:577-582.
17. Knaus W.A., Wagner D.P., Draper E.A., et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100:1619-1636.
18. Vincent J.L., Moreno R., Takala J., et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the working group on sepsis-related problems of the European society of intensive care medicine. Intensive Care Med 1996, 22:707-710.
19. Subbe C.P., Kruger M., Rutherford P., et al. Validation of a modified Early Warning Score in medical admissions. QJM 2001, 94:521-526.
20. Kirkland LL, Malinchoc M, O'Byrne M, et al. A Clinical Deterioration Prediction Tool for Internal Medicine Patients. American Journal of Medical Quality Published Online First: 19 July 2012. doi:. doi:10.1177/1062860612450459.
21. Escobar G.J., LaGuardia J.C., Turk B.J., et al. Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record. J Hosp Med 2012, 7:388-395.
22. Prytherch D.R., Smith G.B., Schmidt P.E., et al. ViEWS-Towards a national early warning score for detecting adult inpatient deterioration. Resuscitation 2010, 81:932-937.
23. Parshuram C.S., Hutchison J., Middaugh K. Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care 2009, 13:R135.
24. McLellan MC, Connor JA. The Cardiac Children's Hospital Early Warning Score (C-CHEWS). J Pediatr Nurs Published Online First: 15 August 2012. doi:. doi:10.1016/j.pedn.2012.07.009.
25. Buist M.D., Moore G.E., Bernard S.A., et al. Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ 2002, 324:387-390.
26. Kyriacos U., Jelsma J., Jordan S. Monitoring vital signs using early warning scoring systems: a review of the literature. J Nurs Manag 2011, 19:311-330.
27. Duncan H., Hutchison J., Parshuram C.S. The pediatric early warning system score: a severity of illness score to predict urgent medical need in hospitalized children. J Crit Care 2006, 21:271-278.
28. Mao Y., Chen Y., Hackmann G., et al. Early deterioration warning for hospitalized patients by mining clinical data. IJDKB 2011, 2:1-20.
29. Richardson D.K., Gray J.E., McCormick M.C., et al. Score for neonatal acute physiology: a physiologic severity index for neonatal intensive care. Pediatrics 1993, 91:617-623.
30. Rothman MJ, Solinger AB, Rothman SI, et al. Clinical implications and validity of nursing assessments: a longitudinal measure of patient condition from analysis of the Electronic Medical Record. BMJ Open 2012;2. doi:. doi:10.1136/bmjopen-2012-000849.
31. Walter L.C., Brand R.J., Counsell S.R., et al. Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization. JAMA 2001, 285:2987-2994.
32. Baid H. The process of conducting a physical assessment: a nursing perspective. Br J Nurs 2006, 15:710-714.
33. Kerr S.D. A comparison of four nursing documentation systems. J Nurs Staff Dev 1992, 8:27-31.
34. Adams S.T., Leveson S.H. Clinical prediction rules. BMJ 2012, 344:d8312.
35. Boudreaux E.D., Friedman J., Chansky M.E., et al. Emergency department patient satisfaction: examining the role of acuity. Acad Emergy Med 2004, 11:162-168.
36. Grobman W.A., Stamilio D.M. Methods of clinical prediction. Am J Obstet Gynecol 2006, 194:888-894.
37. Lowry R. Concepts & Applications of Inferential Statistics,Chapter 14. <> 2012. http://www.vassarstats.net/textbook.
38. Kelly C.A., Upex A., Bateman D.N. Comparison of consciousness level assessment in the poisoned patient using the alert/verbal/painful/unresponsive scale and the Glasgow Coma Scale. Ann Emergy Med 2004, 44:108-113.
39. Higgins Y., Maries-Tillott C., Quinton S., et al. Promoting patient safety using an early warning scoring system. Nurs Stand 2008, 22:35-40.
40. Bland J.M., Altman D.G. Validating scales and indexes. BMJ 2002, 324:606-607.
41. Van Walraven C, Dhalla IA, Bell C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182(6).
42. Lindenauer P.K., Normand S.L., Drye E.E., et al. Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia. J Hosp Med 2011, 6(3):142-150.
43. Hasan O., Meltzer D.O., Shaykevich S.A., et al. Hospital readmission in general medicine patients: a prediction model. J Gen Intern Med 2010, 25(3):211-219.
44. Hripcsak G., Albers D.J., Perotte A. Exploiting time in electronic health record correlations. J Am Med Inform Assoc 2011, 18(Suppl 1):i109-i115.
45. Duckitt R.W., Buxton-Thomas R., Walker J., et al. Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth 2007, 98:769-774.
46. Inouye S.K., Peduzzi P.N., Robison J.T., et al. Importance of functional measures in predicting mortality among older hospitalized patients. JAMA 1998, 279:1187-1193.
47. Duncan K.D., McMullan C., Mills B.M. Early warning systems: the next level of rapid response. Nursing 2012, 42:38-44.
48. Odell M., Victor C., Oliver D. Nurses' role in detecting deterioration in ward patients: systematic literature review. J Adv Nurs 2009, 65:1992-2006.
49. Akre M., Finkelstein M., Erickson M., et al. Sensitivity of the pediatric early warning score to identify patient deterioration. Pediatrics 2010, 125:e763-e769.
50. Smith G.B., Prytherch D.R., Schmidt P.E., et al. Review and performance evaluation of aggregate weighted 'track and trigger' systems. Resuscitation 2008, 77:170-179.
51. Kho A, Rotz D, Alrahi K, et al. Utility of commonly captured data from an EHR to identify hospitalized patients at risk for clinical deterioration. AMIA Annu Symp Proc 2007;404-8.
52. Liaw S.Y., Scherpbier A., Klainin-Yobas P., et al. A review of educational strategies to improve nurses' roles in recognizing and responding to deteriorating patients. Int Nurs Rev 2011, 58:296-303.
53. National Patient Safety Agency. Safer care for the acutely ill patient: learning from serious incidents. Available at: ; 2007. http://www.nrls.npsa.nhs.uk/resources/?EntryId45=59828.
54. Institute for Healthcare Improvement: Improving transitions in hospital care. <> (accessed 20 Feb2012). http://www.ihi.org/offerings/VirtualPrograms/Expeditions/Transitions/Pages/default.aspx.
55. Joint Commission Center for Transforming Healthcare: Hand-Off Communications Project. <> (accessed 20 Feb2012). http://www.centerfortransforminghealthcare.org/projects/detail.aspx?Project=1.
56. Tait D. Nursing recognition and response to signs of clinical deterioration. Nurs Manag (Harrow) 2010, 17:31-35.
57. Blouin A.S. Improving hand-off communications: new solutions for nurses. J Nurs Care Qual 2011, 26:97-100.
58. Bates D.W., Gawande A.A. Improving safety with information technology. N Engl J Med 2003, 348:2526-2534.
59. Breslow M.J., Rosenfeld B.A., Doerfler M., et al. Effect of a multiple-site intensive care unit telemedicine program on clinical and economic outcomes: an alternative paradigm for intensivist staffing. Crit Care Med 2004, 32:31-38.
60. Goldhill D.R., McNarry A.F. Physiological abnormalities in early warning scores are related to mortality in adult inpatients†. Br J Anaesth 2004, 92:882-884.
61. Cioffi J. Nurses' experiences of making decisions to call emergency assistance to their patients. J Adv Nurs 2000, 32:108-114.
62. Kause J., Smith G., Prytherch D., et al. A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in australia and New Zealand, and the United Kingdom-the ACADEMIA study. Resuscitation 2004, 62:275-282.
63. Hillman K.M., Bristow P.J., Chey T., et al. Antecedents to hospital deaths. Int Med J 2001, 31:343-348.
64. Bradley EH, Yakusheva O, Horwitz LI, et al. Identifying patients at increased risk for unplanned readmission. Medical Care 2013, in press.
65. Tepas III JJ, Rimar JM, Hsiao AL, Nussbaum MS. Automated analysis of electronic medical record data reflects the pathophysiology of surgical complications. Surgery 2013, in press.