The ngram chief complaint classifier: A novel method of automatically creating chief complaint classifiers based on international classification of diseases groupings

Journal of Biomedical Informatics

Volumn 43, Issue 2, 2010, Pages 268-272

  Brown, Philip ^a   Halász, Sylvia ^a   Goodall, Colin ^a   Cochrane, Dennis G ^b,c   Milano, Peter ^b   Allegra, John R ^b,c  

^a AT AND T LABS RESEARCH   (United States)

^b Emergency Medical Associates   (United States)

^c MORRISTOWN MEMORIAL HOSPITAL   (United States)

Author keywords

Disease outbreaks; Epidemiology; Public health; Surveillance

Indexed keywords

DISEASE OUTBREAKS; EMERGENCY DEPARTMENTS; INTERNATIONAL CLASSIFICATION OF DISEASE; NOVEL METHODS; PUBLIC HEALTH; TEST SETS; TEXT FRAGMENTS; TRAINING SETS; VOLUME CORRELATIONS;

CLASSIFIERS; COLOR;

CLASSIFICATION (OF INFORMATION);

ABDOMINAL PAIN; ARTICLE; CLASSIFIER; GASTROINTESTINAL DISEASE; INTERNATIONAL CLASSIFICATION OF DISEASES; PRIORITY JOURNAL; SENSITIVITY AND SPECIFICITY;

COHORT STUDIES; DIAGNOSIS; DISEASE OUTBREAKS; EMERGENCY SERVICE, HOSPITAL; EPIDEMIOLOGIC METHODS; GASTROINTESTINAL DISEASES; HUMANS; MEDICAL INFORMATICS; NATURAL LANGUAGE PROCESSING; POPULATION SURVEILLANCE; RETROSPECTIVE STUDIES; SENSITIVITY AND SPECIFICITY;

EID: 77949264235     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2009.08.015     Document Type: Article

References (34)

1. Reis B.Y., and Mandl K.D. Syndromic surveillance: the effects of syndrome grouping on model accuracy and outbreak detection. Ann Emerg Med 44 3 (2004) 235-241
2. Henning K.J. What is syndromic surveillance?. MMWR Morb Mortal Wkly Rep 53 Suppl (2004) 5-11
3. Travers D.A., and Haas S.W. Evaluation of emergency medical text processor, a system for cleaning chief complaint text data. Acad Emerg Med 11 11 (2004) 1170-1176
4. American Medical Association. ICD-9-CM 2002: international classification of diseases, 9th revision. Chicago, IL: American Medical Association; 2002.
5. Beitel A.J., Olson K.L., Reis B.Y., and Mandl K.D. Use of emergency department chief complaint and diagnostic codes for identifying respiratory illness in a pediatric population. Pediatr Emerg Care 20 (2004) 355-360
6. Espino J.U., and Wagner M.M. Accuracy of ICD-9-coded chief complaints and diagnoses for the detection of acute respiratory illness. Proc AMIA Symp (2001) 164-168
7. Ivanov O., Wagner M.M., Chapman W.W., and Olszewski R.T. Accuracy of three classifiers of acute gastrointestinal syndrome for syndromic surveillance. Proc AMIA Symp (2002) 345-349
8. Mocny M., Cochrane D.G., Allegra J.R., Nguyen T., and Heffernan R. A comparison of two methods for biosurveillance of respiratory disease in the emergency department: chief complaint vs ICD-9 diagnosis code. Acad Emerg Med 10 (2003) 513
9. Tsui F.C., Wagner M.M., Dato V., and Chang C.C. Value of ICD-9 coded chief complaints for detection of epidemics. Proc AMIA Symp (2001) 711-715
10. Begier E.M., Sockwell D., Branch L.M., et al. The national capitol region's emergency department syndromic surveillance system: do chief complaint and discharge diagnosis yield difference results?. Emerg Infect Dis 9 (2003) 393-396
11. Bravata DM, McDonald KM, Smith WM, et al. Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Ann Int Med 2004;140(11):910-22. [Review].
12. Pavlin JA, Kelley PW. ESSENCE: electronic surveillance system for early notification of community-based epidemics. Silver Spring, MD: U.S. Department of Defense, Global Emerging Infections Surveillance and Response System; 4 October 2001.
13. Mikosz C.A., Silva J., Black S., Gibbs G., and Cardenas I. Comparison of two major emergency department-based free-text chief-complaint coding systems. MMWR Morb Mortal Wkly Rep 53 Suppl (2004) 101-105
14. Chapman W.W., Christensen L.M., Wagner M.M., et al. Classifying free-text triage chief complaints into syndromic categories with natural language processing. Artif Intell Med 33 1 (2005) 31-40
15. Travers D.A., and Haas S.W. Using nurses' natural language entries to build a concept-oriented terminology for patients' chief complaints in the emergency department. J Biomed Inform 36 4-5 (2003) 260-270
16. Tsui F.C., Espino J.U., Wagner M.M., et al. Data, network, and application: technical description of the Utah RODS Winter Olympic Biosurveillance System. Proc AMIA Symp (2002) 815-819
17. Wagner M.M., Espino J., Tsui F.C., et al. Syndrome and outbreak detection using chief-complaint data-experience of the real-time outbreak and disease surveillance project. MMWR Morb Mortal Wkly Rep 53 Suppl (2004) 28-31
18. Bravata D.M., Rahman M.M., Luong N., Divan H.A., and Cody S.H. A comparison of syndromic incidence data collected by triage nurses in Santa Clara County with regional infectious disease data. J Urban Health 80 (2003) 122
19. Zelicoff A., Brillman J., Forslund D.W., et al. The rapid syndrome validation project (RSVP) (2001), Sandia National Laboratories, Albuquerque, NM
20. Idaho Technology products. Salt Lake City, UT: Idaho Technology, Inc. Accessed from: www.idahotech.com on 29 October 2001.
21. Chapman W.W., Dowling J.N., and Wagner M.M. Classification of emergency department chief complaints into 7 syndromes: a retrospective analysis of 527, 228 patients. Ann Emerg Med 46 5 (2005) 445-455
22. Beitel A.J., Olson K.L., Reis B.Y., and Mandl K.D. Use of emergency department chief complaint and diagnostic codes for identifying respiratory illness in a pediatric population. Pediatr Emerg Care 20 6 (2004) 355-360
23. Talotta, Cochrane D, Allegra J. Chief complaint based quality indicators: the challenge for automation posed by chief complaint variability (abstract). Ann Emerg Med 2005;46:S40.
24. Shapiro A.R. Taming variability in free-text: application to health surveillance. MMWR Morb Mortal Wkly Rep 53 Suppl (2004) 95-100
25. Terry W, Ostrowsky B, Huang A. Should we be worried? Investigation of signals generated by an electronic syndromic surveillance system--Westchester County, New York. MMWR Morb Mortal Wkly Rep. 2004 Sep 24;53 Suppl:190-5.
26. Halász S, Brown P, Oktay C, et al. Talking Turkish: using n-grams for syndromic surveillance in a Turkish emergency department without the need for English translation. (abstract) Acad Emerg Med 2006:13:S115.
27. Guidelines for evaluating surveillance systems. MMWR Morb Mortal Wkly Rep 1988;37(Suppl 5):1-18.
28. Travers D.A., Waller A., Haas S.W., Lober W.B., and Beard C. Emergency department data for bioterrorism surveillance: electronic data availability, timeliness, sources and standards. AMIA Annu Symp Proc (2003) 664-668
29. Lober W.B., Karras B.T., Wagner M.M., Overhage J.M., Davidson A.J., and Fraser H. Roundtable on bioterrorism detection: information system-based surveillance. J Am Med Inform Assoc 9 2 (2002) 105-115
30. Ising A.I., Travers D.A., MacFarquhar J., Kipp A., and Waller A.E. Triage note in emergency department-based syndromic surveillance. Adv Dis Surv 1 (2006) 34
31. Stone L., Olinky R., and Huppert A. Seasonal dynamics of recurrent epidemics. Nature 446 7135 (2007) 533-536
32. Betancourt J.A., Hakre S., Polyak C.S., and Pavlin J.A. Evaluation of ICD-9 codes for syndromic surveillance in the electronic surveillance system for the early notification of community-based epidemics. Mil Med 172 4 (2007) 346-352
33. Levy R.S., Cochrane D.G., and Allegra J.R. Analysis of interhospital variability in the sensitivity of a gastrointestinal chief complaint syndromic surveillance method. Acad Emerg Med 12 (2005) 26
34. Halász S, Brown P, Goodall C, Cochrane DG, Allegra J. The ngram classifier: a novel method of automatically creating cc classifiers based on ICD9 groupings (abstract). Adv Dis Sur 2006:1-30.