Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): Architecture, component evaluation and applications

Journal of the American Medical Informatics Association

Volumn 17, Issue 5, 2010, Pages 507-513

  Savova, Guergana K ^a   Masanz, James J ^a   Ogren, Philip V ^b   Zheng, Jiaping ^a   Sohn, Sunghwan ^a   Kipper Schuler, Karin C ^a   Chute, Christopher G ^a  

^a MAYO CLINIC   (United States)

^b The University of Colorado Denver   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARCHITECTURE; ARTICLE; CLINICAL EVALUATION; CLINICAL TEXT ANALYSIS AND KNOWLEDGE EXTRACTION SYSTEM; CONCEPT MAPPING; ELECTRONIC MEDICAL RECORD; GOLD STANDARD; NATURAL LANGUAGE PROCESSING; EVALUATION; INFORMATION RETRIEVAL; MEDICAL RECORD; MEDICAL RESEARCH; METHODOLOGY;

BIOMEDICAL RESEARCH; ELECTRONIC HEALTH RECORDS; INFORMATION STORAGE AND RETRIEVAL; NATURAL LANGUAGE PROCESSING;

EID: 78149490620     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1136/jamia.2009.001560     Document Type: Article

References (77)

1. Hornberger J. Electronic health records: a guide for clinicians and administrators. Book and media review. JAMA 2009;(301):110.
2. Meystre SM, Savova GK, Kipper-Schuler KC, et al. Extracting information from textual documents in the electronic health record: a review of recent research. IMIA Year book of Medical Informatics 2008;47(Suppl 1):128-44.
3. Friedman C. Towards a comprehensive medical language processing system: methods and issues. Proc AMIA Annu Fall Symp 1997:595-9.
4. Friedman C. A broad-coverage natural language processing system. Proc AMIA Symp 2000:270-4.
5. Hripcsak G, Kuperman G, Friedman C. Extracting findings from narrative reports: software transferability and sources of physician disagreement. Methods Inf Med 1998;37:1-7.
6. Health Information Text Extraction (HITEx). https://www.i2b2.org/ software/projects/hitex/hitex-manual.html.
7. Zeng Q, Goryachev S, Weiss S, et al. Extracting principal diagnosis, comorbidity, and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak 2006;6:30.
8. HiTEXT. https://www.i2b2.org/.
9. Mack R, Mukherjea S, Soffer A, et al. Text analytics for life science using the unstructured information management architecture. IBM Syst J 2004;43:490-515.
10. Coden A, Savova G, Sominsky I, et al. Automatically extracting cancer disease characteristics from pathology reports into a cancer disease knowledge model. J Biomed Inform 2009;42:937-49.
11. Haug P, Koehler S, Lau L, et al. Experience with a mixed semantic/syntactic parser. Ann Symp Comp Appl Med Care 1995:284-8.
12. Christensen L, Haug P, Fiszman M. MPLUS: a probabilistic medical language understanding system. Proceedings of the ACL-02 workshop on Natural language processing in the biomedical domain - Volume 3 2002:29-36. Philadelphia, PA
13. Fiszman M, Haug P, Frederick P. Automatic extraction of PIOPED interpretations from ventilation/perfusion lung scan reports. Proc AMIA symp 1998:860-4.
14. Fiszman M, Chapman W, Aronsky D, et al. Automatic detection of acute bacterial pneumonia from chest X-ray reports. J Am Med Inform Assoc 2000:593-604.
15. Trick W, Chapman W, Wisniewski M, et al. Electronic interpretation of chest radiograph reports to detect central venous catheters. Infect Control Hosp Epidemiol 2003;24:950-4.
16. Aronson A, Bodenreider O, Chang H, et al. The NLM indexing initiative. Proc AMIA symp 2000:17-21.
17. Unified Medical Language System (UMLS). http://www.nlm.nih.gov/research/ umls/.
18. UIMA MetaMap wrapper. http://sourceforge.net/projects/metamap-uima/
19. National Center for Text Mining (NaCTeM). http://www.nactem.ac.uk/index. php.
20. JULIE Lab. http://www.julielab.de.
21. U-compare. http://u-compare.org/index.html.
22. Meystre S, Haug P. Evaluation of medical problem extraction from electronic clinical documents using MetaMap transfers (MMTx), in Connecting Medical Informatics and Bio-Informatics. In. Proceedings of MIE2005-The XIXth International Congress of the European Federation for Medical Informatics. IOS Press, 2005:823-8.
23. Cancer biomedical informatics grid (caBIG). https://cabig.nci.nih.gov/.
24. caTIES. https://cabig.nci.nih.gov/tools/caties.
25. Crowley R, Castine M, Mitchell K, et al. caTIES - a grid based system for coding and retrieval of surgical pathology reports and tissue specimens in support of translational research. J Am Med Inform Assoc 2010;17:253-64.
26. NCI Enterprise Vocabulary System (EVS). http://ncicb.nci.nih.gov/NCICB/ infrastructure/cacore-overview/vocabulary.
27. OpenNLP. http://opennlp.sourceforge.net/index.html.
28. Berger A, Della Pietra S, Della Pietra V. A maximum entropy approach to natural language processing. Computational Linguistics 1996;22:39-71.
29. Rosenfeld R. A maximum entropy approach to adaptive statistical language modeling. Computer, Speech and Language 1996;10:187-228.
30. Manning C, Schutze H. Foundations of statistical natural language processing Cambridge, Mass: MIT Press, 1999.
31. Sha R, Pereira F. Shallow parsing with conditional random fields. NLT-NAACL 2003:134-41.
32. Ratnaparkhi A. Maximum entropy models for natural language ambiguity resolution. PhD thesis, University of Pennsylvania, 1998.
33. Buyko E, Wermter J, Poprat M, et al. Automatically adapting an NLP core engine to the biology domain. ICBM 2006 65-68.
34. GENIA. 2009. http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/home/wiki.cgi? page=GENIA+Project.
35. PennBioIE. http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId= LDC2008T20.
36. Clinical Document Architecture (CDA). http://hl7book.net/index.php?title= CDA.
37. LVG. http://www.SPECIALIST.nlm.nih.gov.
38. LVG user guide. http://www.lexsrv3.nlm.nih.gov/SPECIALIST/Projects/lvg/ current/docs/userDoc/index.html.
39. Ogren P, Savova G, Chute C. Constructing evaluation corpora for automated clinical named entity recognition. Language Resources and Evaluation Conference, Proc LREC 2008:3143-50. http://www.lrec-conf.org/proceedings/ lrec2008/. Marrakesh, Morocco.
40. Snomed CT. http://www.nlm.nih.gov/research/umls/Snomed/snomed-main.html.
41. RxNORM. http://www.nlm.nih.gov/research/umls/rxnorm/.
42. Bodenreider O, McCray A. Exploring semantic groups through visual approaches. J Biomed Inform 2003;36:414-32.
43. Electronic Orange Book. http://www.fda.gov/drugs/informationondrugs/ ucm129689.htm.
44. Chapman W, Bridewell W, Hanbury P, et al. A simple algorithm for identifying negated findings and diseases in discharge summaries. J Biomed Inform 2001;34:301-10.
45. Open Health Natural Language Processing consortium (OHNLP). http://www.ohnlp.org.
46. UIMA. http://incubator.apache.org/uima/.
47. Ferrucci D, Lally A UIMA: an architectural approach to unstructured information processing in the corporate research environment. Nat Lang Eng 2004;10(3:4):327-48.
48. Baldwin D, Carrell D. Rapidly deployable, highly scalable natural language processing using cloud computing and an open source NLP pipeline. https://www.cabig-kc.nci.nih.gov/Vocab/uploaded-files/7/73/Rapid-Scalable-NLP- And-Cloud-Computing.doc (accessed 2010).
49. Cohen K, Fox L, Ogren P, et al. Empirical data on corpus design and usage in biomedical natural language processing. Proc AMIA Symp 2005:156-60.
50. Marcus M, Santorini B, Marcinkiewicz M. Building a large annotated corpus of English: the Penn treebank. Computational Linguistics 1994;19:313-30.
51. Hripcsak G, Rothschild A. Agreement, the F-Measure, and reliability in information retrieval. J Am Med Inform Assoc 2005;12:296-8.
52. Poesio M, Vieira R. A corpus-based investigation of definite description use. Computational Linguistics 1998;24:183-216.
53. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20:37-46.
54. Settles B. ABNER: an open source tool for automatically tagging genes, proteins, and other entity names in text. Bioinformatics 2005;21:3191-2.
55. Santorini B. Part-of-speech tagging guidelines for the Penn Treebank Project, Technical report number MS-CIS-90-47. Department of Computer and Information Science. University of Pennsylvania, 1990.
56. Bies A, Ferguson M, Katz K, et al. Bracketing guidelines for Treebank II Style Penn Treebank project. http://citeseerx.ist.psu.edu/viewdoc/summary?doi= 10.1.1.31.9795. Accessed 24 July 2010.
57. Coden A, Pakhomov S, Ando R, et al. Domain-specific language models and lexicons for tagging. J Biomed Inform 2005;38:422-30.
58. Liu K, Chapman W, Hwa R, et al. Heuristic sample selection to minimize reference standard training set for a part-of-speech tagger. J Amer Med Inform Assoc 2007;14:641-50.
59. Kipper-Schuler K, Kaggal V, Masanz J, et al. System evaluation on a named entity corpus from clinical notes. Language Resources and Evaluation Conference, LREC 2008:3001-3007. http://www.lrec-conf.org/proceedings/lrec2008/. Marrakesh, Morocco.
60. Li D, Schuler K, Savova G. A comparison between CRFs and SVMs in Disorder Named Entity Recognition in Clinic Texts. Intelligent Data Analysis in Biomedicine and Pharmacology (IDAMAP), 2008. A colloquium in conjunction with the American Medical Informatics Association Annual Symposium 2008 in Washington, DC, USA: 57-62.
61. Lafferty A, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In 8th international conference on machine learning (ICML-2001). 2001:282-9.
62. McCallum A, Li W. Early results for name entity recognition with conditional random fields, feature induction and web-enhanced Lexicons. ACM Trans Comput Log 2003:188-191.
63. Cortes C, Vapnik V. Support-vector networks. Mach Learn 1995;10:273-97.
64. Schuemie M, Kors J, Mons B. Word sense disambiguation in the biomedical domain: an overview. J Comput Biol 2005;12:554-65.
65. Savova G, Coden A, Sominsky I, et al. Word sense disambiguation across two domains: biomedical literature and clinical notes. J Biomed Inform 2008;41:1088-100.
66. eMERGE. https://www.mc.vanderbilt.edu/victr/dcc/projects/acc/index.php/ Main-Page.
67. PGRN. http://www.nigms.nih.gov/Initiatives/PGRN
68. Cheng L, Zheng J, Savova G, et al. Discerning tumor status from unstructured MRI reports - completeness of information in existing reports and utility of natural language processing. J Dig Imag Soc Imag Inform Med 2009;23(2):119-33.
69. Savova G, Ogren P, Duffy P, et al. Mayo clinic system for patient smoking status classification. J Am Med Inform Assoc 2008;15:25-8.
70. Sohn S, Savova G. Mayo clinic smoking status classification system. AMIA Annu Symp Proc 2009. San Francisco, CA. 619-23.
71. Savova G, Clark C, Zheng J, et al. The Mayo/MITRE system for discovery of obesity and its comorbidities. In. The Second i2b2 Workshop on Challenges in Natural Language Processing for Clinical Data. Washington, DC, 2008.
72. Uzuner Ö, Goldstein I, Luo Y, et al. Identifying patient smoking status from medical discharge records. J Am Med Inform Assoc 2008;15:14-24.
73. Uzuner Ö. Recognizing obesity and comorbidities in sparse data. J Am Med Inform Assoc 2009;16:561-70.
74. Savova G, Chapman W, Zheng J, et al. Annotation schema for anaphoric relations in the clinical domain. AMIA Annu Symp Proc;2009. San Francisco, CA.
75. Savova G, Bethard S, Styler W, et al. Towards temporal relation discovery from the clinical narrative. AMIA Annu Symp Proc;2009. San Francisco, CA. 568-72.
76. ODIE. Ontology development and information extraction (ODIE) toolset. http://www.bioontology.org/ODIE.
77. Health insurance portability and accountability act (HIPAA). http://www.hhs.gov/ocr/privacy/index.html.