Enhancing clinical concept extraction with distributional semantics

Journal of Biomedical Informatics

Volumn 45, Issue 1, 2012, Pages 129-140

  Jonnalagadda, Siddhartha ^a,b   Cohen, Trevor ^c   Wu, Stephen ^b   Gonzalez, Graciela ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b MAYO CLINIC   (United States)

^c UNIVERSITY OF TEXAS   (United States)

Author keywords

Clinical informatics; Distributional semantics; Information extraction; NER; NLP

Indexed keywords

BOOTSTRAP RESAMPLING; CLINICAL INFORMATICS; CLINICAL TRIAL; CONCEPT EXTRACTION; CONDITIONAL RANDOM FIELD; DICTIONARY MATCHING; DISCRIMINATIVE CLASSIFIERS; DISEASE PROGRESSION; ENABLING TECHNOLOGIES; EXTRACTING CONCEPT; F-SCORE; FEATURE WORDS; INFORMATION EXTRACTION; INTELLIGENT ANALYSIS; MEDLINE; NER; NLP; PART-OF-SPEECH TAGS; SEMANTIC FEATURES; SEMANTIC RELATEDNESS; SEQUENCE CLASSIFICATION; SEQUENCE LABELING; SLIDING WINDOW; SUPERVISED MACHINE LEARNING; TRAINING AND TESTING; TRAINING DATA; TRAINING SETS; UNANNOTATED TEXTS; VECTOR REPRESENTATIONS; VECTOR SPACE MODELS;

DIAGNOSIS; ENCODING (SYMBOLS); LEARNING SYSTEMS; MEDICAL PROBLEMS; PATTERN MATCHING; SEMANTICS; SOFTWARE AGENTS; VECTOR SPACES;

TEXT PROCESSING;

ARTICLE; AUTOMATION; BOOK; CLASSIFICATION; CONCEPT FORMATION; DOCUMENTATION; MACHINE LEARNING; MEDICAL INFORMATICS; MEDICAL LITERATURE; PRIORITY JOURNAL; SEMANTICS; THEORETICAL MODEL;

DATA MINING; DECISION SUPPORT SYSTEMS, CLINICAL; HUMANS; MEDLINE; NATURAL LANGUAGE PROCESSING; SEMANTICS; UNIFIED MEDICAL LANGUAGE SYSTEM;

EID: 84856376731     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2011.10.007     Document Type: Article

References (68)

1. Meystre S.M., Savova G.K., Kipper-Schuler K.C., Hurdle J.F. Extracting information from textual documents in the electronic health record: a review of recent research. Yearbook Med Informat 2008, 128-144.
2. Ando RK. BioCreative II gene mention tagging system at IBM Watson. In: Proceedings of the second biocreative challenge; 2007.
3. Liu C, Ng HT. Learning predictive structures for semantic role labeling of NomBank. In: Proceedings of the 45th annual meeting of the association of computational linguistics. Prague (Czech Republic): Association for Computational Linguistics; 2007. p. 208-15.
4. Kanerva P, Kristofersson J, Holst A. Random indexing of text samples for latent semantic analysis. In: Proceedings of the 22nd annual conference of the cognitive science society, Citeseer; 2000. p. 1036.
5. Rau LF, Res GE, Center D, Schenectady NY. Extracting company names from text. In: Seventh IEEE conference on artificial intelligence applications; 1991. p. 1.
6. Minka T. Discriminative models, not discriminative training. Microsoft Research (MSR-TR-2005-144); 2005.
7. Sutton C. McCallum A: an introduction to conditional random fields for relational learning. in introduction to statistical relational learning 2007, MIT Press, Cambridge, Massachusetts, USA.
8. Hirschman L, Grishman R, Sager N. From text to structured information: automatic processing of medical reports. In: Proceedings of the national computer conference and exposition. New York NY, (USA); 1976. p. 267.
9. Sager N. Sublanguage grammers in science information processing. J Am Soc Inform Sci 1975, 26:10-16.
10. Friedman C. Towards a comprehensive medical language processing system: methods and issues. In: AMIA; 1997.
11. Aronson AR. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: AMIA; 2001.
12. Meystre S., Haug P.J. Evaluation of medical problem extraction from electronic clinical documents using MetaMap Transfer (MMTx). Stud Health Technol Informat 2005, 116:823.
13. Zeng QT, Goryachev S, Weiss S, Sordo M, Murphy SN, Lazarus R. Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system, vol. 6. BMC Med Inform Decis Mak; 2006. p. 30.
14. Savova GK, Kipper-Schuler KC, Buntrock JD, Chute CG. UIMA-based clinical information extraction system. In: LREC; 2008.
15. Chuang J-H, Friedman C, Hripcsak G. A comparison of the Charlson comorbidities derived from medical language processing and administrative data. In: AMIA Symposium; 2002. p. 160-64.
16. Fiszman M, Chapman WW, Evans SR, Haug PJ. Automatic identification of pneumonia related concepts on chest X-ray reports. In AMIA; 1999. p. 67-71.
17. Haug P.J., Koehler S., Lau L.M., Wang P., Rocha R., Huff S.M. Experience with a mixed semantic/syntactic parser. Proc Annu Symp Comput Appl Med Care 1995, 284-288.
18. Haug P.J., Ranum D.L., Frederick P.R. Computerized extraction of coded findings from free-text radiologic reports. Work in progress. Radiology 1990, 174:543-548.
19. Meystre S., Haug P.J. Automation of a problem list using natural language processing. BMC Med Inform Decis Mak 2005, 5:30.
20. Meystre S., Haug P.J. Natural language processing to extract medical problems from electronic clinical documents: performance evaluation. J Biomed Inform 2006, 39:589-599.
21. Schadow G., McDonald C.J. Extracting structured information from free text pathology reports. AMIA Annu Symp Proc 2003, 584-588.
22. Taira R.K., Soderland S.G. A statistical natural language processor for medical reports. Proc AMIA Symp 1999, 970-974.
23. Wicentowski R., Sydes M.R. Using implicit information to identify smoking status in smoke-blind medical discharge summaries. J Am Med Inform Assoc 2008, 15:29-31.
24. Xu H., Friedman C. Facilitating research in pathology using natural language processing. AMIA Annu Symp Proc 2003, 1057.
25. Stanfill M.H., Williams M., Fenton S.H., Jenders R.A., Hersh W.R. A systematic literature review of automated clinical coding and classification systems. J Am Med Inform Assoc 2010, 17:646-651.
26. Cohen T., Widdows D. Empirical distributional semantics: methods and biomedical applications. J Biomed Informat 2009, 42:390-405.
27. Turian J, Opérationnelle R, Ratinov L, Bengio Y. Word representations: a simple and general method for semi-supervised learning. In: ACL, vol. 51; 2010. p. 61801.
28. Jonnalagadda S., Leaman R., Cohen T., Gonzalez G. A distributional semantics approach to simultaneous recognition of multiple classes of named entities. Comput Linguist Intellig Text Process (CICLing). 2010, 6008/2010.
29. Trefethen LN, Bau D. Numerical linear algebra. Society for industrial mathematics; 1997.
30. Turney P.D., Pantel P. From frequency to meaning: vector space models of semantics. J Artif Intellig Res 2010, 37:141-188.
31. Salton G., Wong A., Yang C.S. A vector space model for automatic indexing. Commun ACM 1975, 18:613-620.
32. Deerwester S., Dumais S.T., Furnas G.W., Landauer T.K., Harshman R. Indexing by latent semantic indexing. J Am Soc Informat Sci 1990, 41:391-407.
33. Landauer T.K., Dumais S.T. A solution to Plato's problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychol Rev 1997, 104:211-240.
34. Schütze H. Word space. In: Advances in neural information processing systems 5 (NIPS conference); 1992. p. 895-902.
35. Lund K., Burgess C. Hyperspace analog to language (HAL): a general model of semantic representation. Lang Cognit Process 1996.
36. Lin D. Automatic retrieval and clustering of similar words. In: Proceedings of the 17th international conference on computational linguistics - Montreal, Quebec, Canada; 1998. p. 768-74.
37. Hofmann T. Unsupervised learning by probabilistic latent semantic analysis. Mach Learn 2001, 42:177-196.
38. Turney P. Mining the web for synonyms: PMI-IR versus LSA on TOEFL. In: Proceedings of the twelfth European conference on machine learning; 2001.
39. Karlgren J., Sahlgren M. From words to understanding. Found Real-world Intellig 2001, 294-308.
40. Kanerva P, Kristoferson J, Holst A. Random indexing of text samples for latent semantic analysis. In: Proceedings of the 22nd annual conference of the cognitive science society; 2000. p. 1036.
41. Blei D.M., Ng A.Y., Jordan M.I. Latent Dirichlet allocation. J Mach Learn Res 2003, 3:993-1022.
42. Padó S., Lapata M. Dependency-based construction of semantic space models. Comput Linguist 2007, 33:161-199.
43. Johnson W.B., Lindenstrauss J. Extensions of Lipschitz mappings into a Hilbert space. Contemp Math 1984, 189-206.
44. Mika S, Ratsch G, Weston J, Scholkopf B, Mullers KR. Fisher discriminant analysis with kernels. In: Neural networks for signal processing IX: proceedings of the 1999 IEEE signal processing society workshop (Cat. No. 98TH8468). Madison, WI, USA. p. 41-8.
45. Sahlgren M, Holst A, Kanerva P. Permutations as a means to encode order in word space. In: Proceedings of the 30th annual meeting of the cognitive science society; 2008. p. 23-6.
46. Rapp R. The computation of word associations: comparing syntagmatic and paradigmatic approaches. In: Proceedings of the 19th international conference on computational linguistics, vol. 1. Association for computational linguistics; 2002. p. 7.
47. Saussure F, Bally C, Sechehaye A, Riedlinger A, Calvet LJ, Mauro TD. Cours de linguistique générale. Payot, Paris; 1922.
48. Sahlgren M. The word-space model; 2006.
49. Jones M.N., Mewhort D.J.K. Representing word meaning and order information in a composite holographic lexicon. Psychol Rev 2007, 114:1-37.
50. Plate TA. Holographic reduced representations. In: Neural networks, IEEE transactions on 2002, vol. 6. p. 623-641.
51. De Vine L, Bruza P. Semantic oscillations: encoding context and structure in complex valued holographic vectors. In: 2010 AAAI fall symposium series; 2010.
52. Harris Z. A theory of language and information: a mathematical approach 1991, Clarendon Press, Oxford (England).
53. Friedman C., Kra P., Rzhetsky A. Two biomedical sublanguages: a description based on the theories of Zellig Harris. J Biomed Informat 2002, 35:222-235.
54. Widdows D, Cohen T. The Semantic vectors package: new algorithms and public tools for distributional semantics. In: Fourth IEEE international conference on semantic computing, vol. 1. 2010. p. 43.
55. Widdows D, Ferraro K. Semantic vectors: a scalable open source package and online technology management application. In: Sixth international conference on language resources and evaluation; 2008.
56. Leaman R, Gonzalez G. BANNER: an executable survey of advances in biomedical named entity recognition. In: Pacific symposium in bioinformatics; 2008.
57. MALLET: a machine learning for language toolkit http://mallet.cs.umass.edu.
58. Uzuner O., South B.R., Shen S., Duvall S.L. 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text. J Am Med Inform Assoc 2011.
59. Apache Lucene http://lucene.apache.org.
60. Noreen E.W. Computer-intensive methods for testing hypotheses: an introduction 1989, John Wiley & Sons, Inc., New York.
61. Wilbur J, Smith L, Tanabe T. BioCreative 2 gene mention task. In: Proceedings of the second biocreative challenge workshop; 2007. p. 7-16.
62. Tjong Kim Sang EF, De Meulder F. Introduction to the CoNLL-2003 shared task. In: Proceedings of the seventh conference on natural language learning. Edmonton, Canada; 2003. p. 142-47.
63. Jonnalagadda S. An effective approach to biomedical information extraction with limited training data. PhD Dissertation, Arizona State University; 2011.
64. Kabiljo R., Clegg A.B., Shepherd A.J. A realistic assessment of methods for extracting gene/protein interactions from free text. BMC Bioinformat 2009, 10:233.
65. Traugott E. Regularity in semantic change 2002, Cambridge University Press, Cambridge.
66. Jurgens D, Stevens K. Event detection in blogs using temporal random indexing. In: Proceedings of the workshop on events in emerging text types. Stroudsburg, PA (USA): Association for Computational Linguistics; 2009. p. 9-16.
67. Cohen T., Schvaneveldt R.W. The trajectory of scientific discovery: concept co-occurrence and converging semantic distance. Stud Health Technol Inform 2010, 160:661-665.
68. Lussier Y.A., Bodenreider O. Clinical ontologies for discovery applications. Semantic web 2007, 101-119. Springer. C.J.O. Baker, K.-H. Cheung (Eds.).