Learning multiple distributed prototypes of semantic categories for named entity recognition

International Journal of Data Mining and Bioinformatics

Volumn 13, Issue 4, 2015, Pages 395-411

  Henriksson, Aron ^a  

^a STOCKHOLM UNIVERSITY   (Sweden)

Author keywords

De identification; Distributional semantics; Electronic health records; Named entity recognition; Random indexing; Semantic space ensembles

Indexed keywords

AUTOMATED PATTERN RECOGNITION; CONTROLLED VOCABULARY; DATA BASE; DATA MINING; ELECTRONIC MEDICAL RECORD; MACHINE LEARNING; NATURAL LANGUAGE PROCESSING; NOMENCLATURE; ORGANIZATION AND MANAGEMENT; PROCEDURES; SEMANTICS;

DATA MINING; DATABASE MANAGEMENT SYSTEMS; ELECTRONIC HEALTH RECORDS; MACHINE LEARNING; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; SEMANTICS; TERMINOLOGY AS TOPIC; VOCABULARY, CONTROLLED;

EID: 84946740793     PISSN: 17485673     EISSN: 17485681     Source Type: Journal    
DOI: 10.1504/IJDMB.2015.072766     Document Type: Article

References (39)

1. Allvin, H., Carlsson, E., Dalianis, H., Danielsson-Ojala, R., Daudaravicius, V., Hassel, M. et al. (2011) 'Characteristics of Finnish and Swedish intensive care nursing narratives: a comparative analysis to support the development of clinical language technologies', Journal of Biomedical Semantics, Vol. 2(S-3):S1.
2. Aronson, A.R. and Lang, F-M. (2010) 'An overview of metamap: historical perspective and recent advances', Journal of the American Medical Informatics Association, Vol. 17, No. 3, pp.229-236.
3. Baroni, M., Dinu, G. and Kruszewski, G. (2014) 'Don't count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors', Association for Computational Linguistics, Vol. 1, pp.238-247.
4. Cohen, T. and Widdows, D. (2009) 'Empirical distributional semantics: methods and ical applications', Journal of Biomedical Informatics, Vol. 42, No. 2, pp.390-405.
5. Dalianis, H. and Boström, H. (2012) 'Releasing a Swedish clinical corpus after removing all words - de-identification experiments with conditional random fields and random forests', Proceedings of BioTxtM 2012, pp.45-48.
6. Dalianis, H. and Velupillai, S. (2010) 'De-identifying Swedish clinical text refinement of a gold standard and experiments with conditional random fields', Journal of Biomedical Semantics, Vol. 1, No. 6.
7. Dalianis, H., Hassel, M. and Velupillai, S. (2009) 'The Stockholm EPR corpus - characteristics and some initial findings', Proceedings of the Symposium on Health Information Management Research.
8. Dalianis, H., Hassel, M., Henriksson, A. and Skeppstedt, M. (2012) 'Stockholm EPR corpus: a clinical database used to improve health care', Swedish Language Technology Conference.
9. De Bruijn, B., Cherry, C., Kiritchenko, S., Martin, J. and Zhu, X. (2011) 'Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010', Journal of the American Medical Informatics Association, Vol. 18, No. 5, pp.557-562.
10. Dietterich, T.G. (2000) 'Ensemble methods in machine learning', Multiple Classifier Systems, Springer, pp.1-15.
11. Friedman, C. (1997) 'Towards a comprehensive medical language processing system: methods and issues', Proceedings of the AMIA Annual Fall Symposium, American Medical Informatics Association, p.595.
12. Harris, Z.S. (1954) 'Distributional structure', Word.
13. Henriksson, A. (2013) Semantic spaces of clinical text: leveraging distributional semantics for natural language processing of electronic health records, Licentiate Thesis, Stockholm University.
14. Henriksson, A., Conway, M., Duneld, M. and Chapman, W. (2013) 'Identifying synonymy between SNOMED clinical terms of varying length using distributional analysis of electronic health records', AMIA Annual Symposium Proceedings, pp.600-609.
15. Henriksson, A., Dalianis, H. and Kowalski, S. (2014a) 'Generating features for named entity recognition by learning prototypes in semantic space: the case of de-identifying health records', IEEE International Conference on Bioinformatics and Biomedicine, 2-5 November, Belfast, UK, pp.450-457.
16. Henriksson, A., Moen, H., Skeppstedt, M., Daudaravicius, V. and Duneld, M. (2014b) 'Synonym extraction and abbreviation expansion with ensembles of semantic spaces', Journal of Biomedical Semantics, Vol. 5, No. 6.
17. Jonnalagadda, S., Cohen, T., Wu, S. and Gonzalez, G. (2012) 'Enhancing clinical concept extraction with distributional semantics', Journal of Biomedical Informatics, Vol. 45, No. 1, pp.129-140.
18. Kanerva, P., Kristofersson, J. and Holst, A. (2000) 'Random indexing of text samples for latent semantic analysis', Proceedings of the 22nd Annual Conference of the Cognitive Science Society, Vol. 1036.
19. Kendall, M.G. (1938) 'A new measure of rank correlation', Biometrika, pp.81-93.
20. Kudo, T. (2005) Crf++: Yet another crf toolkit. Software available online at: http://crfpp.sourceforge.net.
21. Lafferty, J., McCallum, A. and Pereira, F.C.N. (2001) 'Conditional random fields: probabilistic models for segmenting and labeling sequence data', Proceedings of the 18th International Conference on Machine Learning, pp.282-289.
22. Landauer, T.K. and Dumais, S.T. (1997) 'A solution to plato's problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge', Psychological Review, Vol. 104, No. 2, p.211.
23. Lapesa, G. and Evert, S. (2014) 'A large scale evaluation of distributional semantic models: parameters, interactions and model selection', Transactions of the Association for Computational Linguistics, Vol. 2, pp.531-545.
24. Lapesa, G., Evert, S. and Schulte, S. (2014) 'imWalde. Contrasting syntagmatic and paradigmatic relations: Insights from distributional semantic models', Proceedings of the Third Joint Conference on Lexical and Computational Semantics (∗ SEM 2014), pp.160-170.
25. Miller, S., Guinness, J. and Zamanian, A. (2004) 'Name tagging with word clusters and discriminative training', HLT-NAACL, Vol. 4, pp.337-342.
26. Pradhan, S., Elhadad, N., Chapman, W., Manandhar, S. and Savova, G. (2014) 'Semeval-2014 task 7: analysis of clinical text', SemEval 2014, Vol. 199, No. 99, p.54.
27. Pradhan, S., Elhadad, N., South, B.R., Martinez, D., Christensen, L., Vogel, A., Suominen, H., Chapman, W. and Savova, G. (2015) 'Evaluating the state of the art in disorder recognition and normalization of the clinical narrative', Journal of the American Medical Informatics Association, Vol. 22, No. 1, pp.143-154.
28. Sahlgren, M. (2006) The word-space model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces, PhD Thesis, Stockholm University.
29. Sahlgren, M., Holst, A. and Kanerva, P. (2008) 'Permutations as a means to encode order inword space', Proceedings of the 30th Annual Meeting of the Cognitive Science Society, pp.1300-1305.
30. Savova, G.K., Masanz, J.J., Ogren, P.V., Zheng, J., Sohn, S., Kipper-Schuler, K.C. and Chute. C.G. (2010) 'Mayo clinical text analysis and knowledge extraction system (ctakes): architecture, component evaluation and applications', Journal of the American Medical Informatics Association, Vol. 17, No. 5, pp.507-513.
31. Skeppstedt, M., Ahltorp, M. and Henriksson, A. (2013) 'Vocabulary expansion by semantic extraction of medical terms', Proceedings of the Symposium on Languages in Biology and Medicine (LBM).
32. Tang, B., Cao, H., Wu, Y., Jiang, M. and Xu, H. (2013) 'Recognizing clinical entities in hospital discharge summaries using structural support vector machines with word representation features', BMC Medical Informatics and Decision Making, Vol. 13(Suppl 1):S1.
33. Turian, J., Ratinov, L. and Bengio, Y. (2010) 'Word representations: a simple and general method for semi-supervised learning', Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, pp.384-394.
34. Turney, P.D. and Pantel, P. (2010) 'From frequency to meaning: vector space models of semantics', Journal of Artificial Intelligence Research, Vol. 37, No. 1, pp.141-188.
35. Uzuner, Ö., Solti, I. and Cadag, E. (2010) 'Extracting medication information from clinical text', Journal of the American Medical Informatics Association, Vol. 17, No. 5, pp.514-518.
36. Uzuner, Ö., South, B.R., Shen, S. and DuVall, S.L. (2011) '2010 i2b2/va challenge on concepts, assertions, and relations in clinical text', Journal of the American Medical Informatics Association, Vol. 18, No. 5, pp.552-556.
37. Velupillai, S., Dalianis, H., Hassel, M. and Nilsson, G.H. (2009) 'Developing a standard for de-identifying electronic patient records written in Swedish: precision, recall and F-measure in a manual and computerized annotation trial', International Journal of Medical Informatics, Vol. 78, No. 12, pp.e19-e26.
38. Webber, W., Moffat, A. and Zobel, J. (2010) 'A similarity measure for indefinite rankings', ACM Transactions on Information Systems, Vol. 28, No. 4, p.20.
39. Zhang, Y., Wang, J., Tang, B., Wu, Y., Jiang, M., Chen, Y. and Xu, H. (2014) 'Uth-ccb: a report for semeval 2014-task 7 analysis of clinical text', SemEval 2014, pp.802-806.