Domain adaptation for semantic role labeling of clinical text

Journal of the American Medical Informatics Association

Volumn 22, Issue 5, 2015, Pages 967-979

  Zhang, Yaoyun ^a   Tang, Buzhou ^a,b   Jiang, Min ^a   Wang, Jingqi ^a   Xu, Hua ^a  

^a UNIVERSITY OF TEXAS   (United States)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Clinical natural language processing; Domain adaptation; Semantic role labeling; Shallow semantic parsing; Transfer learning

Indexed keywords

LEARNING CURVE; SAMPLE SIZE; VALIDATION PROCESS; ALGORITHM; INFORMATION PROCESSING; NATURAL LANGUAGE PROCESSING; SEMANTICS;

ALGORITHMS; DATASETS AS TOPIC; NATURAL LANGUAGE PROCESSING; SEMANTICS;

EID: 84953345206     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1093/jamia/ocu048     Document Type: Article

References (63)

1. Pradhan SS, Ward WH, Hacioglu K, et al. Shallow semantic parsing using support vector machines. In: Proceedings of Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics. Boston, Massachusetts, USA: Association for Computational Linguistics July 21-26, 2004:233-240.
2. Allen J. Natural Language Understanding. 2nd ed. Menlo Park, CA: Benjamin/Cummings 1995.
3. Surdeanu M, Harabagiu S, Williams J, et al. Using predicate-argument structures for information extraction. In: Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. Sapporo, Japan: Association for Computational Linguistics July 7-12, 2003:8-15.
4. Akane Y, Yusuke M, Tomoko O, et al. Automatic construction of predicateargument structure patterns for biomedical information extraction. In: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing. Seattle, Washington, USA: Association for Computational Linguistics July 22-23, 2006:284-292.
5. Yakushiji A, Miyao Y, Tateisi Y, et al. Biomedical information extraction with predicate-argument structure patterns. In: Proceedings of the First International Symposium on Semantic Mining in Biomedicine. Hinxton, Cambridge, UK: European Bioinformatics Institute April 10-13, 2005:60-69.
6. Nguyen NTH, Miwa M, Tsuruoka Y, et al. Open information extraction from biomedical literature using predicate-argument structure patterns. In: Proceedings of the 5th International Symposium on Languages in Biology and Medicine. Zurich, Switzerland December 12-13, 2013.
7. Wattarujeekrit T, Shah PK, Collier N. PASBio: predicate-argument structures for event extraction in molecular biology. BMC Bioinformatics 2004;5(1): 155.
8. Kogan Y, Collier N, Pakhomov S, et al. Towards semantic role labeling & IE in the medical literature. AMIA Symposium October 22-26, 2005:410-414.
9. Shah PK, Bork P. LSAT: learning about alternative transcripts in MEDLINE. Bioinformatics 2006;22(7):857-865.
10. Bethard S, Lu Z, Martin JH, et al. Semantic role labeling for protein transport predicates. BMC Bioinformatics 2008;9:277.
11. Barnickel T, Weston J, Collobert R, et al. Large scale application of neural network based semantic role labeling for automated relation extraction from biomedical texts. PloS One 2009;4(7):e6393.
12. Paek H, Kogan Y, Thomas P, et al. Shallow semantic parsing of randomized controlled trial reports. AMIA Symposium November 11-15, 2006:604-608.
13. Albright D, Lanfranchi A, Fredriksen A, et al. Towards comprehensive syntactic and semantic annotations of the clinical narrative. J Am Med Inform Assoc. 2013;20(5):922-930.
14. Wang Y, Pakhomov S, Melton GB. Predicate argument structure frames for modeling information in operative notes. Stud Health Technol Inform. 2013; 192:783-787.
15. Meyers A, Reeves R, Macleod C, et al. Annotating noun argument structure for NomBank. In: Proceedings of the Language Resources and Evaluation Conference. Lisbon, Portugal: European Language Resources Association May 26-28, 2004:803-806.
16. Meyers A, Reeves R, Macleod C, et al. The NomBank Project: an interim peport. In: Proceedings of the HLT-NAACL 2004 Workshop: Frontiers in Corpus Annotation. Boston, Massachusetts, USA: Association for Computational Linguistics May 6, 2004:24-31.
17. Tsai RT-H, Chou W-C, Su Y-S, et al. BIOSMILE: a semantic role labeling system for biomedical verbs using a maximum-entropy model with automatically generated template features. BMC Bioinformatics 2007;8:325.
18. Palmer M, Gildea D, Kingsbury P. The proposition bank: an annotated corpus of semantic roles. Comput Linguist. 2005;31(1):71-106.
19. Rindflesch TC, Fiszman M. The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text. J Biomed Inform. 2003;36(6):462-477.
20. Kilicoglu H, Shin D, Fiszman M, et al. SemMedDB: a PubMed-scale repository of biomedical semantic predications. Bioinformatics 2012;28(23): 3158-3160.
21. Sager N. Natural Language Information Processing. UK; Addison-Wesley, 1981.
22. Chen ES, Hripcsak G, Xu H, et al. Automated acquisition of disease-drug knowledge from biomedical and clinical documents: an initial study. J Am Med Inform Assoc. 2008;15(1):87-98.
23. Simpson MS, Demner-Fushman D. Biomedical text mining: a survey of recent progress. In: Aggarwal CC, Zhai C, eds. Mining Text Data. USA; Springer 2012:465-517.
24. Harris ZS, Harris Z. A Theory of Language and Information: a Mathematical Approach. Oxford: Clarendon Press 1991.
25. Friedman C, Kra P, Rzhetsky A. Two biomedical sublanguages: a description based on the theories of Zellig Harris. J Biomed Inform. 2002;35(4): 222-235.
26. Cohen KB, Palmer M, Hunter L. Nominalization and alternations in biomedical language. PLoS One 2008;3(9):e3158.
27. Xu H, Stenner SP, Doan S, et al. MedEx: a medication information extraction system for clinical narratives. J Am Med Inform Assoc. 2010;17(1):19-24.
28. Schuler KK. VerbNet: A Broad-Coverage, Comprehensive Verb Lexicon. ProQuest Paper AAI3179808, 2005.
29. Ruppenhofer J, Ellsworth M, Petruck MRL, et al. FrameNet II: extended theory and practice. http://framenet.icsi.berkeley.edu/Accessed 10 March 2014.
30. Levin B. English Verb Classes and Alternations: a Preliminary Investigation. Chicago, USA: University of Chicago Press 1993.
31. Gildea D, Jurafsky D. Automatic labeling of semantic roles. Comput Linguist. 2002;28(3):245-288.
32. Shen D, Lapata M. Using semantic roles to improve question answering. In: Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL). Prague, Czech Republic: Association for Computational Linguistics June 28-30, 2007:12-21.
33. McCord MC, Murdock JW, Boguraev BK. Deep parsing in Watson. IBM J Res Dev. 2012;56(3.4):3:1-3:15.
34. Carreras X, Márquez L. Introduction to the CoNLL-2005 shared task: semantic role labeling. In: Proceedings of the Ninth Conference on Computational Natural Language Learning (CoNLL-2005). Ann Arbor, Michigan: Association for Computational Linguistics June 29-30, 2005:152-164.
35. Surdeanu M, Johansson R, Meyers A, et al. The CoNLL-2008 shared task on joint parsing of syntactic and semantic dependencies. In: Proceedings of the Twelfth Conference on Computational Natural Language Learning. Stroudsburg, PA, USA: Association for Computational Linguistics August 16-17, 2008:159-177.
36. Xue N, Palmer M. Calibrating features for semantic role labeling. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. Barcelona, Spain: Association for Computational Linguistics July 25-26, 2004:88-94.
37. Merlo P, Musillo G. Semantic parsing for high-precision semantic role labelling. In: Proceedings of the Twelfth Conference on Computational Natural Language Learning. Stroudsburg, PA, USA: Association for Computational Linguistics August 16-17th, 2008:1-8.
38. Meza-Ruiz I, Riedel S. Jointly identifying predicates, arguments and senses using Markov logic. In: Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics May 31-June 5, 2009:155-163.
39. Pan SJ, Yang Q. A survey on transfer learning. IEEE T Knowl Data Eng. 2010;22(10):1345-1359.
40. Wang Y, Pakhomov S, Burkart NE, et al. A study of actions in operative notes. AMIA Symposium November 3-7, 2012:1431-1440.
41. Jiang J. Multi-task transfer learning for weakly-supervised relation extraction. In: Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP August 2-7, 2009:1012-1020.
42. Titov I, Klementiev A. Crosslingual induction of semantic roles. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics July 8-14, 2012:647-656.
43. Li Q. Literature Survey: Domain Adaptation Algorithms for Natural Language Processing. Technique Report. USA; The City University of New York 2012.
44. Xu Q, Yang Q. A survey of transfer and multitask learning in bioinformatics. J Comput Sci Eng. 2011;5(3):257-268.
45. Dahlmeier D, Ng HT. Domain adaptation for semantic role labeling in the biomedical domain. Bioinformatics 2010;26(8):1098-1104.
46. Ferraro JP, Daumér H, Duvall SL, et al. Improving performance of natural language processing part-of-speech tagging on clinical narratives through domain adaptation. J Am Med Inform Assoc. 2013;20(5):931-939.
47. Laippala V, Viljanen T, Airola A, et al. Statistical parsing of varieties of clinical Finnish. Artif Intell Med. 2014;61(3)131-136.
48. Savova GK, Coden AR, Sominsky IL, et al. Word sense disambiguation across two domains: biomedical literature and clinical notes. J Biomed Inform. 2008;41(6):1088-1100.
49. Demner-Fushman D, Mork JG, Shooshan SE, et al. UMLS content views appropriate for NLP processing of the biomedical literature vs. clinical text. J Biomed Inform. 2010;43(4):587-594.
50. Johansson R, Nugues P. Dependency-based syntactic-semantic analysis with PropBank and NomBank. In: Proceedings of the Twelfth Conference on Computational Natural Language Learning. Manchester, UK August 16-17, 2008:183-187.
51. Kim JD, Ohta T, Tateisi Y, et al. GENIA corpus-semantically annotated corpus for bio-textmining. Bioinformatics 2003;19 (Suppl 1):i180-i182.
52. Jiang J, Zhai C. Instance weighting for domain adaptation in NLP. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics. Prague, Czech Republic: Association for Computational Linguistics June 25-27, 2007:264-271.
53. McClosky D, Charniak E. Self-training for biomedical parsing. The 46th Annual Meeting of the Association of Computational Linguistics. Manchester, UK: Association for Computational Linguistics June 16-18, 2008:101-104.
54. Xu R, Xu J, Wang X. Instance level transfer learning for cross lingual opinion analysis. In: Proceedings of the Second Workshop on Computational Approaches to Subjectivity and Sentiment Analysis. Stroudsburg, PA, USA: Association for Computational Linguistics June 24, 2011:182-188.
55. Dai W., Yang Q., Xue G., et al. Boosting for transfer learning. In: Proceedings of the 24th International Conference on Machine Learning. Corvallis, OR, USA: ACM June 20-24, 2007:193-200.
56. Daume H III. Frustratingly easy domain adaptation. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics. Prague, Czech Republic: Association for Computational Linguistics June 25-27, 2007:256-263.
57. Pradhan S, Hacioglu K, Krugler V, et al. Support vector learning for semantic argument classification. J Mach Learn. 2005;60(1-3):11-39.
58. Fan R-E, Chang K-W, Hsieh C-J, et al. LIBLINEAR: a library for large linear classification. J Mach Learn Res. 2008;9:1871-1874.
59. Joachims T. Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the 10th European Conference on Machine Learning. London, UK: Springer-Verlag April 21-23, 1998:137-142.
60. Woolson RF. Wilcoxon signed-rank test. Wiley Encyclopedia of Clinical Trials. New York, NY, USA: JohnWiley & Sons 2007.
61. Punyakanok V, Roth D, Yih WT. The importance of syntactic parsing and inference in semantic role labeling. Comput Linguist. 2008;34(2):257-287.
62. Gao J, Fan W, Jiang J, et al. Knowledge transfer via multiple model local structure mapping. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Las Vegas, Nevada, USA: ACM August 24-27, 2008:283-291.
63. Ge L, Gao J, Ngo H, et al. On handling negative transfer and imbalanced distributions in multiple source transfer learning. SIAM Conference on Data Mining. Austin, Texas, USA: Society for Industrial and Applied Mathematics May 2-4, 2013.