Coreference resolution: A review of general methodologies and applications in the clinical domain

Journal of Biomedical Informatics

Volumn 44, Issue 6, 2011, Pages 1113-1122

  Zheng, Jiaping ^a   Chapman, Wendy W ^b   Crowley, Rebecca S ^c   Savova, Guergana K ^a,d  

^a BOSTON CHILDREN S HOSPITAL   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF PITTSBURGH MEDICAL CENTER   (United States)

^d HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Coreference; EHR; NLP

Indexed keywords

COREFERENCE; COREFERENCE RESOLUTION; EHR; ELECTRONIC HEALTH RECORD; FREE TEXTS; GENERAL METHODOLOGIES; GENERAL PURPOSE; GOLD STANDARDS; INFORMATION EXTRACTION; LEXICAL RESOURCES; LINGUISTIC EXPRESSIONS; NATURAL LANGUAGES; NLP; ONTOLOGY DEVELOPMENT; REAL-WORLD ENTITIES; US GOVERNMENT;

HEALTH CARE;

ONTOLOGY;

ACCURACY; ELECTRONIC MEDICAL RECORD; GOLD STANDARD; GOVERNMENT; HEALTH CARE FACILITY; HUMAN; LINGUISTICS; MACHINE LEARNING; METHODOLOGY; NATURAL LANGUAGE PROCESSING; PRIORITY JOURNAL; PUBLICATION; RESEARCH; REVIEW; UNITED STATES;

ELECTRONIC HEALTH RECORDS; HUMANS; INFORMATION STORAGE AND RETRIEVAL; LINGUISTICS; MEDICAL INFORMATICS; NATURAL LANGUAGE PROCESSING;

EID: 84855976343     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2011.08.006     Document Type: Review

References (98)

1. Fiszman M, Haug Peter J, Frederick PR. Automatic extraction of PIOPED interpretations from ventilation/perfusion lung scan reports. In: Proc AMIA Symp; 1998. p. 860-4.
2. Xu H., Stenner S.P., Doan S., Johnson K.B., Waitman L.R., Denny J.C. Medex: a medication information extraction system for clinical narratives. J Am Med Inform Assoc 2010, 17(1):19-24. 10.1197/jamia.M3378.
3. Zeng Q.T., Goryachev S., Weiss S., Sordo M., Murphy S.N., Lazarus R. Extracting principal diagnosis, co-morbidity, and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak 2010, 6:30. 10.1186/1472-6947-6-30.
4. Li L, Chase HS, Patel CO, Friedman C, Weng C. Comparing ICD9-encoded diagnoses and NLP-processed discharge summaries for clinical trials pre-screening: a case study. In: Proceedings of the AMIA annual symposium 2008; 2008. p. 404-8.
5. Liao K.P., Cai T., Gainer V., Goryachev S., Zeng-Treitler Q., Raychaudhuri S., et al. Electronic medical records for discovery research in rheumatoid arthritis. Arthritis Care Res 2010, 62(8):1120-1127. 10.1002/acr.20184.
6. Kullo I.J., Fan J., Pathak J., Savova G.K., Ali Z., Chute C.G. Leveraging informatics for genetic studies: use of the electronic medical record to enable a genome-wide association study of peripheral arterial disease. J Am Med Inform Assoc 2010, 17(5):568-574. 10.1136/jamia.2010.004366.
7. Savova GK, Fan J, Ye Z, Murphy SP, Zheng J, Chute CG, et al. Discovering peripheral arterial disease cases from radiology notes using natural language processing. In: AMIA Annu Symp Proc; 2010. p. 722-6.
8. Garla V, Lo Re III V, Dorey-Stein Z, Kidwai F, Scotch M, Womack J, et al. The Yale cTAKES extensions for document classification: architecture and application. J Am Med Inform Assoc, in press. doi:10.1136/amiajnl-2011-000093.
9. Hirst G. Anaphora in natural language understanding: a survey. Lecture notes in computer science 1981, vol. 119. Springer-Verlag, Berlin Heidelberg.
10. Coreference task definition. In: Proceedings of the 6th message understanding conference; 1995. p. 333-44.
11. Hirschman L, Chinchor N. Coreference task definition. In: Proceedings of the 7th message understanding conference; 1997.
12. Mitkov R. Anaphora resolution: the state of the art; 1999. Based on the COLING'98/ACL'98 tutorial on anaphora resolution.
13. Ng V. Supervised noun phrase coreference research: the first fifteen years. In: Proceedings of the 48th annual meeting of the association for computational linguistics; 2010. p. 1396-411.
14. Coden A.R., Pakhomov S.V., Ando R.K., Duffy P.H., Chute C.G. Domain-specific language models and lexicons for tagging. J Biomed Inform 2005, 38(6):422-430. 10.1016/j.jbi.2005.02.009.
15. Meystre S.M., Savova G.K., Kipper-Schuler Karin C., Hurdle J.F. Extracting information from textual documents in the electronic health record: a review of recent research. IMIA Yearbook 2008: Access Health Inform 2008, 1:128-144.
16. Friedman C., Alderson P.O., Austin J.H.M., Cimino J.J., Johnson S.B. A general natural language text processor for clinical radiology. J Am Med Inform Assoc 1994, 1(2):161-174. 10.1136/jamia.1994.95236146.
17. Haug P, Koehler S, Lau LM, Wang P, Rocha R, Huff S. A natural language understanding system combining syntactic and semantic techniques. In: Proc Annu Symp Comput Appl Med Care; 1994. p. 247-51.
18. Fiszman M., Chapman W.W., Aronsky D., Evans R.S., Haug P.J. Automatic detection of acute bacterial pneumonia from chest X-ray reports. J Am Med Inform Assoc 2000, 7(6):593-604. 10.1136/jamia.2000.0070593.
19. Hahn U., Romacker M., Schulz S. medSynDiKATe-a natural language system for the extraction of medical information from findings reports. Int J Med Inform 2002, 67(1-3):63-74. 10.1016/S1386-5056(02)00053-9.
20. Friedman C. A broad-coverage natural language processing system. In: Proceedings of AMIA symposium; 2000. p. 270-4.
21. Goryachev S, Sordo M, Zeng QT. A suite of natural language processing tools developed for the i2b2 project. In: AMIA Annu Symp Proc; 2006. p. 931.
22. Savova G.K., Masanz J.J., Ogren P.V., Zheng J., Sohn S., Kipper-Schuler K.C., et al. Mayo clinical text analysis and knowledge extraction system (cTAKES): architecture, component evaluation and applications. J Am Med Inform Assoc 2010, 17(5):507-513. 10.1136/jamia.2009.001560.
23. Hahn U, Romacker M, Schulz S. medSynDiKATe-design considerations for an ontology-based medical text understanding system. In: Proc AMIA Symp; 2000. p. 330-4.
24. Savova G.K., Chapman W.W., Zheng J., Crowley R.S. Anaphoric relations in the clinical narrative: corpus creation. J Am Med Inform Assoc 2011, 18(4):459-465. 10.1136/amiajnl-2011-000108.
25. Coden A., Savova G.K., Sominsky I., Tanenblatt M., Masanz J.J., Schuler K., et al. Automatically extracting cancer disease characteristics from pathology reports into a cancer disease knowledge model. J Biomed Inform 2009, 42(5):937-949. 10.1016/j.jbi.2008.12.005.
26. International classification of diseases for oncology 2000, World Health Organization. 3rd ed. A. Fritz, C. Percy, A. Jack, K. Shanmugarathan, L. Sobin, D.M. Parkin (Eds.).
27. Roberts A., Gaizauskas R., Hepple M., Demetriou G., Guo Y., Roberts I., et al. Building a semantically annotated corpus of clinical text. J Biomed Inform 2009, 42(5):950-966. 10.1016/j.jbi.2008.12.013.
28. Sidner C.L. Focusing for interpretation of pronouns. Am J Comput Linguist 1981, 7(4):217-231.
29. Rich E., LuperFoy S. An architecture for anaphora resolution. Proceedings of the second conference on applied natural language processing 1988, 18-24. Association for Computational Linguistics, Austin (Texas, USA). 10.3115/974235.974239.
30. Hobbs J.R. Resolving pronoun references. Lingua 1978, 44(4):311-338. 10.1016/0024-3841(78)90006-2.
31. Lappin S., Leass H.J. An algorithm for pronominal anaphora resolution. Comput Linguist 1994, 20(4):535-562.
32. Kennedy C, Boguraev B. Anaphora for everyone: pronominal anaphora resolution without a parser. In: Proceedings of the 16th international conference on computational linguistics; 1996.
33. Castaño J, Zhang J, Pustejovsky J. Anaphora resolution in biomedical literature. In: Proceedings of the international symposium on reference resolution for NLP. Alicante, Spain; 2002.
34. McCarthy JF, Lehnert WG. Using decision trees for coreference resolution. In: Proceedings of the fourteenth international joint conference on artificial intelligence (IJCAI'95). Montreal, Quebec; 1995. p. 1050-5.
35. Soon W.M., Ng H.T., Lim D.C.Y. A machine learning approach to coreference resolution of noun phrases. Comput Linguist 2001, 27(4):521-544.
36. Ng V, Cardie C. Improving machine learning approaches to coreference resolution. In: Proceedings of the 40th annual meeting of the association for computational linguistics. Philadelphia (PA); 2002. p. 104-11. doi:10.3115/1073083.1073102.
37. Ng V, Cardie C. Combining sample selection and error-driven pruning for machine learning of coreference rules. In: Proceedings of the 2002 conference on empirical methods in natural language processing; 2002. p. 55-62.
38. Yang X, Zhou G, Su J, Tan CL. Coreference resolution using competition learning approach. In: Proceedings of the 41st annual meeting of the association for computational linguistics. Association for Computational Linguistics; 2003. p. 176-83, doi:10.3115/1075096.1075119.
39. Harabagiu SM, Bunescu R, Maiorano SJ. Text and knowledge mining for coreference resolution. In: Second meeting of the North American chapter of the association for computational linguistics. 2001. doi:10.3115/1073336.1073344.
40. Uryupina O. Linguistically motivated sample selection for coreference resolution. In: Proceedings of DAARC. Furnas, Portugal; 2004.
41. Luo X, Ittycheriah A, Jing H, Kambhatla N, Roukos S. A mention-synchronous coreference resolution algorithm based on the bell tree. In: Proceedings of the 42nd meeting of the association for computational linguistics (ACL'04). Barcelona, Spain; 2004. p. 135-42. doi:10.3115/1218955.1218973.
42. Ng V. Machine learning for coreference resolution: from local classification to global ranking. In: Proceedings of the 43rd annual meeting of the association for computational linguistics; 2005. p. 157-64.
43. Denis P, Baldridge J. Specialized models and ranking for coreference resolution. In: Proceedings of the 2008 conference on empirical methods in natural language processing. Honolulu (HI): Association for Computational Linguistics; 2008. p. 660-9.
44. Wagner R.A., Fischer M.J. The string-to-string correction problem. J ACM 1974, 21(1):168-173. 10.1145/321796.321811.
45. Denis P., Baldridge J. Joint determination of anaphoricity and coreference resolution using integer programming. Human language technologies 2007: the conference of the North American chapter of the association for computational linguistics; proceedings of the main conference 2007, 236-243. Association for Computational Linguistics, Rochester (New York).
46. Yang X, Su J, Tan CL. Kernel-based pronoun resolution with structured syntactic knowledge. In: Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the association for computational linguistics. Sydney, Australia; 2006. p. 41-8. doi:10.3115/1220175.1220181.
47. Miller G.A. WordNet: a lexical database for English. Commun ACM 1995, 38(11):39-41. 10.1145/219717.219748.
48. Ng V. Shallow semantics for coreference resolution. In: Proceedings of the 20th international joint conference on artifical intelligence. Hyderabad, India; 2007, p. 1689-94.
49. Bengtson E., Roth D. Understanding the value of features for coreference resolution. In: EMNLP 2008: proceedings of the conference on empirical methods in natural language processing. Honolulu, HI; 2008. p. 294-303.
50. Kehler A. Probabilistic coreference in information extraction. In: Proceedings of the second conference on empirical methods in natural language processing (EMNLP-97); 1997. p. 163-73.
51. Morton TS. Coreference for NLP applications. In: Proceedings of the 38th annual meeting of the association for computational linguistics; 2000. p. 173-80. doi:10.3115/1075218.1075241.
52. Culotta A., Wick M., McCallum A. First-order probabilistic models for coreference resolution. Human language technology conference of the North American chapter of the association of computational linguistics (HLT/NAACL) 2007, 81-88. Association for Computational Linguistics, Rochester (NY).
53. Uryupina O. Corry: a system for coreference resolution. In: Proceedings of the 5th international workshop on semantic evaluation; 2010. p. 100-3.
54. Ge N, Hale J, Charniak E. A statistical approach to anaphora resolution. In: Proceedings of the sixth workshop on very large corpora; 1998. p. 161-71.
55. McCallum A., Wellner B. Conditional models of identity uncertainty with application to noun coreference. Advances in neural information processing systems 2004, vol. 17:905-991. MIT Press, Cambridge (MA).
56. Ng V, Cardie C. Identifying anaphoric and non-anaphoric noun phrases to improve coreference resolution. In: Proceedings of the 19th international conference on computational linguistics; vol. 1. Taipei; 2002c. doi:10.3115/1072228.1072367.
57. Yang X, Su J, Zhou G, Tan CL. An NP-cluster based approach to coreference resolution. In: COLING '04: Proceedings of the 20th international conference on computational linguistics. Geneva (Switzerland); 2004. p. 226-32. doi:10.3115/1220355.1220388.
58. Kim J.D., Ohta T., Tateisi Y., Tsujii J. GENIA corpus-a semantically annotated corpus for bio-textmining. Bioinformatics 2003, 19(Suppl 1):i180-i182. 10.1093/bioinformatics/btg1023.
59. Yang X., Su J., Lang J., Tan C.L., Liu T., Li S. An entity-mention model for coreference resolution with inductive logic programming. Proceedings of ACL-08: HLT 2008, 843-851. Association for Computational Linguistics, Columbus (OH).
60. Nicolae C, Nicolae G. BestCut: a graph algorithm for coreference resolution. In: Proceedings of the 2006 conference on empirical methods in natural language processing. Sydney (Australia): Association for Computational Linguistics; 2006. p. 275-83.
61. Rahman A, Ng V. Supervised models for coreference resolution. In: Proceedings of the 2009 conference on empirical methods in natural language processing. Singapore; 2009. p. 968-77.
62. Finley T, Joachims T. Supervised clustering with support vector machines. In: International conference on machine learning (ICML). 2005. p. 217-24.
63. Bansal N., Blum A., Chawla S. Correlation clustering. Mach Learn 2004, 56(1-3):89-113. 10.1023/B:MACH.0000033116.57574.95.
64. Daumé III H, Marcu D. A large-scale exploration of effective global features for a joint entity detection and tracking model. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing. Vancouver (British Columbia, Canada): Association for Computational Linguistics; 2005. p. 97-104.
65. Daumé III H, Marcu D. Learning as search optimization: approximate large margin methods for structured prediction. In: International conference on machine learning (ICML). Bonn, Germany; 2005, p. 169-76. doi:10.1145/1102351.1102373.
66. Cohen WW. Fast effective rule induction. In: Proceedings of the 12th international conference on machine learning; 1995. p. 115-23.
67. Evans R. Applying machine learning toward an automatic classification of It. J Lit Linguist Comput 2001, 16(1):45-57. 10.1093/llc/16.1.45.
68. Bean DL, Riloff E. Corpus-based identification of non-anaphoric noun phrases. In: Proceedings of the 37th annual meeting of the association for computational linguistics. College Park (Maryland, USA): Association for Computational Linguistics; 1999. p. 373-80. doi:10.3115/1034678.1034737.
69. Ng V. Learning noun phrase anaphoricity to improve conference resolution: issues in representation and optimization. In: Proceedings of the 42nd meeting of the association for computational linguistics (ACL'04). Barcelona, Spain; 2004. p. 151-8. doi:10.3115/1218955.1218975.
70. Ariel M. Referring and accessibility. J Linguist 1988, 24(1):65-87. 10.1017/S0022226700011567.
71. Gundel J.K., Hedberg N., Zacharski R. Cognitive status and the form of referring expressions in discourse. Language 1993, 69(2):274-307.
72. Strube M, Rapp S, Müller C. The influence of minimum edit distance on reference resolution. In: Proceedings of the 2002 conference on empirical methods in natural language processing. Association for Computational Linguistics; 2002. p. 312-9. doi:10.3115/1118693.1118733.
73. Zelenko D, Aone C, Tibbetts J. Coreference resolution for information extraction. In: ACL 2004: workshop on reference resolution and its applications; 2004. p. 24-31.
74. Bergsma S, Lin D, Goebel R. Distributional identification of non-referential pronouns. In: Proceedings of ACL-08: HLT. Columbus (Ohio): Association for Computational Linguistics; 2008. p. 10-8.
75. Cardie C, Wagstaff K. Noun phrase coreference as clustering. In: Proceedings of the join SIGDAT conference on empirical methods in natural language processing and very large Corpora. 1999. p. 82-99.
76. Haghighi A, Klein D. Unsupervised coreference resolution in a nonparametric bayesian model. In: Proceedings of the 45th annual meeting of the association of computational linguistics. Prague, Czech Republic: Association for Computational Linguistics; 2007. p. 848-55.
77. Ng V. Unsupervised models for coreference resolution. In: Proceedings of the 2008 conference on empirical methods in natural language processing. Honolulu, Hawaii; 2008. p. 640-9.
78. Poon H, Domingos P. Joint unsupervised coreference resolution with Markov Logic. In: Proceedings of the 2008 conference on empirical methods in natural language processing. Honolulu (HI): Association for Computational Linguistics; 2008. p. 650-9.
79. Richardson M., Domingos P. Markov logic networks. Mach learn 2006, 62(1-2):107-136. 10.1007/s10994-006-5833-1.
80. Lowd D, Domingos P. Efficient weight learning for markov logic networks. In: Proceedings of the 11th European conference on principles and practices of knowledge discovery in databases (PKDD). 2007. p. 200-11.
81. Haghighi A, Klein D. Simple coreference resolution with rich syntactic and semantic features. In: Proceedings of the 2009 conference on empirical methods in natural language processing. Singapore: Association for Computational Linguistics; 2009. p. 1152-61.
82. Cherry C., Bergsma S. An expectation maximization approach to pronoun resolution. Proceedings of the ninth conference on computational natural language learning (CoNLL-2005) 2005, 88-95. Association for Computational Linguistics, Ann Arbor (Michigan).
83. Charniak E, Elsner M. EM works for pronoun anaphora resolution. In: Proceedings of the 12th Conference of the European chapter of the ACL (EACL 2009). Athens, Greece: Association for Computational Linguistics; 2009. p. 148-56.
84. Vilain M., Burger J., Aberdeen J., Connolly D., Hirschman L. A model-theoretic coreference scoring scheme. In: MUC6'95: Proceedings of the 6th conference on message understanding. Morristown (NJ, USA): Association for Computational Linguistics; 1995. p. 45-52. doi:10.3115/1072399.1072405.
85. Bagga A, Baldwin B. Algorithms for scoring coreference chains. In: The first international conference on language resources and evaluation workshop on linguistics coreference; 1998.
86. Luo X. On coreference resolution performance metrics. In: Proceedings of the conference on human language technology and empirical methods in natural language processing. Vancouver (BC): Association for Computational Linguistics; 2005. p. 25-32. doi:10.3115/1220575.1220579.
87. Popescu-Belis A, Rigouste L, Salmon-Alt S, Romary L. Online evaluation of coreference resolution. In: Proceedings of 4th international conference on language resources and evaluation (LREC 2004). Lisbon, Portugal; 2004. p. 1507-10.
88. Carletta J. Assessing agreement on classification tasks: The kappa statistic. Comput Linguist 1996, 22(2):249-254.
89. Krippendorff K. Estimating the reliability, systematic error and random error of interval data. Educ Psychol Measur 1970, 30(1):61-70. 10.1177/001316447003000105.
90. Poesio M., Artstein R. The reliability of anaphoric annotation, reconsidered: taking ambiguity into account. Proceedings of the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky 2005, 76-83. Association for Computational Linguistics, Ann Arbor (MI).
91. Yang X, Su J. Coreference resolution using semantic relatedness information from automatically discovered patterns. In: Proceedings of the 45th annual meeting of the association of computational linguistics; 2007. p. 528-35.
92. Huang Z, Zeng G, Xu W, Celikyilmaz A. Accurate semantic class classifier for coreference resolution. In: Proceedings of the 2009 conference on empirical methods in natural language processing; 2009. p. 1232-40.
93. Segura-Bedmar I., Crespo M., Pablo-Sánchez C., Martínez P. Resolving anaphoras for the extraction of drug-drug interactions in pharmacological documents. BMC Bioinform 2010, 11(Suppl 2):S1. 10.1186/1471-2105-11-S2-S1.
94. Kim J.J., Park J.C. BioAR: anaphora resolution for relating protein names to proteome database entries. ACL 2004: Workshop on Reference Resolution and its Applications 2004, 79-86. Association for Computational Linguistics, Barcelona (Spain). S. Harabagiu, D. Farwell (Eds.).
95. Liang T., Lin Y.H. Anaphora resolution for biomedical literature by exploiting multiple resources. Lecture Notes in Artificial Intelligence 2005, Vol. 3651:742-753. Springer-Verlag. R. Dale, K.F. Wong, J. Su, O.Y. Kwong (Eds.).
96. Gasperin C. Semi-supervised anaphora resolution in biomedical texts. Proceedings of the HLT-NAACL BioNLP workshop on linking natural language and biology 2006, 96-103. Association for Computational Linguistics, New York (New York).
97. Su J, Yang X, Hong H, Tateisi Y, Tsujii J. Coreference resolution in biomedical texts: a machine learning approach. In: Ashburner M, Leser U, Rebholz-Schuhmann D, editors. Ontologies and text mining for life sciences: current status and future perspectives. No. 08131 in Dagstuhl seminar proceedings. Dagstuhl (Germany): Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany; 2008.
98. Gasperin C, Briscoe T. Statistical anaphora resolution in biomedical texts. In: Proceedings of the 22nd international conference on computational linguistics (Coling 2008). Manchester (UK): Coling 2008 Organizing Committee; 2008. p. 257-64.