Coreference resolution: An empirical study based on SemEval-2010 shared Task 1

Language Resources and Evaluation

Volumn 47, Issue 3, 2013, Pages 661-694

  Màrquez, Lluís ^a   Recasens, Marta ^b   Sapena, Emili ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b UNIVERSITY OF BARCELONA   (Spain)

Author keywords

Coreference resolution and evaluation; Discourse entities; Machine learning based NLP tools; NLP system analysis; SemEval 2010 (Task 1)

Indexed keywords

EID: 84883447787     PISSN: 1574020X     EISSN: 15728412     Source Type: Journal    
DOI: 10.1007/s10579-012-9194-z     Document Type: Article

References (51)

1. Abad, A., Bentivogli, L., Dagan, I., Giampiccolo, D., Mirkin, S., Pianta, E., et al. (2010). A resource for investigating the impact of anaphora and coreference on inference. In Proceedings of the 7th conference on language resources and evaluation (LREC 2010) (pp. 128-135). Valletta, Malta.
2. Azzam, S., Humphreys, K., and Gaizauskas, R. (1999). Using coreference chains for text summarization. In Proceedings of the ACL workshop on coreference and its applications (pp. 77-84). Baltimore, Maryland,
3. Bagga, A., and Baldwin, B. (1998). Algorithms for scoring coreference chains. In Proceedings of the linguistic coreference workshop at LREC 98 (pp. 563-566). Granada, Spain.
4. Bengtson, E., and Roth, D. (2008). Understanding the value of features for coreference resolution. In Proceedings of the conference on empirical methods in natural language processing (EMNLP 2008) (pp. 294-303). Honolulu, USA.
5. Cai, J., and Strube, M. (2010). Evaluation metrics for end-to-end coreference resolution systems. In Proceedings of the annual SIGdial meeting on discourse and dialogue (SIGDIAL 2010) (pp. 28-36). Tokyo, Japan.
6. Chambers, N., and Jurafsky, D. (2008). Unsupervised learning of narrative event chains. In Proceedings of the 46th annual meeting of the association for computational linguistics (ACL-HLT 2008) (pp. 789-797). Columbus, USA.
7. Civit, M., and Martí, M. A. (2005). Building Cast3LB: A Spanish treebank. Research on Language and Computation, 2(4), 549-574.
8. Daelemans, W., Buchholz, S., and Veenstra, J. (1999). Memory-based shallow parsing. In Proceedings of the conference on natural language learning (CoNLL 1999) (pp. 53-60). Bergen, Norway.
9. Daumé, H., and Marcu, D. (2005). A large-scale exploration of effective global features for a joint entity detection and tracking model. In Proceedings of human language technology conference and conference on empirical methods in natural language processing (HLT-EMNLP 2005) (pp. 97-104) Vancouver, Canada.
10. Denis, P., and Baldridge, J. (2009). Global joint models for coreference resolution and named entity classification. Procesamiento del Lenguaje Natural, 42, 87-96.
11. Doddington, G., Mitchell, A., Przybocki, M., Ramshaw, L., Strassel, S., and Weischedel, R. (2004). The automatic content extraction (ACE) program-tasks, data, and evaluation. In Proceedings of the 4th conference on language resources and evaluation (LREC 2004) (pp. 837-840). Lisbon, Portugal.
12. Finkel, J., and Manning, C. (2008). Enforcing transitivity in coreference resolution. In Proceedings of the 46th annual meeting of the association for computational linguistics (ACL-HLT 2008) (pp. 45-48). Columbus, USA.
13. Gerber, M., and Chai, J. Y. (2010). Beyond NomBank: A study of implicit arguments for nominal predicates. In Proceedings of the 48th annual meeting of the association for computational linguistics (ACL 2010) (pp. 1583-1592). Uppsala, Sweden.
14. Heim, I. (1983). File change semantics and the familiarity theory of definiteness. In R. BŠuerle, C. Schwarze, and A. von Stechow (Eds.), Meaning, use, and interpretation of language (pp. 164-189). Berlin, Germany: Mouton de Gruyter.
15. Hirschman, L., and Chinchor, N. (1997). MUC-7 coreference task definition-version 3.0. In Proceedings of the 7th message understanding conference (MUC-7), Fairfax, USA.
16. Hummel, R. A., and Zucker, S. W. (1987). On the foundations of relaxation labeling processes. In M. A. Fischler, and O. Firschein (Eds.), Readings in computer vision: Issues, problems, principles, and paradigms (pp. 585-605). San Francisco, USA: Morgan Kaufmann Publishers Inc.
17. Lundquist, L. (2007). Lexical anaphors in Danish and French. In M. Schwarz-Friesel, M. Consten, and M. Knees (Eds.), Anaphors in text: Cognitive, formal and applied approaches to anaphoric reference (pp. 25-32). Amsterdam, Netherlands: John Benjamins.
18. Luo, X. (2005). On coreference resolution performance metrics. In Proceedings of the joint conference on human language technology and empirical methods in natural language processing (HLT-EMNLP 2005 (pp. 37-48). Vancouver, Canada.
19. Luo, X., Ittycheriah, A., Jing, H., Kambhatla, N., and Roukos, S. (2004). A mention-synchronous coreference resolution algorithm based on the bell tree. In Proceedings of the 42th annual meeting of the association for computational linguistics (ACL 2004) (pp. 21-26). Barcelona, Spain.
20. McCarthy, J. F., and Lehnert, W. G. (1995). Using decision trees for coreference resolution. In Proceedings of the 1995 international joint conference on AI (IJCAI 1995) (pp. 1050-1055) Montreal, Canada.
21. Mirkin, S., Berant, J., Dagan, I., and Shnarch, E. (2010). Recognising entailment within discourse. In Proceedings of the 23rd international conference on computational linguistics (COLING 2010) (pp. 770-778). Beijing, China.
22. Morton, T. S. (1999). Using coreference in question answering. In Proceedings of the 8th Text REtrieval Conference (TREC-8) (pp. 85-89).
23. Ng, V. (2010). Supervised noun phrase coreference research: the first fifteen years. In Proceedings of the 48th annual meeting of the association for computational linguistics (ACL 2010) (pp. 1396-1411). Uppsala, Sweden.
24. Ng, V., and Cardie, C. (2002). Improving machine learning approaches to coreference resolution. In Proceedings of the 40th annual meeting of the association for computational linguistics (ACL 2002) (pp. 104-111). Philadelphia, USA.
25. Nicolov, N., Salvetti, F., and Ivanova, S. (2008). Sentiment analysis: Does coreference matter? In Proceedings of the symposium on affective language in human and machine (pp. 37-40). Aberdeen, UK.
26. Orasan, C., Cristea, D., Mitkov, R., and Branco, A. (2008). Anaphora resolution exercise: An overview. In Proceedings of the 6th conference on language resources and evaluation (LREC 2008) (pp. 28-30). Marrakech, Morocco.
27. Padró, L. (1998). A hybrid environment for syntax-semantic tagging. PhD thesis, Dep. Llenguatges i Sistemes Informaics. Barcelona, Spain: Universitat Politëcnica de Catalunya.
28. Poon, H., Christensen, J., Domingos, P., Etzioni, O., Hoffmann, R., Kiddon, C., et al. (2010). Machine reading at the University of Washington. In Proceedings of the NAACL-HLT first international workshop on formalisms and methodology for learning by reading (pp. 87-95). Los Angeles, USA.
29. Popescu, A., and Etzioni, O. (2005). Extracting product features and opinions from reviews. In Proceedings of the conference on human language technology and empirical methods in natural language processing (HLT-EMNLP 2005) (pp. 339-346). Vancouver, Canada.
30. Popescu-Belis, A., Robba, I., and Sabah, G. (1998). Reference resolution beyond coreference: a conceptual frame and its application. In: Proceedings of the 36th annual meeting of the association for computational linguistics joint with the international conference on computational linguistics (COLING-ACL 1998) (pp. 1046-1052). Montreal, Canada.
31. Pradhan, S., Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., and Weischedel, R. (2007). OntoNotes: A unified relational semantic representation. In Proceedings of the international conference on semantic computing (ICSC 2007) (pp. 517-526). Irvine, USA.
32. Pradhan, S., Ramshaw, L., Marcus, M., Palmer, M., Weischedel, R., and Xue, N. (2011). CoNLL-2011 shared task: Modeling unrestricted coreference in OntoNotes. In Proceedings of the conference on natural language learning (CoNLL 2011) (pp. 1-27). Shared Task, Portland, USA.
33. Quinlan, J. (1993). C4.5: Programs for machine learning. MA, USA: Morgan Kaufmann.
34. Rahman, A., and Ng, V. (2009). Supervised models for coreference resolution. In Proceedings of the conference on empirical methods in natural language processing (EMNLP 2009) (pp. 968-977). Suntec, Singapore.
35. Rand, W. M. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66(336), 846-850.
36. Recasens, M. (2010). Coreference: Theory, annotation, resolution and evaluation. PhD thesis, University of Barcelona, Barcelona, Spain.
37. Recasens, M., and Hovy, E. (2009). A deeper look into features for coreference resolution. In S. L. Devi, A. Branco, and R. Mitkov. (Eds.), Anaphora processing and applications (DAARC 2009) (Vol. 5847, pp. 29-42). Berlin, Germany, LNAI: Springer.
38. Recasens, M., and Hovy, E. (2011). BLANC: Implementing the rand index for coreference evaluation. Natural Language Engineering, 17(4), 485-510.
39. Recasens, M., and Martí, M. A. (2010). AnCora-CO: Coreferentially annotated corpora for Spanish and Catalan. Language Resources and Evaluation, 44(4), 315-345.
40. Recasens, M., Marquez, L., Sapena, E., Martí, M. A., Taulé, M., Hoste, V., et al. (2010). Semeval-2010 task 1: Coreference resolution in multiple languages. In Proceedings of the 5th international workshop on semantic evaluation (SemEval 2010) (pp. 1-8). Uppsala, Sweden.
41. Ruppenhofer, J., Sporleder, C., and Morante, R. (2010). SemEval-2010 Task 10: Linking events and their participants in discourse. In Proceedings of the 5th international workshop on semantic evaluation (SemEval 2010) (pp. 45-50). Uppsala, Sweden.
42. Sapena, E., Padró, L., and Turmo, J. (2010a). A global relaxation labeling approach to coreference resolution. In Proceedings of 23rd international conference on computational linguistics (COLING 2010) (pp. 1086-1094). Beijing, China.
43. Sapena, E., Padró, L., and Turmo, J. (2010b). Relaxcor: A global relaxation labeling approach to coreference resolution. In Proceedings of the ACL workshop on semantic evaluations (SemEval-2010) (pp. 88-91). Uppsala, Sweden.
44. Soon, W. M., Ng, H. T., and Lim, D. C. Y. (2001). A machine learning approach to coreference resolution of noun phrases. Computational Linguistics, 27(4), 521-544.
45. Steinberger, J., Poesio, M., Kabadjov, M. A., and Jeek, K. (2007). Two uses of anaphora resolution in summarization. Information Processing and Management: An International Journal, 43(6), 1663-1680.
46. Stoyanov, V., Gilbert, N., Cardie, C., and Riloff, E. (2009). Conundrums in noun phrase coreference resolution: Making sense of the state-of-the-art. In Proceedings of the 47th annual meeting of the association for computational linguistics and the 4th international joint conference on natural language processing (ACL-IJCNLP 2009) (pp. 656-664). Suntec, Singapore.
47. Stoyanov, V., Cardie, C., Gilbert, N., Riloff, E., Buttler, D., and Hysom, D. (2010). Coreference resolution with Reconcile. In Proceedings of the 48th annual meeting of the association for computational linguistics (ACL 2010) (pp. 156-161) Uppsala, Sweden.
48. Versley, Y., Ponzetto, S., Poesio, M., Eidelman, V., Jern, A., Smith, J., et al. (2008). BART: A modular toolkit for coreference resolution. In: Proceedings of the 6th conference on language resources and evaluation (LREC 2008) (pp. 962-965). Marrakech, Morocco.
49. Vicedo, J. L., and Ferrández, A. (2006). Coreference in QandA. In T. Strzalkowski and S. Harabagiu (Eds.), Advances in open domain question answering, text, speech and language technology (Vol. 32, pp. 71-96). Berlin, Germany: Springer.
50. Vilain, M., Burger, J., Aberdeen, J., Connolly, D., and Hirschman, L. (1995). A model-theoretic coreference scoring scheme. In Proceedings of the 6th message understanding conference (MUC-6) (pp. 45-52).
51. Wick, M., Culotta, A., Rohanimanesh, K., and McCallum, A. (2009). An entity based model for coreference resolution. In Proceedings of the SIAM data mining conference (SDM 2009) (pp. 365-376). Reno, USA.