Analysis of named entity recognition and linking for tweets

Information Processing and Management

Volumn 51, Issue 2, 2015, Pages 32-49

  Derczynski, Leon ^a   Maynard, Diana ^a   Rizzo, Giuseppe ^b,d   Van Erp, Marieke ^c   Gorrell, Genevieve ^a   Troncy, Raphaël ^b   Petrak, Johann ^a   Bontcheva, Kalina ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b EURECOM   (France)

^c VU UNIVERSITY AMSTERDAM   (Netherlands)

^d UNIVERSITY OF TURIN   (Italy)

Author keywords

Entity disambiguation; Information extraction; Microblogs; Named entity recognition; Twitter

Indexed keywords

COMPUTATIONAL LINGUISTICS; DATA MINING; INFORMATION ANALYSIS; INFORMATION RETRIEVAL; SOCIAL NETWORKING (ONLINE); SPEECH RECOGNITION;

ENTITY DISAMBIGUATION; INTELLIGENT INFORMATION; LANGUAGE IDENTIFICATION; MICROBLOGS; NAMED ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; PART OF SPEECH TAGGING; TWITTER;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84911496552     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2014.10.006     Document Type: Article

References (59)

1. Abel, F.; Gao, Q.; Houben, G.; & Tao, K. (2011). Semantic enrichment of twitter posts for user. Profile construction on the social web. In Proceedings of 8th extended semantic web conference (ESWC'11).
2. D.E. Appelt An introduction to information extraction Artificial Intelligence Communications 12 3 1999 161 172
3. Basave, A. E. C.; Varga, A.; Rowe, M.; Stankovic, M.; & Dadzie, A. -S. (2013). Making sense of microposts (#MSM2013) concept extraction challenge. In Proceedings of the making sense of microposts (#MSM2013) concept extraction challenge.
4. L. Biewald Massive multiplayer human computation for fun, money, and survival Current trends in web engineering 2012 Springer 171 176
5. Bontcheva, K.; Derczynski, L.; & Roberts, I. (2014). Crowdsourcing named entity recognition and entity linking corpora. In: N. Ide, & J. Pustejovsky (Eds.), The handbook of linguistic annotation (in press).
6. Brickley, D.; & Miller, L. (2012). FOAF vocabulary specification 0.98. Namespace document 9.
7. Burman, A.; Jayapal, A.; Kannan, S.; Kavilikatta, M.; Alhelbawy, A.; Derczynski, L.; & et al. (2011). USFD at KBP 2011: Entity linking, slot filling and temporal bounding. In Proceedings of the text analysis conference (TAC'11).
8. Cardie, C. (1997). Empirical methods in information extraction. AI Magazine 18 (4).
9. S. Carter, W. Weerkamp, and E. Tsagkias Microblog language identification: Overcoming the limitations of short, unedited and idiomatic text Language Resources and Evaluation Journal 47 1 2013 195 215
10. Cavnar, W.; & Trenkle, J. (1994). N-gram-based text categorization. In Proceedings of the annual symposium on document analysis and information retrieval.
11. Cucerzan, S. (2007). Large-scale named entity disambiguation based on Wikipedia data. In Proceedings of the conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL'07).
12. Cunningham, H.; Maynard, D.; Bontcheva, K.; & Tablan, V. (2002). GATE: A framework and graphical development environment for robust NLP tools and applications. In Proceedings of the meeting of the association for computational linguistics.
13. Damljanovic, D.; & Bontcheva, K. (2012). Named entity disambiguation using linked data. In Proceedings of the 9th extended semantic web conference (ESWC'12).
14. Demartini, G.; Difallah, D. E.; & Cudré-Mauroux, P. (2012). ZenCrowd: Leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking. In Proceedings of the 21st conference on world wide web (WWW'12).
15. Derczynski, L.; & Bontcheva, K. (2014). Passive-aggressive sequence labeling with discriminative post-editing for recognising person entities in tweets. In Proceedings of the 14th conference of the European chapter of the association for computational linguistics (EACL'14) (Vol. 2, pp. 69-73).
16. Derczynski, L.; Maynard, D.; Aswani, N.; & Bontcheva, K. (2013). Microblog-genre noise and impact on semantic annotation accuracy. In Proceedings of the ACM conference on hypertext and social media (HT'13).
17. Derczynski, L.; Ritter, A.; Clark, S.; & Bontcheva, K. (2013). Twitter part-of-speech tagging for all: Overcoming sparse and noisy data. In Proceedings of the international conference recent advances in natural language processing (RANLP'13).
18. Derczynski, L.; Yang, B.; & Jensen, C. (2013). Towards context-aware search and analysis on social media data. In Proceedings of the 16th conference on extending database technology (EDBT'13).
19. Finin, T.; Murnane, W.; Karandikar, A.; Keller, N.; Martineau, & J.; Dredze, M. (2010). Annotating named entities in twitter data with crowdsourcing. In Proceedings of the NAACL HLT 2010 workshop on creating speech and language data with Amazon's Mechanical Turk.
20. Finkel, J.; Grenager, T.; & Manning, C. (2005). Incorporating non-local information into information. Extraction systems by gibbs sampling. In Proceedings of the 43rd annual meeting on association for computational linguistics (ACL'05).
21. K. Fort, G. Adda, and K.B. Cohen Amazon mechanical turk: Gold mine or coal mine? Computational Linguistics 37 2 2011 413 420
22. Fromreide, H.; Hovy, D.; & Søgaard, A. (2014). Crowdsourcing and annotating NER for twitter #drift. In Proceedings of the conference on language resources and evaluation (LREC'14).
23. A. Gangemi A comparison of knowledge extraction tools for the semantic web The semantic web: Semantics and big data 2013 Springer 351 366
24. Greenwood, M.; Aswani, N.; & Bontcheva, K. (2012). Reputation profiling with GATE. In CLEF 2012 labs and workshop notebook papers.
25. Grishman, R.; & Sundheim, B. (1996). Message understanding conference - 6: A brief history. In Proceedings of the 16th conference on computational linguistics (COLING'96), Copenhagen, Denmark.
26. Hakimov, S.; Oto, S. A.; & Dogdu, E. (2012). Named entity recognition and disambiguation using linked data and graph-based centrality scoring. In Proceedings of the 4th international workshop on semantic web information management.
27. Han, B.; & Baldwin, T. (2011). Lexical normalisation of short text messages: Makn sens a #twitter. In Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies (ACL-HLT'11).
28. Han, B.; Cook, P.; & Baldwin, T. (2012). Automatically constructing a normalisation dictionary for microblogs. In Proceedings of the conference on empirical methods in natural language processing (EMNLP'12).
29. Hepple, M. (2000). Independence and commitment: assumptions for rapid training and execution of rule-based POS taggers. In Proceedings of the 38th annual meeting on association for computational linguistics (ACL'00).
30. Hirschmann, L.; & Chinchor, N. (1997). MUC-7 coreference task definition. In Proceedings of MUC-7.
31. Liu, X.; Zhou, M.; Wei, F.; Fu, Z.; & Zhou, X. (2012). Joint inference of named entity recognition and normalisation for tweets. In Proceedings of the association for computational linguistics (ACL'12) (pp. 526-535).
32. Lösch, U.; & Müller, D. Mapping microblog posts to encyclopedia articles. Lecture Notes in Informatics 192(150).
33. Lui, M.; & Baldwin, T. (2012). langid.py: An off-the-shelf language identification tool. In Proceedings of the 50th annual meeting of the association for computational linguistics (ACL'12).
34. Magnani, M.; & Rossi, L. (2011). The ML-model for multi-layer social networks. In Proceedings of the conference on advances in social networks analysis and mining (SNAM'11).
35. M. Marcus, M. Marcinkiewicz, and B. Santorini Building a large annotated corpus of. English: The Penn Treebank Computational Linguistics 19 2 1993 313 330
36. Marrero, M.; Sanchez-Cuadrado, S.; Lara, J.; & Andreadakis, G. (2009). Evaluation of named entity extraction systems. Advances in Computational Linguistics, Research in Computing Science, 41.
37. M.M. Masud, Q. Chen, L. Khan, C. Aggarwal, J. Gao, and J. Han Addressing concept-evolution in concept-drifting data streams 2010 IEEE 10th international conference on data mining (ICDM) 2010 IEEE 929 934
38. Maynard, D.; Bontcheva, K.; & Rout, D. (2012). Challenges in developing opinion mining tools for social media. In Proceedings of the @NLP can u tag #usergeneratedcontent?! workshop at LREC'12.
39. Meij, E.; Weerkamp, W.; & de Rijke, M. (2012). Adding semantics to microblog posts. In Proceedings of the 5th international conference on web search and data mining (WSDM'12).
40. Mendes, P. N.; Passant, A.; Kapanipathi, P.; & Sheth, A. P. (2010). Linked open social signals. In Proceedings of the 2010 IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, WI-IAT '10.
41. Mendes, P.; Jakob, M.; García-Silva, A.; & Bizer, C. (2011). DBpedia spotlight: Shedding light on the web of documents. In Proceedings of the 7th international conference on semantic systems (I-SEMANTICS'11).
42. D. Nadeau, and S. Sekine A survey of named entity recognition and classification Lingvisticae Investigationes 30 1 2007 3 26
43. Preotiuc-Pietro, D.; Samangooei, S.; Cohn, T.; Gibbins, N.; & Niranjan, M. (2012). Trendminer: An architecture for real time analysis of social media text. In Proceedings of the workshop on real-time analysis and mining of social streams (RAMSS'12).
44. Rao, D.; McNamee, P.; & Dredze, M. (2013). Entity linking: Finding extracted entities in a knowledge base. In Multi-source, multi-lingual information extraction and summarization.
45. Ratinov, L.; & Roth, D. (2009). Design challenges and misconceptions in named entity recognition. In Proceedings of the thirteenth conference on computational natural language learning, CoNLL '09.
46. Ritter, A.; Clark, S.; Mausam, & Etzioni, O. (2011). Named entity recognition in tweets: An experimental study. In Proceedings of the conference on empirical methods in natural language processing (EMNLP'11).
47. Rizzo, G.; & Troncy, R. (2012). NERD: A framework for unifying named entity recognition and disambiguation extraction tools. In Proceedings of the 13th conference of the European chapter of the association for computational linguistics (EACL'12).
48. Roberts, A.; Gaizauskas, R.; Hepple, M.; & Guo, Y. (2008). Combining terminology resources and statistical methods for entity recognition: An evaluation. In Proceedings of the 6th conference on language resources and evaluation (LREC'08).
49. Rout, D.; Bontcheva, K.; & Hepple, M. (2013). Reliably evaluating summaries of twitter timelines. In Proceedings of the AAAI workshop on analyzing microtext.
50. Sabou, M.; Bontcheva, K.; & Scharl, A.; Crowdsourcing research opportunities: Lessons from natural language processing. In 12th International conference on knowledge management and knowledge technologies (I-KNOW).
51. Sabou, M.; Bontcheva, K.; Derczynski, L.; & Scharl, A. (2014). Corpus annotation through crowdsourcing: Towards best practice guidelines. In Proceedings of the 9th international conference on language resources and evaluation (LREC'14) (pp. 859-866).
52. Shen, W.; Wang, J.; Luo, P.; & Wang, M. (2012). LINDEN: Linking named entities with knowledge base via. semantic knowledge. In Proceedings of the 21st conference on world wide web (WWW'12).
53. Shuyo, N. (2010). Language detection library for java. < http://code.google.com/p/language-detection/ >.
54. Søgaard, A.; Johannsen, A.; Plank, B.; Hovy, D.; & Martinez, H. (2014). What's in a p-value in NLP? In Proceedings of the eighteenth conference on computational natural language learning (CONLL'14) (pp. 1-10).
55. R. Sproat, A. Black, S. Chen, S. Kumar, M. Ostendorf, and C. Richards Normalization of non-standard words Computer Speech & Language 15 3 2001 287 333
56. Tjong Kim Sang, E.; & De Meulder, F. (2003). Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. In Proceedings of the 7th conference on natural language learning (ACL'03).
57. Toutanova, K.; Klein, D.; Manning, C.; & Singer, Y. (2003). Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the conference of the North American chapter of the association for computational linguistics (NAACL'03).
58. van Erp, M.; Rizzo, G.; & Troncy, R. (2013). Learning with the web: Spotting named entities on the intersection of NERD and machine learning. In Proceedings of the 3rd workshop on making sense of microposts (#MSM2013).
59. Zheng, Z.; Si, X.; Li, F.; Chang, E.; & Zhu, X. (2013). Entity disambiguation with freebase. In Proceedings of the conference on web intelligence (WI-IAT'13).