Lessons learnt from the Named Entity rEcognition and Linking (NEEL) challenge series

Semantic Web

Volumn 8, Issue 5, 2017, Pages 667-700

  Rizzo, Giuseppe ^a   Pereira, Bianca ^b   Varga, Andrea ^c   Van Erp, Marieke ^d   Basave, Amparo Elizabeth Cano ^e  

^a ISTITUTO SUPERIORE MARIO BOELLA   (Italy)

^b Digital Enterprise Research Institute (DERI)   (Ireland)

^c Content Group ^*  (United Kingdom)

^d VU UNIVERSITY AMSTERDAM   (Netherlands)

^e Cube Global   (United Kingdom)

Author keywords

challenge; disambiguation; evaluation; knowledge base; Microposts; named entity linking; named entity recognition

Indexed keywords

EID: 85017367197     PISSN: 15700844     EISSN: 22104968     Source Type: Journal    
DOI: 10.3233/SW-170276     Document Type: Article

References (81)

1. F. Abel, I. Celik, G.-J. Houben and P. Siehndel, Leveraging the semantics of tweets for adaptive faceted search on Twitter, in: The Semantic Web-ISWC 2011-10th International Semantic Web Conference, Proceedings, Part I, Bonn, Germany, October 23-27, 2011, L. Aroyo, C. Welty, H. Alani, J. Taylor, A. Bernstein, L. Kagal, N.F. Noy and E. Blomqvist, eds, Lecture Notes in Computer Science, Vol. 7031, Springer, 2011, pp. 1-17. doi: 10.1007/978-3-642-25073-6-1.
2. F. Abel, Q. Gao, G.-J. Houben and K. Tao, Semantic enrichment of Twitter posts for user profile construction on the social web, in: The Semanic Web: Research and Applications-8th Extended Semantic Web Conference, ESWC 2011, Proceedings, Part II, Heraklion, Crete, Greece, May 29-June 2, 2011, G. Antoniou, M. Grobelnik, E.P.B. Simperl, B. Parsia, D. Plexousakis, P. De Leenheer and J.Z. Pan, eds, Lecture Notes in Computer Science, Vol. 6644, Springer, 2011, pp. 375-389. doi: 10.1007/978-3-642-21064-8-26.
3. M.A. Yosef, J. Hoffart, Y. Ibrahim, A. Boldyrev and G. Weikum, Adapting AIDA for tweets, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 68-69. http://ceur-ws.org/Vol-1141/paper-15.pdf.
4. T. Baldwin, M.-C. deMarneffe, B. Han, Y.-B. Kim, A. Ritter and W. Xu, Shared tasks of the 2015 workshop on noisy user-generated text: Twitter lexical normalization and named entity recognition, in: ACL 2015 Workshop on Noisy User-Generated Text, Proceedings of the Workshop, Beijing, China, July 31, 2015, ACL, 2015, pp. 126-135. http://www.aclweb.org/anthology/W15-4319. doi: 10.18653/v1/W15-4319.
5. R. Bansal, S. Panem, P. Radhakrishnan, M. Gupta and V. Varma, Linking entities in #microposts, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 71-72. http://ceur-ws.org/Vol-1141/paper-16.pdf.
6. H.B. Barathi Ganesh, N. Abinaya, M. Anand Kumar, R. Vinaykumar and K.P. Soman, AMRITA-CEN@NEEL: Identification and linking of Twitter entities, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 64-65. http://ceur-ws.org/Vol-1395/paper-20.pdf.
7. P. Basile, A. Caputo, A.L. Gentile and G. Rizzo, Overview of the EVALITA 2016 named entity rEcognition and linking in Italian Tweets (NEEL-IT) task, in: Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) & Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016), Napoli, Italy, December 5-7, 2016, P. Basile, A. Corazza, F. Cutugno, S. Montemagni, M. Nissim, V. Patti, G. Semeraro and R. Sprugnoli, eds, CEUR Workshop Proceedings, Vol. 1749, CEUR-WS.org, 2016. http://ceur-ws.org/Vol-1749/paper-007.pdf.
8. P. Basile, A. Caputo and G. Semeraro, An enhanced lesk word sense disambiguation algorithm through a distributional semantic model, in: COLING 2014, 25th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, Dublin, Ireland, August 23-29, 2014, J. Hajic and J. Tsujii, eds, ACL, 2014, pp. 1591-1600. http://aclweb.org/anthology/C/C14/C14-1151.pdf.
9. P. Basile, A. Caputo, G. Semeraro and F. Narducci, UNIBA: Exploiting a distributional semantic model for disambiguating and linking entities in tweets, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, p. 62. http://ceur-ws.org/Vol-1395/paper-15.pdf.
10. K. Bontcheva, L. Derczynski, A. Funk, M.A. Greenwood, D. Maynard and N. Aswani, TwitIE: An open-source information extraction pipeline for microblog text, in: Recent Advances in Natural Language Processing, RANLP 2013, Hissar, Bulgaria, 9-11 September, 2013, G. Angelova, K. Bontcheva and R. Mitkov, eds, RANLP 2013 Organising Committee/ACL, 2013, pp. 83-90. http://aclweb.org/anthology/R/R13/R13-1011.pdf.
11. S. Brin and L. Page, The anatomy of a large-scale hypertextual web search engine., Computer Networks 30 (1-7) (1998), 107-117. doi: 10.1016/S0169-7552(98)00110-X.
12. P.F. Brown, V.J. Della Pietra, P.V. deSouza, J.C. Lai and R.L. Mercer, Class-based n-gram models of natural language., Computational Linguistics 18 (4) (1992), 467-479.
13. R.C. Bunescu and M. Pasca, Using encyclopedic knowledge for named entity disambiguation, in: EACL 2006, 11st Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, Trento, Italy, April 3-7, 2006, D. McCarthy and S. Wintner, eds, ACL, 2006. http://aclweb.org/anthology/E/E06/E06-1002.pdf.
14. D. Caliano, E. Fersini, P. Manchanda, M. Palmonari and E. Messina, UniMiB: Entity linking in tweets using Jaro-Winkler distance, popularity and coherence, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April 11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E. Cano Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, 2016, pp. 70-72. http://ceur-ws.org/Vol-1691/paper-12.pdf.
15. A.E. Cano Basave, G. Rizzo, A. Varga, M. Rowe, M. Stankovic and A.-S. Dadzie, Making sense of microposts (#Microposts2014) named entity extraction & linking challenge, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 54-60. http://ceur-ws.org/Vol-1141/microposts2014-neel-challenge-report.pdf.
16. A.E. Cano Basave, A. Varga, M. Rowe, M. Stankovic and A.-S. Dadzie, Making sense of microposts (#MSM2013) concept extraction challenge, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 1-15. http://ceur-ws.org/Vol-1019/msm2013-challenge-report.pdf.
17. D. Carmel, M.-W. Chang, E. Gabrilovich, B.P. Hsu and K. Wang, ERD'14: Entity recognition and disambiguation challenge. SIGIR Forum 48 (2) (2014), 63-77. doi: 10.1145/2701583.2701591.
18. M. Chang and W. Yih, Dual coordinate descent algorithms for efficient large margin structured prediction., Transactions of the Association for Computational Linguistics 1 (2013), 207-218. https://tacl2013.cs.columbia.edu/ojs/index.php/tacl/article/view/120.
19. M.-W. Chang, B.-J.P. Hsu, H. Ma, R. Loynd and K. Wang, E2E: An end-to-end entity linking system for short and noisy text, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 62-63. http://ceur-ws.org/Vol-1141/paper-18.pdf.
20. N. Chinchor and P. Robinson, Muc-7 named entity task definition, in: Message Understanding Conference Proceedings, MUC-7, 1997. http://www-nlpir.nist.gov/related-projects/muc/proceedings/ne-task.html.
21. W.W. Cohen, P. Ravikumar and S.E. Fienberg, A comparison of string distance metrics for name-matching tasks, in: Proceedings of IJCAI-03 Workshop on Information Integration on the Web (IIWeb-03), Acapulco, Mexico, August 9-10, 2003, S. Kambhampati and C.A. Knoblock, eds, 2003, pp. 73-78. http://www.isi.edu/info-agents/workshops/ijcai03/papers/Cohen-p.pdf.
22. K. Cortis, ACE: A concept extraction approach using linked open data, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 31-35. http://ceur-ws.org/Vol-1019/paper-20.pdf.
23. S. Cucerzan, Large-scale named entity disambiguation based on Wikipedia data, in: EMNLP-CoNLL 2007, Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Prague, Czech Republic, June 28-30, 2007, J. Eisner, ed., ACL, 2007, pp. 708-716. http://www.aclweb.org/anthology/D07-1074.
24. H. Cunningham, D. Maynard, K. Bontcheva and V. Tablan, GATE: An architecture for development of robust HLT applications, in: ACL-02, 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, Pennsylvania, USA, 7-12 July, 2002, P. Isabelle, E. Charniak and D. Lin, eds, Proceedings of the Conference, ACL, pp. 168-175. doi: 10.3115/1073083.1073112.
25. H. Cunningham, D. Maynard, K. Bontcheva, V. Tablan, N. Aswani, I. Roberts, G. Gorrell, A. Funk, A. Roberts, D. Damljanovic, T. Heitz, M.A. Greenwood, H. Saggion, J. Petrak, Y. Li, W. Peters et al., Text Processing with GATE (Version 6), Gateway Press, 2011.
26. H. Cunningham, D. Maynard, K. Bontcheva, V. Tablan, N. Aswani, I. Roberts, G. Gorrell, A. Funk, A. Roberts, D. Damljanovic, T. Heitz, M.A. Greenwood, H. Saggion, J. Petrak, Y. Li, W. Peters, L. Derczynski et al., Developing language processing components with GATE version 8 (a user guide), Technical report, The University of Sheffield, 2017. https://gate.ac.uk/sale/tao/split.html.
27. D. Dahlmeier, N. Nandan and W. Ting, Part-of-speech is (almost) enough: SAP research & innovation at the #Microposts2014 NEEL challenge, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 73-74. http://ceur-ws.org/Vol-1141/paper-20.pdf.
28. A. Das, U. Burman, A.R. Balamurali and S. Bandyopadhyay, NER from tweets: SRI-JU system @MSM, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 13, CEUR-WS.org, 2013, p. 62. http://ceur-ws.org/Vol-1019/paper-33.pdf.
29. D.M. deOliveira, A.H.F. Laender, A. Veloso and A.S. daSilva, Filter-stream named entity recognition: A case study at the #MSM2013 concept extraction challenge, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 71-75. http://ceur-ws.org/Vol-1019/paper-34.pdf.
30. S. Dlugolinsky, P. Krammer, M. Ciglan and M. Laclavik, MSM2013 IE challenge: Annotowatch, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, CEUR-WS.org, Vol. 1019, 2013, pp. 21-26. http://ceur-ws.org/Vol-1019/paper-21.pdf.
31. P. Ferragina and U. Scaiella, TAGME: On-the-fly annotation of short text fragments (by Wikipedia entities), in: Proceedings of the 19th ACM Conference on Information and Knowledge Management, CIKM 2010, Toronto, Ontario, Canada, October 26-30, 2010, J. Huang, N. Koudas, G.J.F. Jones, X. Wu, K. Collins-Thompson and A. An, eds, ACM, 2010, pp. 1625-1628. doi: 10.1145/1871437.1871689.
32. J.R. Finkel, T. Grenager and C.D. Manning, Incorporating non-local information into information extraction systems by Gibbs sampling, in: ACL 2005, 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, University of Michigan, USA, 25-30 June, 2005, K. Knight, H.T. Ng and K. Oflazer, eds, ACL, 2005, pp. 363-370. doi: 10.3115/1219840.1219885.
33. J.H. Friedman, Greedy function approximation: A gradient boosting machine., The Annals of Statistics 29 (5) (2001), 1189-1232. doi: 10.1214/aos/1013203451.
34. C. Gârbacea, D. Odijk, D. Graus, I. Sijaranamual and M. deRijke, Combining multiple signals for semanticizing tweets: University of Amsterdam at #Microposts2015, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 59-60. http://ceur-ws.org/Vol-1395/paper-17.pdf.
35. Y. Genc, W.A. Mason and J.V. Nickerson, Classifying short messages using collaborative knowledge bases: Reading Wikipedia to understand Twitter, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 50-53. http://ceur-ws.org/Vol-1019/paper-28.pdf.
36. S. Ghosh, P. Maitra and D. Das, Feature based approach to named entity recognition and linking for tweets, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April 11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E. Cano Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, CEUR-WS.org, 2016, pp. 74-76. http://ceur-ws.org/Vol-1691/paper-10.pdf.
37. K. Gimpel, N. Schneider, B. O'Connor, D. Das, D. Mills, J. Eisenstein, M. Heilman, D. Yogatama, J. Flanigan and N.A. Smith, Part-of-speech tagging for Twitter: Annotation, features, and experiments, in: The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference-Short Papers, Portland, Oregon, USA, 19-24 June, 2011, ACL, 2011, pp. 42-47. http://www.aclweb.org/anthology/P11-2008.
38. F. Godin, P. Debevere, E. Mannens, W. De Neve and R. Van de Walle, Leveraging existing tools for named entity recognition in microposts, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 36-39. http://ceur-ws.org/Vol-1019/paper-25.pdf.
39. K. Greenfield, R.S. Caceres, M. Coury, K. Geyer, Y. Gwon, J. Matterer, A. Mensch, C.S. Sahin and O. Simek, A reverse approach to named entity extraction and linking in microposts, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April 11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E. Cano Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, CEUR-WS.org, 2016, pp. 67-69. http://ceur-ws.org/Vol-1691/paper-11.pdf.
40. R. Grishman and B. Sundheim, Message understanding conference-6: A brief history, in: 16th International Conference on Computational Linguistics, Proceedings of the Conference, COLING 1996, Center for Sprogteknologi, Copenhagen, Denmark, August 5-9, 1996, ACL, 1996, pp. 466-471. http://aclweb.org/anthology/C96-1079. doi: 10.3115/992628.992709.
41. Z. Guo and D. Barbosa, Entity recognition and linking on tweets with random walks, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 57-58. http://ceur-ws.org/Vol-1395/paper-21.pdf.
42. M.B. Habib, M. van Keulen and Z. Zhu, Concept extraction challenge: University of Twente at #MSM2013, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 17-20. http://ceur-ws.org/Vol-1019/paper-14.pdf.
43. M.B. Habib, M. van Keulen and Z. Zhu, Named entity extraction and linking challenge: University of Twente at #Microposts2014, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 64-65. http://ceur-ws.org/Vol-1141/paper-13.pdf.
44. B. Hachey, J. Nothman and W. Radford, Cheap and easy entity evaluation, in: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, Vol. 2: Short Papers, Baltimore, MD, USA, June 22-27, 2014, ACL, 2014, pp. 464-469. http://aclweb.org/anthology/P/P14/P14-2076.pdf.
45. J. Hoffart, M.A. Yosef, I. Bordino, H. Fürstenau, M. Pinkal, M. Spaniol, B. Taneva, S. Thater and G. Weikum, Robust disambiguation of named entities in text, in: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, A Meeting of SIGDAT, a Special Interest Group of the ACL, John McIntyre Conference Centre, Edinburgh, UK, 27-31 July, 2011, ACL, 2011, pp. 782-792. http://www.aclweb.org/anthology/D11-1072.
46. A.H. Jadidinejad, Unsupervised information extraction using BabelNet and DBpedia, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 54-56. http://ceur-ws.org/Vol-1019/paper-32.pdf.
47. H. Ji, R. Grishman and H.T. Dang, Overview of the TAC2011 Knowledge Base Population (KBP) track, Presentation at the Fourth Text Analysis Conference (TAC 2011), November 14-15, 2011, National Institute of Standards and Technology, Gaithersburg, Maryland, USA, 2009. http://tac.nist.gov/publications/2011/presentations/KBP2011-overview.presentation.pdf.
48. H. Ji, J. Nothman, B. Hachey and R. Florian, Overview of TAC-KBP2015 tri-lingual entity discovery and linking, in: Proceedings of the Eighth Text Analysis Conference (TAC 2015), National Institute of Standards and Technology, Gaithersburg, Maryland, USA, November 16-17, 2015, 2015. http://tac.nist.gov/publications/2015/additional.papers/TAC2015.KBP-Trilingual-Entity-Discovery-and-Linking-overview.proceedings.pdf.
49. J. Lehmann, R. Isele, M. Jakob, A. Jentzsch, D. Kontokostas, P.N. Mendes, S. Hellmann, M. Morsey, P. van Kleef, S. Auer and C. Bizer, DBpedia-A large-scale, multilingual knowledge base extracted from Wikipedia., Semantic Web 6 (2) (2015), 167-195. doi: 10.3233/SW-140134.
50. C. Li, J. Weng, Q. He, Y. Yao, A. Datta, A. Sun and B. Lee, TwiNER: Named entity recognition in targeted Twitter stream, in: The 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'12, W.R. Hersh, J. Callan, Y. Maarek and M. Sanderson, eds, ACM, Portland, OR, USA, 2012, pp. 721-730. doi: 10.1145/2348283.2348380.
51. P. Liang, Semi-supervised learning for natural language, Master's thesis, Massachusetts Institute of Technology, 2005, http://hdl.handle.net/1721.1/33296.
52. E. Loper and S. Bird, NLTK: the natural language toolkit, in: ETMTNLP'02, Proceedings of the ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics-Vol. 1, Philadelphia, Pennsylvania, July 7, 2002, C. Brew, M. Rosner and D. Radev, eds, ACL, 2002, pp. 63-70. doi: 10.3115/1118108.1118117.
53. X. Luo, On coreference resolution performance metrics, in: HLT/EMNLP 2005, Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, Vancouver, British Columbia, Canada, 6-8 October, 2005, ACL, 2005, pp. 25-32. doi: 10.3115/1220575.1220579.
54. P. McNamee, H. Simpson and H.T. Dang, Overview of the TAC2009 knowledge base population track, Presentation at the Second Text Analysis Conference (TAC 2009), November 16-17, 2009, National Institute of Standards and Technology, Gaithersburg, Maryland, USA, 2009. http://tac.nist.gov/publications/2009/presentations/TAC2009-KBP-overview.pdf.
55. P.N. Mendes, M. Jakob, A. García-Silva and C. Bizer, Dbpedia spotlight: Shedding light on the web of documents, in: Proceedings the 7th International Conference on Semantic Systems, I-SEMANTICS, Graz, Austria, September 7-9, 2011, C. Ghidini, A.-C. Ngonga Ngomo, S.N. Lindstaedt and T. Pellegrini, eds, ACM International Conference Proceeding Series, ACM, 2011, pp. 1-8. doi: 10.1145/2063518.2063519.
56. P.N. Mendes, D. Weissenborn and C. Hokamp, DBpedia spotlight at the MSM2013 challenge, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 57-61. http://ceur-ws.org/Vol-1019/paper-30.pdf.
57. A. Moro and R. Navigli, SemEval-2015 Task 13: Multilingual all-words sense disambiguation and entity linking, in: Proceedings of the 9th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2015, Denver, Colorado, USA, June 4-5, 2015, D.M. Cer, D. Jurgens, P. Nakov and T. Zesch, eds, ACL, 2015, pp. 288-297. http://aclweb.org/anthology/S/S15/S15-2049.pdf.
58. A. Moro, A. Raganato and R. Navigli, Entity linking meets word sense disambiguation: A unified approach., Transactions of the Association for Computational Linguistics 2 (2014), 231-244. https://tacl2013.cs.columbia.edu/ojs/index.php/tacl/article/view/291.
59. Ó. Muñoz-García, A. García-Silva and Ó. Corcho, Towards concept identification using a knowledge-intensive approach, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 45-49, http://ceur-ws.org/Vol-1019/paper-29.pdf.
60. M. Osborne, S. Petrovic, R. McCreadie, C. Macdonald and I. Ounis, Bieber no more: First story detection using Twitter and Wikipedia, in: SIGIR 2012 Workshop on Time-Aware Information Access (#TAIA2012), Portland, Oregon, USA, August 16, 2012, F. Diaz, S. Dumais, K. Radinsky, M. deRijke and M. Shokouhi, eds, 2012.
61. S. Petrovic, M. Osborne and V. Lavrenko, Streaming first story detection with application to Twitter, in: Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings, Los Angeles, California, USA, June 2-4, 2010, ACL, 2010, pp. 181-189. http://www.aclweb.org/anthology/N10-1021.
62. L.-A. Ratinov and D. Roth, Design challenges and misconceptions in named entity recognition, in: Proceedings of the Thirteenth Conference on Computational Natural Language Learning, CoNLL 2009, Boulder, Colorado, USA, June 4-5, 2009, S. Stevenson and X. Carreras, eds, ACL, 2009, pp. 147-155. doi: 10.3115/1596374.1596399.
63. L.-A. Ratinov, D. Roth, D. Downey and M. Anderson, Local and global algorithms for disambiguation to Wikipedia, in: The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, Portland, Oregon, USA, 19-24 June, 2011, D. Lin, Y. Matsumoto and R. Mihalcea, eds, ACL, 2011, pp. 1375-1384. http://www.aclweb.org/anthology/P11-1138.
64. A. Ritter, S. Clark, Mausam and O. Etzioni, Named entity recognition in tweets: An experimental study, in: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, A meeting of SIGDAT, a Special Interest Group of the ACL, John McIntyre Conference Centre, Edinburgh, UK, 27-31 July, 2011, ACL, 2011, pp. 1524-1534. http://www.aclweb.org/anthology/D11-1141.
65. G. Rizzo, A.E. Cano Basave, B. Pereira and A. Varga, Making sense of microposts (#Microposts2015) named entity rEcognition and linking (NEEL) challenge, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 44-53. http://ceur-ws.org/Vol-1395/microposts2015-neel-challenge-report/.
66. G. Rizzo and R. Troncy, NERD: A framework for unifying named entity recognition and disambiguation extraction tools, in: EACL 2012, 13th Conference of the European Chapter of the Association for Computational Linguistics, Avignon, France, April 23-27, 2012, W. Daelemans, M. Lapata and L. Màrquez, eds, ACL, 2012, pp. 73-76. http://aclweb.org/anthology-new/E/E12/E12-2015.pdf.
67. G. Rizzo, R. Troncy, S. Hellmann and M. Brümmer, NERD meets NIF: Lifting NLP extraction results to the Linked Data Cloud, in: WWW2012 Workshop on Linked Data on the Web, Lyon, France, 16 April, 2012, C. Bizer, T. Heath, T. Berners-Lee and M. Hausenblas, eds, CEUR Workshop Proceedings, Vol. 937, CEUR-WS.org, 2012. http://ceur-ws.org/Vol-937/ldow2012-paper-02.pdf.
68. G. Rizzo, M. van Erp, J. Plu and R. Troncy, Making sense of microposts (#Microposts2016) Named Entity rEcognition and Linking (NEEL) challenge, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April 11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E. Cano Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, CEUR-WS.org, 2016, pp. 50-59. http://ceur-ws.org/Vol-1691/microposts2016-neel-challenge-report/.
69. G. Rizzo, M. van Erp and R. Troncy, Benchmarking the extraction and disambiguation of named entities on the Semantic Web, in: Proceedings of the Ninth International Conference on Language Resources and Evaluation, LREC 2014, Reykjavik, Iceland, May 26-31, 2014, N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J. Mariani, A. Moreno, J. Odijk and S. Piperidis, eds, European Language Resources Association (ELRA), 2014, pp. 4593-4600. http://www.lrec-conf.org/proceedings/lrec2014/summaries/176.html.
70. S. Sachidanandan, P. Sambaturu and K. Karlapalem, NERTUW: named entity recognition on tweets using Wikipedia, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 67-70. http://ceur-ws.org/Vol-1019/paper-35.pdf.
71. E.F.T.K. Sang and F. De Meulder, Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition, in: Proceedings of the Seventh Conference on Natural Language Learning, CoNLL 2003, Held in Cooperation with HLT-NAACL 2003, Edmonton, Canada, May 31-June 1, 2003, W. Daelemans and M. Osborne, eds, ACL, 2003, pp. 142-147. http://aclweb.org/anthology/W/W03/W03-0419.pdf.
72. U. Scaiella, M. Barbera, S. Parmesan, G. Prestia, E. Del Tessandoro and M. Verí DataTXT at #Microposts2014 challenge, in: Proceedings of the 4th Workshop on Making Sense of Microposts Co-Located with the 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 7th, 2014, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1141, CEUR-WS.org, 2014, pp. 66-67. http://ceur-ws.org/Vol-1141/paper-19.pdf.
73. P. Sinha and B. Barik, Named entity extraction and linking in #microposts, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 66-67. http://ceur-ws.org/Vol-1395/paper-19.pdf.
74. P. Torres-Tramón, H. Hromic, B. Walsh, B.R. Heravi and C. Hayes, Kanopy4Tweets: Entity extraction and linking for Twitter, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E.C. Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, 2016, pp. 64-66. http://ceur-ws.org/Vol-1691/paper-13.pdf.
75. A. van den Bosch and T. Bogers, Memory-based named entity recognition in tweets, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 40-43. http://ceur-ws.org/Vol-1019/paper-03.pdf.
76. M. van Erp, P.N. Mendes, H. Paulheim, F. Ilievski, J. Plu, G. Rizzo and J. Waitelonis, Evaluating entity linking: An analysis of current benchmark datasets and a roadmap for doing a better job, in: Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, PortoroŽ Slovenia, May 23-28, 2016, N. Calzolari, K. Choukri, T. Declerck, S. Goggi, M. Grobelnik, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk and S. Piperidis, eds, European Language Resources Association (ELRA), 2016. http://www.lrec-conf.org/proceedings/lrec2016/summaries/926.html.
77. M. van Erp, G. Rizzo and R. Troncy, Learning with the Web: Spotting named entities on the intersection of NERD and machine learning, in: Proceedings of the Concept Extraction Challenge at the Workshop on 'Making Sense of Microposts', Rio de Janeiro, Brazil, May 13, 2013, A.E. Cano Basave, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1019, CEUR-WS.org, 2013, pp. 27-30. http://ceur-ws.org/Vol-1019/paper-15.pdf.
78. A. Varga, A.E. Cano Basave, M. Rowe, F. Ciravegna and Y. He, Linked knowledge sources for topic classification of microposts: A semantic graph-based approach., Journal of Web Semantics 26 (2014), 36-57. doi: 10.1016/j.websem.2014.04.001.
79. J. Waitelonis and H. Sack, Named entity linking in #tweets with KEA, in: Proceedings of the 6th Workshop on 'Making Sense of Microposts' Co-Located with the 25th International World Wide Web Conference (WWW 2016), Montréal, Canada, April 11, 2016, A.-S. Dadzie, D. Preotiuc-Pietro, D. Radovanovic, A.E.C. Basave and K. Weller, eds, CEUR Workshop Proceedings, Vol. 1691, CEUR-WS.org, 2016, pp. 61-63. http://ceur-ws.org/Vol-1691/paper-14.pdf.
80. R.E. Walpole and R.H. Myers, Probability and Statistics for Engineers & Scientists, 8 edn, Pearson Education International, 2007.
81. I. Yamada, H. Takeda and Y. Takefuji, An end-to-end entity linking approach for tweets, in: Proceedings of the 5th Workshop on Making Sense of Microposts Co-Located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, May 18th, 2015, M. Rowe, M. Stankovic and A.-S. Dadzie, eds, CEUR Workshop Proceedings, Vol. 1395, CEUR-WS.org, 2015, pp. 55-56. http://ceur-ws.org/Vol-1395/paper-16.pdf.