On knowledge-poor methods for person name matching and lemmatization for highly inflectional languages

Information Retrieval

Volumn 12, Issue 3, 2009, Pages 275-299

  Piskorski, Jakub ^a   Wieloch, Karol ^b   Sydow, Marcin ^c  

^a JOINT RESEARCH CENTRE   (Italy)

^b POZNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Poland)

^c POLISH JAPANESE INSTITUTE OF INFORMATION TECHNOLOGY   (Poland)

Author keywords

Highly inflectional languages; Lemmatization; Person name matching; String distance metrics

Indexed keywords

EID: 64749104008     PISSN: 13864564     EISSN: 15737659     Source Type: Journal    
DOI: 10.1007/s10791-008-9085-5     Document Type: Article

References (41)

1. Agirre, E., Marquez, L., & Wicentowski, R. (2007). Proceedings of SemEval2007 4th International Workshop on Semantic Evaluations, Prague, Czech Republic. ACL.
2. Bagga, A., & Baldwin, B. (1998). Entity-based Cross-document Co-referencing Using the Vector Space Model. In Proceedings of the ACL 1998, Montreal, Quebec, Canada (pp. 79-85).
3. Bilenko, M., & Mooney, R. (2003). Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2003), Washington, USA.
4. Bollegalla, D., Matsuo, Y., & Ishizuka, M. (2007). Measuring semantic similarity between words using web search engines. In Proceedings of the World Wide Web Conference 2007, Banff, Alberta, Canada.
5. Bollegalla, D., Honma, T., Matsuo, Y., & Ishizuka, M. (2008). Identification of personal name aliases on the web. In Proceedings of the World Wide Web Conference 2008, Beijing, China.
6. Christen, P. (2006). A comparison of personal name matching: Techniques and practical issues. Technical report, TR-CS-06-02, Computer Science Laboratory, The Australian National University, Canberra, Australia.
7. S. Coates Steohens 1992 The analysis and acquisition of proper names for the understanding of a free text Computers and the Humanities 26 441 456
8. Cohen, E., Ravikumar, P., & Fienberg, S. (2003a). A comparison of string metrics for matching names and records. In Proceedings of KDD Workshop on Data Cleaning and Object Consolidation.
9. Cohen, W., Ravikumar, P., & Fienberg, S. (2003b). A comparison of string distance metrics for name-matching tasks. In Proceedings of IJCAI-03 Workshop on Information Integration on the Web (IIWeb-03), Acapulco, Mexico (pp. 73-78).
10. Cucerzan, S. (2007). Large scale named entity disambiguation based on Wikipedia data. In Proceedings of the EMNLP-CoNLL Joint Conference, Prague, Czech Republic, ACL.
11. A Elmagarmid P Ipeirotis V Verykios 2007 Duplicate record detection: A survey IEEE Transactions on Knowledge and Data Engineering 19 1 1 16
12. I. Fellegi A. Sunter 1969 A theory for record linkage Journal of the American Statistical Association 64 328 1183 1210
13. Fernandez, M., De la Clergerie, E., & Vilares, M. (2007). Knowledge acquisition through error mining. In Proceedings of RANLP'07, Recent Advances in Natural Language Processing, Tzigov Chark, Bulgaria (pp. 220-224).
14. Fleischman, M., & Hovy, E. (2004). Multi-document person name resolution. In Proceedings of the Workshop on Reference Resolution at ACL 2004, Barcelona, Spain.
15. L. Gravano P. Ipeirotis H. Jagadish N. Koudas S. Muthukrishnan L. Pietarinen D. Srivastava 2001 Using q-grams in a DBMS for approximate string processing IEEE Data Engineering Bulletin 24 4 28 34
16. Grzenia, J. (1998). Słownik nazw własnych-ortografia, wymowa, słowotwórstwo i odmiana. Warszawa: PWN.
17. Hernandez, M., & Stolfo, S. (1995). The Merge/purge problem for large databases. In Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, San Jose, California, USA (pp. 127-138). New York: ACM.
18. M. Jaro 1989 Advances in record linking methodology as applied to the 1985 census of Tampa Florida Journal of the American Statistical Society 84 406 414 420
19. Keskustalo, H., Pirkola, A., Visala, K., Leppanen, E., & Jarvelin, K. (2003). Non-adjacent digrams improve matching of cross-lingual spelling variants. In Proceedings of SPIRE, LNCS 22857, Manaus, Brazil (pp. 252-265).
20. Klementiev, A., & Roth, D. (2006). Weakly supervised named-entity transliteration and discovery from multilingual comparable corpora. In Proceedings of ACL 2006 Conference. ACL
21. V. Levenshtein 1965 Binary codes for correcting deletions, insertions, and reversals Doklady Akademii Nauk SSSR 163 4 845 848
22. Li, X., Morie, P., & Rothd, D. (2004). Identification and tracing of ambiguous names: Discriminative and generative approaches. In Proceedings of the National Conference on Artificial Intelligence 2004.
23. Lindén, K. (2008). A probabilistic model for guessing base forms of new words by analogy. In Proceedings of CICling-2008, 9th International Conference on Intelligent Text Processing and Computational Linguistics, Haifa, Israel.
24. Mann, G., & Yarowsky, D. (2003). Unsupervised personal name disambiguation. In Proceedings of CoNLL 2003, Edmonton, Canada (pp. 33-40).
25. Miłkowski, M. (2007). Morfologik. Web document: http://morfologik.blogspot.com.
26. Monge, A., & Elkan, C. (1996). The field matching problem: Algorithms and applications. In Proceedings of Knowledge Discovery and Data Mining 1996 (pp. 267-270).
27. Ntoulas, A., Stamou, S., & Tzagarakis, M. (2001). Using a WWW search engine to evaluate normalization performance for a highly inflectional language. In Proceedings of ACL 2001 (Companion Volume) (pp. 31-36).
28. On, B., Lee, D., Kang, J., & Mitra, P. (2005). Comparative study of name disambiguation problem using a scalable blocking-based framework. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, JCDL 2005, Denver, CA, USA (pp. 344-353). ACM.
29. Pedersen, T., Purandare, A., & Kulkarni, A. (2005). Name discrimination by clustering similar contexts. In CICLing (pp. 226-237).
30. Piskorski, J. (2005). Named-entity recognition for Polish with SProUT. In L. Bolc, Z. Michalewicz, & T. Nishida (Eds.), LNCS Vol 3490: Proceedings of IMTCI 2004, Warsaw, Poland.
31. Piskorski, J., Sydow, M., & Kupść, A. (2007). Lemmatization of Polish person names. In Proceedings of the ACL Workshop on Balto-Slavonic Natural Language Processing 2007-Special Theme: Information Extraction and Enabling Technologies (BSNLP'2007). Held at ACL'2007, Prague, Czech Republic, 2007. Stroudsburg, PA: ACL.
32. Piskorski, J., Wieloch, K., Pikuła, M., & Sydow, M. (2008). Towards person name matching for highly inflective languages. In Proceedings of the WWW'2008 workshop on Natural Language Processing Challenges in the Information Explosion Era (NLPIX 2008).
33. Pouliquen, B., & Steinberger, R. (2009). Automatic construction of multilingual name dictionaries. In: C. Goutte, N. Cancedda, M. Dymetman, & G. Foster (Eds.), Learning machine translation (pp. 59-78). MIT Press - Advances in Neural Information Processing (NIPS) Series.
34. Przepiórkowski, A. (2005). The IPI PAN corpus in numbers. In Z. Vetulani (Ed.), Proceedings of the 2nd Language & Technology Conference, Poznań, Poland.
35. T. Smith M. Waterman 1981 Identification of common molecular subsequences Journal of Molecular Biology 147 195 197
36. R. Steinberger B. Pouliquen 2007 Cross-lingual named entity recognition Journal Linguisticae Investigationes, Special Issue on Named Entity Recognition and Categorisation 30 1 135 162
37. E. Ukkonen 1992 Approximate string matching with q-grams and maximal matches Theoretical Computer Science 92 1 191 211
38. Vilares, J., Alonso, M., & Vilares Ferro, M. (2004). Morphological and syntactic processing for text retrieval. In DEXA (pp. 371-380).
39. Weiss, D. (2005). A survey of freely available Polish stemmers and evaluation of their applicability in information retrieval. In Proceedings of the 2nd Language and Technology Conference (LTC'2005), Poznań, Poland, 2005 (pp. 216-221).
40. Weiss, D. (2007). Korpus Rzeczpospolitej. URL: http://www.cs.put.poznan. pl/dweiss/rzeczpospolita.
41. Winkler, W. (1999). The state of record linkage and current research problems. Technical report, Statistical Research Division, U.S. Bureau of the Census, Washington, DC.