Arabic Named Entity Recognition: A Feature-Driven Study

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 5, 2009, Pages 926-934

  Benajiba, Yassine ^a   Rosso, Paolo ^a   Diab, Mona ^b  

^a UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Arabic; machine learning comparison; named entity recognition; natural language processing (NLP)

Indexed keywords

EID: 85008044204     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2009.2019927     Document Type: Article

References (36)

1. B. Babych and A. Hartley, “Improving machine translation quality with automatic named entity recognition,” in Proc. EACL-EAMT, Budapest, 2003.
2. Y. Benajiba and P. Rosso, “Arabic named entity recognition using conditional random fields,” in Proc. Workshop HLT NLP within the Arabic world. Arabic Lang, local lang. process.: Status Updates and Prospects, 6th Int. Conf. Lang. Resources Eval., LREC-2008, 2008.
3. Y. Benajiba, P. Rosso, and J. M. Benedf, “ANERsys: An Arabic named entity recognition system based on maximum entropy,” in Proc. 8th Int. Conf. Comput. Linguist. Intell. Text Process., CICLing-2007, Springer-Verlag, LNCS(4394), 2007, pp. 143–153.
4. Y. Benajiba and P. Rosso, “ANERsys 2.0: Conquering the NER task for the Arabic language by combining the maximum entropy with POS-tag information,” in Proc. Workshop Natural Lang.-Independent Eng., 3rd Indian Int. Conf. Artif. Intell., IICAI-2007, 2007.
5. O. Bender, F. J. Och, and H. Ney, “Maximum entropy models for named entity recognition,” in Proc. CoNLL-2003, Edmonton, AL, Canada, 2003.
6. A. L. Berger, V. J. D. Pietra, and S. A. D. Pietra “A maximum entropy approach to natural language processing,” Comput. Linguist., vol. 22, pp. 39–71, 1996.
7. T. Buckwalter, “Buckwalter Arabic morphological analyzer,” in Proc. Linguistic Data Consortium. (LDC2002L49), 2002.
8. H. L. Chieu and H. T. Ng, “Named entity recognition with a maximum entropy approach,” in Proc. CoNLL-2003, Edmonton, AL, Canada, 2003.
9. M. Diab, K. Hacioglu, and D. Jurafsky, Arabic Computational Morphology: Knowledge-based and Empirical Methods, A. Soudi, A. van den Bosch, and G. Neumann, Eds. New York: Springer, 2007, ch. 9, pp. 159–179.
10. M. Diab, M. Alkhalifa, S. Elkateb, C. Fellbaum, A. Mansouri, and M. Palmer, “Semeval 2007 task 18: Arabic semantic labeling,” in Proc. Int. Workshop Semantic Eval., SemEval-2007, 2007.
11. B. Farber, D. Freitag, N. Habash, and O. Rambow, “Improving NER in Arabic using a morphological tagger,” in Proc. 6th Int. Lang. Resources Eval. (LREC'08), 2008.
12. S. Ferrandez, O. Ferrandez, A. Ferrandez, and R. Munoz, “The importance of named entities in cross-lingual question answering,” in Proc. Recent Adv. Natural Lang. Process. RANLP-2007, 2007.
13. R. Florian, A. Ittycheriah, H. Jing, and T. Zhang, “Named entity recognition through classifier combination,” in Proc. CoNLL 2003, 2003.
14. M. A. Greenwood and R. Gaizauskas, “Using a named entity tagger to generalise surface matching text patterns for question answering,” in Proc. Workshop Natural Lang. Process. Question Answering (EACY03), 2007.
15. N. Habash and F. Sadat, “Arabic preprocessing schemes for statistical machine translation,” in Proc. North Amer. Chap. Assoc. Comput. Linguist. (NAACL), 2006.
16. N. Habash and O. Rambow, “Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop,” in Proc. Workshop Comput. Approaches to Semitic Lang. ACL-2005, 2005.
17. D. Klein, J. Smarr, H. Nguyen, and C. Manning, “Named entity recognition with character-level models,” in Proc. CoNLL-2003, 2003.
18. T. Kudo and Y. Matsumato, “Chunking with support vector machine,” in Proc. 4th Conf. Very Large Corpora, 2000, pp. 142–144.
19. T. Kudo, K. Yamamoto, and Y. Matsumoto, “Applying conditional random fields to Japanese morphological analysis,” in Proc. EMNLP'04, 2004.
20. J. Lafferty, A. McCallum, and F. Pereira, “Conditional random fields: Probabilistic models for segmenting and labeling sequence data,” in Proc. ICML-2002, 2002.
21. W. Li and A. McCallum, “Rapid development of Hindi named entity recognition using conditional random fields and feature induction,” Special issue of ACM Trans. Asian Lang. Inf. Process.: Rapid Develop. Lang. Capabilities: The Surprise Lang., 2003.
22. M. Maamouri, A. Bies, T. Buckwalter, and W. dan Mekki, “The Penn-Arabic treebank: Building a large-scale annotated Arabic corpus,” in Proc. NEMLAR Conf. Arabic Lang. Resources and Tools, 2004.
23. R. Malouf, “Markov models for language-independent named entity recognition,” in Proc. CoNLL-2003, Edmonton, AL, Canada, 2003.
24. J. Mayfield, P. McNamee, and C. Piatko, “Named entity recognition using hundreds of thousands of features,” in Proc. CoNLL-2003, 2003.
25. A. McCallum and W. Li, “Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons,” in Proc. 7th Conf. Natural Lang. Learn. (CoNLL), 2003.
26. A. Ratnaparkhi, “A maximum entropy part-of-speech tagger,” in Proc. 1st EMNLP, 1996.
27. G. Salton and C. Buckley, “Term-weighting approaches in automatic text retrieval,” in Proc. Inf. Process. Manage., 1988.
28. F. Sha and F. Pereira, “Shallow parsing with conditional random fields,” in Proc. HLT-NAACL, 2003.
29. H. Toda and R. Kataoka, “A search result clustering method using informatively named entities,” in Proc. 7th ACM Int. Workshop Web Inf. Data Manage., 2005.
30. Q. T. Tran, T. X. T. Pham, Q. H. Ngo, D. Dinh, and N. Collier, “Named entity recognition in Vietnamese documents,” Progress in Informatics J., 2007.
31. P. Thompson and C. C. Dozier, “Name searching and information retrieval,” in Proc. 2nd Conf. Empirical Methods in Natural Lang. Process., 1997.
32. H. Turtle and W. C. Bruce, “Evaluation of an inference network-based retrieval model,” in ACM Trans. Inf. Syst., 1991.
33. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer Verlag, 1995.
34. C.-W. Wu, S.-Y. Jan, R.T.-H. Tsai, and W.-L. Hsu, “On using ensemble methods for Chinese named entity recognition,” in Proc. 5th SIGH AN Workshop Chinese Lang. Process., 2006.
35. T. Zhang and D. Johnson, “A robust risk minimization based named entity recognition system,” in Proc. CoNLL-2003, 2003.
36. I. Zitouni, J. Sorensen, X. Luo, and R. Florian, “The impact of morphological stemming on Arabjc mention detection and coreference resolution,” in Proc. 43rd Annu. Meeting Assoc. Comput. Linguist. (ACL05), 2005, pp. 63–70.