Morphology-based segmentation combination for arabic mention detection

ACM Transactions on Asian Language Information Processing

Volumn 8, Issue 4, 2009, Pages

  Benajiba, Yassine ^a   Zitouni, Imed ^b  

^a Howard Hughes Medical Institute   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Arabic information extraction; Arabic mention detection; Arabic segmentation

Indexed keywords

ARABIC LANGUAGES; ARABIC TEXTS; AUTOMATIC CONTENT; DETECTION MODELS; DETECTION SYSTEM; INFORMATION EXTRACTION; MORPHOLOGICAL SEGMENTATION; NATURAL LANGUAGE PROCESSING; PRE-PROCESSING STEP; SEGMENTATION SCHEME; SIGNIFICANT IMPACTS; TREEBANKS; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS; INFORMATION ANALYSIS; MORPHOLOGY; QUERY LANGUAGES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 75649120307     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1644879.1644883     Document Type: Article

References (22)

1. BENAJIBA, Y., DIAB, M., AND ROSSO, P. 2008. Arabic named entity recognition using optimized feature sets. In Proceedings of the Joint Meeting of the Conference on Empirical Methods in Natural Language Processing (EMNLP'08).
2. BERGER, A., DELLA PIETRA, S., AND DELLA PIETRA, V. 1996. A maximum entropy approach to natural language processing. Comput. Linguist. 22, 1, 39-71.
3. CHEN, S. AND ROSENFELD, R. 2000. A survey of smoothing techniques for ME models. IEEE Trans. Speech Audio Proc.
4. CHEN, S. F. AND GOODMAN, J. 1998. An empirical study of smoothing techniques for language modeling. Tech. rep., TR-10-98, Center for Research in Computing Technology, Harvard University.
5. DIAB, M., HACIOGLU, K., AND JURAFSKY, D. 2004. Automatic tagging of Arabic text: From raw text to base phrase chunks. In Proceedings of the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLT/NAACL'04).
6. FLORIAN, R., HASSAN, H., ITTYCHERIAH, A., JING, H., KAMBHATLA, N., LUO, X., NICOLOV, N., AND ROUKOS, S. 2004. A statistical model for multilingual entity detection and tracking. In Proceedings of the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLT/NAACL'04).
7. GOODMAN, J. 2002. Sequential conditional generalized iterative scaling. In Proceedings of the Association of Computer Linguistics (ACL'02).
8. GRAFF, D. 2003. Arabic gigaword. http://www.ldc.upenn.edu/.
9. HABASH, N. AND SADAT, F. 2006. Combination of Arabic preprocessing schemes for statistical machine translation. In Proceedings of the Association of Computer Linguistics (ACL'06).
10. JING, H., FLORIAN, R., LUO, X., ZHANG, T., AND ITTYCHERIAH, A. 2003. How to get a Chinese Name (Entity): Segmentation and combination issues. In Proceedings of the Joint Meeting of the Conference on Empirical Methods in Natural Language Processing (EMNLP'03).
11. LAFFERTY, J., MCCALLUM, A., AND PEREIRA, F. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning (ICML'01).
12. LEE, Y.-S.,PAPINENI, K., ROUKOS, S., EMAM, O., AND HASSAN, H. 2003. Language model based Arabic word segmentation. In Proceedings of the Association of Computer Linguistics (ACL'03). 399-406.
13. MAAMOURI, M., BIES, A., BUCKWALTER, T., AND MEKKI, W. 2004. The Penn Arabic Treebank: Building a large-scale annotated Arabic corpus. In Proceedings of the NEMLAR Conference on Arabic Language Resources and Tools (NEMLAR'04).
14. MOHRI, M., PEREIRA, F. C. N., AND RILEY, M. 1998. A rational design for a weighted finite-state transducer library. In Proceedings of the 2nd International Workshop on Implementation and Application of Automata (CIAA'98). D.Wood and S. Yu, Eds. Lecture Notes in Computer Science, vol.1436. Springer-Verlag: Berlin. 144-158.
15. NIST. 2007. The ACE evaluation plan. www.nist.gov/speech/tests/ace/index. htm.
16. NOREEN, E. W. 1989. Computer-Intensive Methods for Testing Hypotheses. John Wiley & Sons.
17. RAMSHAW, L. AND MARCUS, M. 1994. Exploring the statistical derivation of transformational rule sequences for part-of-speech tagging. In Proceedings of the ACL Workshop on Combining Symbolic and Statistical Approaches to Language (ACL'94). 128-135.
18. RAMSHAW, L. AND MARCUS, M. 1995. Text chunking using transformation-based learning. In Proceedings of the 3rd Workshop on Very Large Corpora (WVLC'95). D. Yarowsky and K. Church, Eds. Association for Computational Linguistics, 82-94.
19. TJONG KIM SANG, E. F. 2002. Introduction to the CONLL-2002 shared task: Languageindependent named entity recognition. In Proceedings of the Conference on Natural Language Learning (CoNLL'02). 155-158.
20. TJONG KIM SANG, E. F. AND VEENSTRA, J. 1999. Representing text chunks. In Proceedings of the Conference on the European Chapter of the Association for Computational Linguistics (EACL'99).
21. TOUTANOVA, K., KLEIN, D., MANNING, C., AND SINGER, Y. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLT/NAACL'03).
22. ZITOUNI, I., SORENSEN, J., LUO, X., AND FLORIAN, R. 2005. The impact of morphological stemming on Arabic mention detection and conference resolution. In Proceedings of the ACL Workshop on Computing Approaches to Semitic Languages (CASL'05).