An accuracy-enhanced light stemmer for arabic text

ACM Transactions on Speech and Language Processing

Volumn 7, Issue 2, 2011, Pages

  El Beltagy, Samhaa R ^a   Rafea, Ahmed ^b  

^a Cairo University   (Egypt)

^b The American University in Cairo   (Egypt)

Author keywords

Arabic; Broken plurals; Heuristic rules; Stemming

Indexed keywords

ARABIC; ARABIC TEXTS; AUTOMATIC ANNOTATION; BROKEN PLURALS; HEURISTIC RULES; INFORMATION EXTRACTION; KEYPHRASE EXTRACTION; ONTOLOGY LEARNING; RETRIEVAL APPLICATIONS; SEMANTIC ANNOTATIONS; SET OF RULES; STEMMING; TEXT MINING;

DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS; ONTOLOGY; SEMANTICS; TEXT PROCESSING;

INFORMATION RETRIEVAL;

EID: 79952319526     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1921656.1921657     Document Type: Article

References (37)

1. AL AMEED, H. K., AL KETBI, S. O., AL KAABI, A. A., AL SHEBLI, K. S., AL SHAMSI, N. F., AL NUAIMI, N. H., AND AL MUHAIRI, S. S. 2005. Arabic light stemmer: A new enhanced approach. In Proceedings of the 2nd International Conference on Innovations in Information Technology (IIT'05).
2. AL KHARASHI, I. A. AND AL SUGHAIYER, I. A. 2004. Performance evaluation of an Arabic rule-based stemmer. In Proceedings of the 17th National Computer Conference.
3. ALJLAYL, M. AND FRIEDER, O. 2002. On Arabic search: Improving the retrieval effectiveness via light stemming approach. In Proceedings of the ACM 11th Conference on Information and Knowledge Management. 340-347.
4. AL-SHAMMARI, E. AND LIN, J. 2008a. A novel Arabic lemmatization algorithm. In Proceedings of Conference AND'08. 113-118.
5. AL-SHAMMARI, E. AND LIN, J. 2008b. Towards an error-free Arabic stemming. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM-iNEWS'08). 9-16.
6. BEESLEY, K. R. 1996. Arabic finite-state morphological analysis and generation. In Proceedings of the 16th Conference on Computational Linguistics. 89-94.
7. BUCKWALTER, T. 2003. Qamus: Arabic Lexicography. http://www.qamus.org/
8. CHEN, A. AND GEY, F. 2002. Building an Arabic stemmer for information retrieval. In Proceedings of the Text Retrieval Conference (TREC'02). 631-639.
9. DARWISH, K. 2002. Building a shallow morphological analyzer in one day. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages.
10. DARWISH, K. AND OARD, D. W. 2002. CLIR experiments at Maryland for TREC-2002: Evidence combination for Arabic-English retrieval. In Proceedings of the Text Retrieval Conference (TREC'02). 703-710.
11. DIAB, M., HACIOGLU, K., AND JURAFSKY, D. 2004. Automatic tagging of Arabic text: From raw test to base phrase chunks. In Proceedings of the Annual Meeting of the Association for Computational Linguistics on Human Language Technologies North American Chapter of the Association for Computational Linguistics (HLT-NAACL'04).
12. EL-BELTAGY, S. R. AND RAFEA, A. 2009a. A framework for the rapid development of list based domain specific Arabic stemmers. In Proceedings of the 2nd International Conference on Arabic Language Resources and Tools.
13. EL-BELTAGY, S. R. AND RAFEA, A. 2009b. KP-Miner: A keyphrase extraction system for English and Arabic documents. Inform. Syst. 34, 132-144.
14. EL-BELTAGY, S. R., HAZMAM, M., AND RAFEA, A. 2007. Ontology based annotation of Web document segments. In Proceedings of the 22nd Annual ACM Symposium on Applied Computing. 1362-1367. (Pubitemid 47568492)
15. FLORES, F. N.,MOREIRA, V. P., AND HEUSER, C. A. 2010. Assessing the impact of stemming accuracy on information retrieval. In Proceedings of the International Conference on Computational Processing of Portuguese Language. Lecture Notes in Computer Science, vol. 6001. Springer, 11-20.
16. GOLDSMITH, J. A.,HIGGINS, D., AND SOGLASNOVA, S. 2000. Automatic language-specific stemming in information retrieval. In Revised Papers from theWorkshop of Cross-Language Evaluation Forum on Cross-Language Information Retrieval and Evaluation. 273-284.
17. GOWEDER, A., POESIO, M., AND DE ROECK, A. 2004a. Broken plural detection for arabic information retrieval. In Proceedings of the Annual ACM Conference on Reseurch and Development in Information Retvieval (SIGIR'04).
18. GOWEDER, A., POESIO, M., DE ROECK, A., AND REYNOLDS, J. 2004b. Identifying broken plurals in unvowelised Arabic text. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).
19. HARMANANI, H. M., KEIROUZ, W. T., AND RAHEEL, S. 2006. A rule-based extensible stemmer for information retrieval with application to Arabic. Int. Arab J. Inform. Technol. 3, 3, 265-272.
20. HAZMAN, M., EL-BELTAGY, S. R., AND RAFEA, A. 2009. Ontology learning from domain specific Web documents. Int. J. Metadata Semant. Ontol. 4, 1-2, 24-33.
21. KHOJA, S. AND GARSIDE, R. 1999. Stemming Arabic text. Tech. rep. Computing Department, Lancaster University, Lancaster, U.K.
22. LACLAVIK, M., SELENG, M., GATIAL, E., BALOGH, Z., AND HLUCHY, L. 2007. Ontology based text annotation - OnTeA. In Proceedings of the Conference on Information Modeling and Knowledge Bases. 311-315.
23. LARKEY, L. S. AND CONNELL, M. E. 2001. Arabic information retrieval at UMass in TREC-10. In Proceedings of the Text Retrieval Conference (TREC'01).
24. LARKEY, L. S.,BALLESTEROS, L., AND CONNELL,M. E. 2002. Improving stemming for Arabic information retrieval: Light stemming and co-occurrence analysis. In Proceeedings of the Annual ACM Conference on Research and Development in Information Retrieval (SIGIR'02).
25. LARKEY, L. S., BALLESTEROS, L., AND CONNELL, M. E. 2007. Light stemming for Arabic information retrieval. In Arabic Computational Morphology, A. Soudi, A. van der Bosch, and G. Neumann, Eds. 221-243.
26. LEE, Y., PAPINENI, K., ROUKOS, S., EMAM, O., AND HASSAN, H. 2003. Language model based Arabic word segmentation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. 399-406.
27. MANNING, C. D., RAGHAVAN, P., AND SCHÜTZE, H. 2008. Introduction to Information Retrieval. Cambridge University Press. Cambridge, U.K.
28. MOUKDAD, H. 2006. Stemming and root-based approaches to the retrieval of Arabic documents on the Web. Webology 3, 1, Article 22. http://www.webology.ir/ 2006/v3n1/a22.html.
29. NWESRI, A., TAHAGHOGHI, S. M. M., AND SCHOLER, F. 2005. Stemming Arabic conjunctions and prepositions. In Proceedings of the 12th International Symposium on String Processing and Information Retrieval (SPIRE'05). Lecture Notes in Computer Science, vol. 3772, Springer, 206-217.
30. PAICE, C. D. 1996. Method for evaluation of stemming algorithms based on error counting. J. Amer. Soc. Inform. Sci. 47, 632-649. (Pubitemid 126593558)
31. RAFEA, A. AND SHAALAN, K. 1993. Lexical analysis of inflected Arabic words using exhaustive search of an augmented transition network. Softw. Pract. Exper. 23, 6, 567-588. (Pubitemid 23668408)
32. ROGATI, M., MCCARLEY, S., AND YANG, Y. 2003. Unsupervised learning of Arabic stemming using a parallel corpus. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics. 391-398.
33. ŠNAJDER, J., BAŠIC, B. D., AND TADIC, M. 2008. Automatic acquisition of inflectional lexica for morphological normalization. Inform. Process. Manag. 44, 1720-1731.
34. TAGHVA, K.,ELKHOURY, R., AND COOMBS, J. S. 2005. Arabic stemming without a root dictionary. ITCC 1, 152-157. (Pubitemid 41290087)
35. WIKIPEDIA. 2008. Wikipedia, the free encyclopedia. http://ar.wikipedia. org/wiki/Main-Page.
36. XU, J. AND CROFT, W. B. 1998. Corpus, based stemming using co, occurrence of word variants. ACM Trans. Inform. Syst. 16, 1, 61-81. (Pubitemid 128656321)
37. ZITOUNI, I., SORENSEN, J., LUO, X., AND FLORIAN, R. 2005. The impact of morphological stemming on Arabic mention detection and coreference resolution. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages. 63-70.