A survey of automatic Arabic diacritization techniques

Natural Language Engineering

Volumn 21, Issue 3, 2015, Pages 477-495

  Azmi, Aqil M ^a   Almajed, Reham S ^a  

^a KING SAUD UNIVERSITY   (Saudi Arabia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED LANGUAGE TRANSLATION; SPEECH TRANSMISSION;

ARABIC LANGUAGES; DIACRITIC RESTORATION; FUTURE TRENDS; MACHINE TRANSLATIONS; MODERN STANDARDS; TEXT TO SPEECH;

SURVEYS;

EID: 84930155717     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324913000284     Document Type: Article

References (47)

1. Al-Azami, M. M. 2011. The History of the Qur'anic Text: From Revelation to Compilation, 2nd ed., pp. 123-9. Sherwoord Park, Alberta, Canada: Al-Qalam Publishing.
2. Alghamdi, M., Khursheed, M., Elshafei, M., Alhargan, F., Alkanhal, M., Alshamsan, A., Alqahtani, S., Muzaffar, Z., Altowim, Y., Yusuf, A., and Almuhtasib, H. 2006. Automatic Arabic text diacritizer. Technical Report CI.25.02, King Abdulaziz City for Science and Technology (KACST), Riyadh, Saudi Arabia.
3. Alghamdi, M., and Muzaffar, Z. 2007. KACST Arabic diacritizer. In Proceedings of the First International Symposium on Computers and Arabic Language, Riyadh, Saudi Arabia.
4. Alghamdi, M., Muzaffar, Z., and Alhakami, H. 2010. Automatic restoration of Arabic diacritics: a simple, purely statistical approach. Arabian Journal for Science and Engineering 35(2C): 125-35.
5. Ali, N. 1988. Arabic Language and Computer (in Arabic). Cairo, Egypt: Ta'reep.
6. Alotaiby, F., Alkharashi, I., and Foda, S. 2009. Processing large Arabic text corpora: preliminary analysis and results. In Proceedings of the 2nd International Conference on Arabic Language Resources and Tools, Cairo, Egypt, pp. 78-82.
7. Al-Sughaiyer, I., and Al-Kharashi, I. 2004. Arabic morphological analysis techniques: a comprehensive survey. Journal of American Society for Information Science and Technology 55(3): 189-213.
8. Ananthakrishnan, S., Narayanan, S., and Bangalore, S. 2005. Automatic diacritization of Arabic transcripts for automatic speech recognition. In Proceedings of the International Conference on Natural Language Processing (ICON-05), Kanpur, India.
9. Attia, M. 2000. A Large Scale Computational Processor of the Arabic Morphology and Applications (unpublished Master's thesis), Cairo University, Cairo, Egypt.
10. Attia, M. 2008. Handling Arabic Morphological and Syntactic Ambiguity within the LFG Framework with a View to Machine Translation (unpublished D.Sc thesis), University of Manchester, Manchester, UK.
11. Bahanshal, A., and Al-Khalifa, H. 2012. A first approach to the evaluation of Arabic diacritization systems. In Proceedings of the 7th International Conference on Digital Information Management (ICDIM 2012), Macau, China.
12. Bellamy, J. 1988. Two pre-Islamic Arabic inscriptions revised: Jabal Ramm and Umm Al-Jimal. Journal of the American Oriental Society 108(3): 369-72.
13. Buckwalter, T. 2004. Buckwalter Arabic Morphological Analyzer Version 2.0. Philadelphia, PA: Linguistic Data Consortium (LDC).
14. Central Intelligence Agency. 2008. World Factbook. Washington DC: CIA.
15. Debili, F., Achour, H., and Souissi, E. 2002. De l'etiquetage grammatical a la voyellation automatique de l'arabe. Technical Report, Correspondances de l'Institut de Recherche sur le Maghreb Contemporain 17.
16. Diab, M., Ghoneim, M., and Habash, N. 2007. Arabic diacritization in the context of statistical machine translation. In Proceedings of Machine Translation Summit XI(MTSummit), Copenhagen, Denmark.
17. El-Imam, Y. 2003. Phonetization of Arabic: rules and algorithms. Computer Speech and Language 18: 339-73.
18. Elshafei, E., Al-Muhtaseb, H., and Alghamdi, M. 2006. Statistical methods for automatic diacritization of Arabic text. In Proceedings of Saudi 18th National Computer Conference (NCC18), Riyadh, Saudi Arabia, pp. 301-6.
19. Emam, O., and Fisher, V. 2004. A hierarchical approach for the statistical vowelization of Arabic text. Technical Report, IBM patent led DE9-2004-0006, US Patent Application US2005/0192809 A1.
20. Farghaly, A., and Shaalan, K. 2009. Arabic natural language processing: challenges and solutions. ACM Transaction on Asian Language Information Processing 8(4): 1-22.
21. Gal, Y. 2002. An HMM approach to vowel restoration in Arabic and Hebrew. In Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages (SEMITIC '02), Philadelphia, PA, pp. 27-33.
22. Habash, N. 2010. Introduction to Arabic language processing. In G. Hirst (ed.), Synthesis Lectures on Human Language Technologies. San Rafael, CA: Morgan & Claypool.
23. Habash, N., and Rambow, O. 2007. Arabic diacritization through full morphological tagging. In Human Language Technologies: The Conference of the North American Chapter of the Association of Computational Linguistics (NAACL '07), Rochester, NY, pp. 53-6.
24. Habib, M. 2008. An Intelligent System for Automated Arabic Text Categorization (unpublished Master's thesis), Ain Shams University, Cairo, Egypt.
25. Hattab, A. M., and Hussain, A.K. 2012. Hybrid statistical and morpho-syntactical Arabic language diacritizing system. International Journal of Academic Research (Part A) 4(4): 51-6.
26. Hifny, Y. 2012a. Smoothing techniques for Arabic diacritics restoration. In Proceedings of the 12th Conference on Language Engineering (ESOLEC '12), Cairo, Egypt.
27. Hifny, Y. 2012b. Higher order n-gram language models for Arabic diacritics restoration. In Proceedings of the 12th Conference on Language Engineering (ESOLEC '12), Cairo, Egypt.
28. Ibn Mandhur. 2009. Lisan al-Arab, A. A. Haider and A. Ibrahim (eds.). Beirut, Lebanon: Dar al-Kutub al-Ilmiyah (in Arabic).
29. Kirchhoff, K., and Vergyri, D. 2005. Cross-dialectal data sharing for acoustic modeling in Arabic speech recognition. Speech Communication 46: 37-51.
30. Klinger, R., and Tomanek, K. 2007. Classical probabilistic models and conditional random fields. Technical Report TR07-2-013, Department of Computer Science, Dortmund University of Technology, Dortmund, Germany.
31. Liu, Y., Shriberg, E., Stolcke, A., and Harper, M. 2005. Comparing HMM, maximum entropy, and conditional random fields for disfluency detection. In Proceedings of European Conference on Speech Communication and Technology, Lisbon, Portugal, pp. 3313-6.
32. Maamouri, M., and Bies, A. 2010. The Penn Arabic treebank. In A. Farghaly (ed.), Arabic Computational Linguistics. Stanford, CA: CSLI.
33. Maamouri, M., Bies, A., and Kulick, S. 2006. Diacritization: a challenge to Arabic treebank annotation and parsing. In Proceedings of Arabic NLP/MT Conference, The British Computer Society, Natural Language Translation Specialist Group, London.
34. Manning, C., and Schtze, C. 1999. Foundations of Statistical Natural Language Processing, 2nd ed. Cambridge, MA: MIT Press.
35. Nelken, R., and Shieber, S. 2005. Arabic diacritization using weighted finite-state transducers. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages (SEMITIC '05), Ann Arbor, MI, pp. 79-86.
36. Rashwan, M., Al Badrashiny, M., Attia, M., Abdou, S., and Rafea, A. 2011. A stochastic Arabic diacritizer based on a hybrid of factorized and unfactorized textual features. IEEE Transaction on Audio, Speech, and Language Processing 19(1): 166-75.
37. Ryding, K. 2006. A Reference Grammar of Modern Standard Arabic. Cambridge, UK: Cambridge University Press.
38. Salton, G. 1989. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Reading, MA: Addison-Wesley.
39. Schlippe, T., Nguyen, T., and Vogel, S. 2008. Diacritization as a machine translation problem and as a sequence labeling problem. In Proceedings of the 8th Conference of the Association for Machine Translation in Americas (AMTA-2008), Waikiki, HI, pp. 192-201.
40. Shaalan, K. 2010. Rule-based approach in Arabic natural language processing. International Journal on Information and Communication Technologies (IJICT), Serial Publications 3(3): 11-9 (Special Issue on Advances in Arabic Language Processing).
41. Shaalan, K., Abo Bakr, H., and Ziedan, I. 2009. A hybrid approach for building Arabic diacritizer. In Proceedings of EACL 2009 Workshop on Computational Approaches to Semitic Language, Morristown, NJ, pp. 27-35.
42. Smrz, O. 2007. Functional Arabic Morphology: Formal System and Implementation (unpublished PhD thesis), Charles University in Prague, Prague, Czech Republic.
43. Van Gompel, M. 2008. Automatic Arabic Vocalisation. Tilberg, Netherlands: University of Tilburg.
44. Vergyri, D., and Kirchhoff, K. 2004. Automatic diacritization of Arabic for acoustic modeling in speech recognition. In Proceedings of the Workshop on Computational Approaches Arabic Script-Based Languages (SEMITIC '04), Stroudsburg, PA, pp. 66-73.
45. Wikipedia. n.d. Danish and Norwegian alphabet. Retreived March 17, 2013, from http://en.wikipedia.org/wiki/Danish and Norwegian alphabet.
46. Zerrouki, T. 2011. Tashkeela: Arabic vocalized text corpus. Retreived June 9, 2013, from http://aracorpus.e3rab.com/.
47. Zitouni, I., and Sarikaya, R. 2009. Arabic diacritic restoration approach based on maximum entropy models. Computer Speech and Language 23: 257-76.