Arabic diacritic restoration approach based on maximum entropy models

Computer Speech and Language

Volumn 23, Issue 3, 2009, Pages 257-276

  Zitouni, Imed ^a   Sarikaya, Ruhi ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Arabic diacritic restoration; Finite state transducer; Maximum entropy; Vowelization

Indexed keywords

ENTROPY; PIEZOELECTRIC TRANSDUCERS; RESTORATION;

ARABIC DIACRITIC RESTORATION; ARABIC SCRIPTS; ARABIC TEXTS; ERROR RATES; FEATURE TYPES; FINITE STATE TRANSDUCER; MAXIMUM ENTROPY; MAXIMUM ENTROPY MODELS; MODERN STANDARDS; PART OF SPEECH; SEGMENT-BASED; TREEBANK; VOWELIZATION; WORD ERROR RATES;

COLLEGE BUILDINGS;

EID: 62249192844     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2008.06.001     Document Type: Article

References (32)

1. Afify, M., Abdou, S., Makhoul, J., Nguyen, L., Xiang, B., 2004. The BBN RT04 BN Arabic System. In: RT04 Workshop, Palisades, NY.
2. Afify, M., Sarikaya, R., Kuo, H.-K.J., Besacier, L., Gao, Y., 2006. On the use of morphological analysis for dialectal arabic speech recognition. In: InterSpeech06. Pittsburg, PA, USA (September).
3. Berger A., Della Pietra S., and Della Pietra V. A maximum entropy approach to natural language processing. Computational Linguistics 22 1 (1996) 39-71
4. Buckwalter, T., 2002. Buckwalter Arabic morphological analyzer version 1.0. Technical Report, Linguistic Data Consortium, LDC2002L49 and ISBN 1-58563-257-0.
5. Stanley Chen, Ronald Rosenfeld, 2000. A survey of smoothing techniques for me models. IEEE Transactions on Speech and Audio Processing.
6. Chen S.F., and Goodman J. An empirical study of smoothing techniques for language modeling computer speech and language. Computer Speech and Language 4 13 (1999) 359-393
7. Darroch J.N., and Ratcliff D. Generalized iterative scaling for log-linear models. The Annals of Mathematical Statistics 43 5 (1972) 1470-1480
8. Debili, F., Achour, H., Souissi, E., 2002. De l'etiquetage grammatical a' la voyellation automatique de l'arabe. Technical Report, Correspondances de l'Institut de Recherche sur le Maghreb Contemporain 17.
9. El-Imam Y. Phonetization of arabic: rules and algorithms. Computer Speech and Language 18 (2003) 339-373
10. El-Sadany, T., Hashish, M., 1988. Semi-automatic vowelization of Arabic verbs. In: 10th NC Conference, Jeddah, Saudi Arabia.
11. Emam, O., Fisher, V., 2004. A hierarchical approach for the statistical vowelization of Arabic text. Technical Report, IBM patent filed, DE9-2004-0006, US Patent Application US2005/0192809 A1.
12. Florian, R., Hassan, H., Ittycheriah, A., Jing, H., Kambhatla, N., Luo, X., Nicolov, N., Roukos, S., 2004. A statistical model for multilingual entity detection and tracking. In: Proceedings of HLT-NAACL 2004, pp. 1-8.
13. Gal, Y., 2002. An HMM approach to vowel restoration in Arabic and Hebrew. In: ACL-02 Workshop on Computational Approaches to Semitic Languages.
14. Goodman, Joshua, 2002. Sequential conditional generalized iterative scaling. In: Proceedings of ACL'02.
15. Goodman J. Exponential priors for maximum entropy models. In: Marcu Susan Dumais D., and Roukos S. (Eds). HLT-NAACL 2004. Main Proceedings (2004), Association for Computational Linguistics, Boston, Massachusetts, USA 305-312
16. Habash, Nizar, Rambow, Owen., 2007. Arabic diacritization through full morphological tagging. In: The Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2007). Companion Volume, Short Papers. Rochester, NY, USA, April.
17. Kazama, Jun'ichi, Tsujii, Jun'ichi., 2003. Evaluation and extension of maximum entropy models with inequality constraints. In: Collins, Michael, Steedman, Mark, (Eds.), Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pp. 137-144.
18. Khudanpur, Sanjeev, 1995. A method of maximum entropy estimation with relaxed constraints. In: 1995 Johns Hopkins University Language Modeling Workshop.
19. Kirchhoff K., and Vergyri D. Cross-dialectal data sharing for acoustic modeling in Arabic speech recognition. Speech Communication 46 1 (2005) 37-51
20. Lafferty, John, McCallum, Andrew, Pereira, Fernando, 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: ICML.
21. Lee, Y.-S., Papineni, K., Roukos, S., Emam, O., Hassan, H., 2003. Language model based Arabic word segmentation. In: Proceedings of the ACL'03, pp. 399-406.
22. Littlestone N. Learning quickly when irrelevant attributes abound: a new linearthreshold algorithm. Machine Learning 2 (1988) 285-318
23. Liu D.C., and Nocedal J. On the limited memory BFGS method for large scale optimization. Mathematical Programming 45 3 Ser. B (1989) 503-528
24. McCallum, Andrew, Freitag, Dayne, Pereira, Fernando, 2000. Maximum entropy markov models for information extraction and segmentation. In: ICML.
25. Nelken, Rani, Shieber, Stuart M., 2005. Arabic diacritization using weighted finite-state transducers. In: ACL-05 Workshop on Computational Approaches to Semitic Languages, Ann Arbor, Michigan, pp. 79-86.
26. Ratnaparkhi, Adwait., 1996. A maximum entropy model for part-of-speech tagging. In: Conference on Empirical Methods in Natural Language Processing.
27. Sarikaya, Ruhi, Emam, Ossama, Zitouni, Imed, Gao, Yuqing, 2006. Maximum entropy modeling for diacritization of arabic text. In: InterSpeech06, Pittsburg, PA, USA.
28. Tayli M., and Al-Salamah A. Building bilingual microcomputer systems. Communications of the ACM 33 5 (1990) 495-505
29. Vergyri, D., Kirchhoff, K., 2004. Automatic diacritization of Arabic for acoustic modeling in speech recognition. In: COLING Workshop on Arabic-script Based Languages, Geneva.
30. Zhang T., Damerau F., and Johnson D.E. Text chunking based on a generalization of Winnow. Journal of Machine Learning Research 2 (2002) 615-637
31. Zitouni, Imed, Sorensen, Jeff, Luo, Xiaoqiang, Florian, Radu, 2005. The impact of morphological stemming on Arabic mention detection and coreference resolution. In: Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages, Ann Arbor, pp. 63-70.
32. Zitouni, Imed, Sorensen, Jeffrey S., Sarikaya, Ruhi, 2006. Maximum entropy based restoration of arabic diacritics. In: COLING/ACL 2006, Sydney, Australia.