Diacritization as a machine translation problem and as a sequence labeling problem

AMTA 2008 - 8th Conference of the Association for Machine Translation in the Americas

Volumn , Issue , 2008, Pages

  Schlippe, Tim ^a   Nguyen, Thuy Linh ^b   Vogel, Stephan ^b  

^a UNIVERSITY OF KARLSRUHE   (Germany)

^b Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

A-MONOTONE; ARABIC TEXTS; CHARACTER-BASED MODELS; CONDITIONAL RANDOM FIELD; EMPIRICAL EXPERIMENTS; ERROR RATE; LANGUAGE MODEL; MACHINE TRANSLATIONS; RULE BASED; SEQUENCE LABELING; STATISTICAL MACHINE TRANSLATION; WORD ERROR RATE;

COMPUTATIONAL LINGUISTICS;

INFORMATION THEORY;

EID: 84858027046     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. T. Buckwalter. 2004. Arabic Morphological Analyzer version 2.0. LDC2004L02.
2. Mona Diab, Mahmoud Ghoneim, and Nizar Habash. 2007. Arabic Diacritization in the Context of Statistical Machine translation. In Proceedings of the MTSummit, Copenhagen, Denmark.
3. Yousif A. El-Imam. 2004. Phonetization of Arabic: Rules and Algorithms. Computer Speech and Language, 18(4).
4. Tarek A. El-Sadany and Mohamed A. Hashish. 1989. An Arabic Morphological System. IBM Systems Journal, 28(4).
5. Ossama Emam and Volker Fischer. 2005. Hierarchical Approach for the Statistical Vowelization of Arabic Text. Technical report, IBM Corporation Intellectual Property Law, Austin, TX, US.
6. Ya'akov Gal. 2002. An HMM Approach to Vowel Restoration in Arabic and Hebrew. In Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages, Philadelphia, PA, USA.
7. Nizar Habash and Owen Rambow. 2007. Arabic Diacritization through Full Morphological Tagging. In Proceedings of NAACL/HLT 2007. Companion Volume, Short Papers, Rochester, New York, April.
8. Philipp Koehn, Hieu Hoang, Alexandra Birch an Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar ad Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Annual Meeting of ACL, demonstration session, Prag, Czech Republic, June.
9. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the 18th ICML.
10. Mohamed Maamouri, Ann Bies, and Seth Kulick. 2006. Diacritization: A Challenge to Arabic Treebank Annotation and Parsing. In Proceedings of the British Computer Society Arabic NLP/MT Conference.
11. Rada Mihalcea. 2002. Diacritics Restoration: Learning from Letters versus Learning fromWords. In Proceedings of the 3rd CICLing, London, UK.
12. Husni Al-Muhtaseb Mustafa Elshafei and Mansour Alghamdi. 2006. Statistical Methods for Automatic Diacritization of Arabic Text. In Proceedings of the Saudi 18th National Computer Conference (NCC18), Riyadh, Saudi Arabia, March.
13. Rani Nelken and Stuart M. Shieber. 2005. Arabic Diacritization Using Weighted Finite-State Transducers. In Proceedings of the ACL 2005 Workshop On Computational Approaches To Semitic Languages, Ann Arbor, Michigan, USA.
14. Franz Josef Och and Hermann Ney. 2003. A Systematic Comparison of Various Statistical Alignment Models. Computational Linguistics, 29(1):19-51. (Pubitemid 37049767)
15. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th ACL, Philadelphia.
16. Michel Simard, Nicola Ueffing, Pierre Isabelle, and Roland Kuhn. 2007. Rule-Based Translation with Statistical Phrase-Based Post-Editing. In Proceedings of the Second Workshop on Statistical Machine Translation, Prague, Czech Republic, June.
17. Andreas Stolcke. 2002. SRILM - an Extensible Language Modeling Toolkit. In International Conference on Spoken Language Processing, Denver, USA.
18. Kristina Toutanova and Christopher D. Manning. 2000. Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech Tagger. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-2000), Hong Kong.
19. Dan Tufis and Adrian Chitu. 1999. Automatic Diacritics Insertion in Romanian Texts. In Proceedings of COMPLEX' 99 International Conference on Computational Lexicography, Pecs, Hungary, June.
20. Dimitra Vergyri and Katrin Kirchhoff. 2004. Automatic Diacritization of Arabic for Acoustic Modeling in Speech Recognition. In COLING 2004 Computational Approaches to Arabic Script-based Languages, Geneva, Switzerland, August 28th.
21. Stephan Vogel, Ying Zhang, Fei Huang, Alicia Tribble, Ashish Venugopal, Bing Zhao, and Alex Waibel. 2003. The CMU Statistical Machine Translation System. In Proceedings of MT-Summit IX, New Orleans, Louisiana, USA, September.
22. Ying Zhang. 2006. SALM: Suffix Array and its Applications in Empirical Language Processing. Technical Report CMU-LTI-06-010, LTI, Carnegie Mellon University, Pittsburgh PA, USA.
23. Imed Zitouni, Jeffrey S. Sorensen, and Ruhi Sarikaya. 2006. Maximum Entropy Based Restoration of Arabic Diacritics. In Proceedings of the 44th Annual Meeting of the ACL, Sydney, Australia, July.