Joint Morphological-lexical language modeling for processing morphologically rich languages with application to dialectal Arabic

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 7, 2008, Pages 1330-1339

  Sarikaya, Ruhi ^a   Afify, Mohamed ^b   Deng, Yonggang ^a   Erdogan, Hakan ^c   Gao, Yuqing ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Ministry of Communications and Information Technology Egypt   (Egypt)

^c SABANCI UNIVERSITY   (Turkey)

Author keywords

Joint modeling; Language modeling; Maximum entropy modeling; Morphological analysis

Indexed keywords

INFORMATION SOURCES; JOINT MODELING; JOINT MODELS; LANGUAGE MODEL; LANGUAGE MODELING; LEXICAL ITEMS; MACHINE TRANSLATIONS; MAXIMUM ENTROPY MODELING; MORPHOLOGICAL ANALYSIS; PREDICTIVE POWER; PROBABILITY ESTIMATE;

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; INFORMATION THEORY; MORPHOLOGY; NATURAL LANGUAGE PROCESSING SYSTEMS; PARAMETER ESTIMATION; QUERY LANGUAGES; SPEECH RECOGNITION; SPEECH TRANSMISSION;

TRANSLATION (LANGUAGES);

EID: 70350433083     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.924591     Document Type: Article

References (35)

1. A. Ghaoui, F. Yvon, C. Mokbel, and G. Chollet, "On the use of morphological constraints in N-gram statistical language model, " in Proc. Interspeech'05, Lisbon, Portugal, 2005, pp. 1281-1284.
2. B. Xiang, K. Nguyen, L. Nguyen, R. Schwartz, and J. Makhoul, "Morphological decomposition for Arabic broadcast news transcription, " in Proc. ICASSP'06, Toulouse, France, 2006, pp. I-1089-I-1092.
3. G. Choueiter, D. Povey, S. F. Chen, and G. Zweig, "Morpheme-based language modeling for Arabic LVCSR, " in Proc. ICASSP'06, Toulouse, France, 2006, pp. I-1053-I-1056.
4. M. Afify, R. Sarikaya, H.-K. J. Kuo, L. Besacier, and Y. Gao, "On the use of morphological analysis for dialectal arabic speech recognition, " in Proc. Interspeech'06, Pittsburgh, PA, 2006, pp. 277-280.
5. K. Kirchhoff, D. Vergyri, K. Duh, J. Bilmes, and A. Stolcke, "Morphology- based language modeling for Arabic speech recognition, " Comput. Speech Lang., vol. 20, no. 4, pp. 589-608, 2006.
6. T. Buckwalter, Buckwalter Arabic Morphological Analyzer Version 1.0. 2002, LDC2002L49 and ISBN 1-58563-257-0.
7. S. Khudanpur and J.Wu, "Maximum entropy techniques for exploiting syntactic, semantic and collocational dependencies in language modeling, " Comput. Speech Lang., vol. 14, no. 4, pp. 355-372, 2000.
8. H. Erdogan, R. Sarikaya, S. F. Chen, Y. Gao, and M. Picheny, "Using semantic analysis to improve speech recognition performance, " Comp. Speech Lang., vol. 19, no. 3, pp. 321-343, Jul. 2005.
9. S. F. Chen and R. Rosenfeld, "A survey of smoothing techniques for ME models, " IEEE Trans. Speech Audio Process, vol. 8, no. 1, pp. 37-50, Jan. 2000.
10. Y. Gao, L. Gu, B. Zhou, R. Sarikaya, H.-K. Kuo, A.-V. I. Rosti, M. Afify, and W. Zhu, "IBM MASTOR: Multilingual automatic speech-to-speech translator, " in Proc. ICASSP'06, Toulouse, France, 2006, pp. I-1205-I-1208.
11. S. Vogel, H. Ney, and C. Tillmann, "HMM-based word alignment in statistical translation, " in Proc. COLING-96, Copenhagen, Denmark, Aug. 1996, pp. 836-841.
12. A. Berger, S. D. Pietra, and V. D. Pietra, "A maximum entropy approach to natural language processing, " Comput. Linguist., vol. 22, no. 1, pp. 39-71, Mar. 1996.
13. R. Rosenfeld, S. F. Chen, and X. Zhu, "Whole sentence exponential language models: A vehicle for linguistic-statistical integration, " Comput. Speech Lang., vol. 15, no. 1, pp. 55-73, 2001.
14. K. Kirchhoff and M.Yang, "Improved language modeling for statistical machine translation, " in Proc. ACL'05 Workshop Building and Using Parallel Text, 2005, pp. 125-128.
15. P. Koehn, F. J. Och, and D. Marcu, "Pharaoh: A beam search decoder for phrase based statistical machine translation models, " in Proc. 6th Conf. AMTA, 2004, pp. 115-124.
16. F. J. Och and H. Ney, "Discriminative training and maximum entropy models for statistical machine translation, " in Proc. ACL, 2002, pp. 295-302, Univ. of Pennsylvania.
17. F. J. Och and H. Ney, "A systematic comparison of various statistical alignment models, " Comp. Linguist., vol. 29, no. 1, pp. 9-51, 2003.
18. K. Papineni, S. Roukos, T.Ward, and W.-J. Zhu, "BLEU: A method for automatic evaluation of machine translation, " in Proc ACL'02, 2002, pp. 311-318.
19. P. Liang, B. Taskar, and D. Klein, "Alignment by agreement, " in Proc. HLT/NAACL, 2006, pp. 104-111.
20. R. Sarikaya, M. Afify, and Y. Gao, "Joint Morphological-Lexical Language Modeling (JMLLM) for Arabic, " in Proc. ICASSP'07, Honolulu, HI, 2007, pp. IV-181-IV-184.
21. R. Sarikaya and Y. Deng, "Joint morphological-lexical modeling for machine translation, " in Proc. HLT/NAACL'07, Rochester, NY, 2007, pp. 145-148.
22. R. Zens, E. Matusov, and H. Ney, "Improved word alignment using a symmetric lexicon model, " in Proc. COLING, 2004, pp. 36-42.
23. S. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling, " in Proc. ACL'96, Santa Cruz, CA, 1996, pp. 310-318.
24. P. Geutner, "Using morphology towards better large-vocabulary speech recognition systems, " in Proc. ICASSP'95, Detroit, MI, 1995, pp. I-445-I-448.
25. M. Kurimo et al., "Unlimited vocabulary speech recognition for agglutinative languages, " in Proc. HLT/NAACL, 2006, pp. 104-111.
26. O. W. Kwon and J. Park, "Korean large vocabulary continuous speech recognition with morpheme-based recognition units, " Speech Commun., vol. 39, pp. 287-300, 2003.
27. K. Toutanova and C. D. Manning, "Enriching the knowledge sources used in a maximum entropy part-of-speech tagger, " in Proc. Joint SIGDAT Conf. EMNLP/VLC, Hong Kong, 2000, pp. 63-70.
28. J. Zavrel and W. Daelemans, "Memory-based learning, " in ACL'97, Madrid, Spain, 1997, pp. 436-443.
29. R. Kneser and H. Ney, "Improved backing-off for m-gram language modeling, " in Proc. ICASSP'95, 1995, vol. 1, pp. 181-184.
30. E. Arisoy, H. Sak, and M. Saraclar, "Language modeling for automatic turkish broadcast news transcription, " in Interspeech'07, Antwerp, Belgium, 2007, pp. 2381-2384.
31. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1992.
32. M. Riley, E. Bocchieri, A. Ljolje, and M. Saraclar, "The AT&T 1x real-time Switchboard speech-to-text system, " in Proc. NIST RT'02 Workshop, 2002, pp. 21-24.
33. M. Afify, L. Nguyen, B. Xiang, S. Abdou, and J. Makhoul, "Recent progress in Arabic broadcast news transcription at BBN, " in Proc. Interspeech' 05, Lisbon, Portugal, 2005, pp. 1637-1640. (Pubitemid 43908392)
34. H. Erdogan, O. Buyuk, and K. Oflazer, "Incorporating language constraints in sub-word based speech recognition, " in Proc. IEEE ASRU Workshop, San Juan, Puerto Rico, Dec. 2005, pp. 98-103.
35. Chelba, Ciprian, Jelinek, and Frederick, "Structured language modeling, " Comput. Speech Lang., vol. 14, no. 4, pp. 283-332, 2000.