Morpheme-based feature-rich language models using Deep Neural Networks for LVCSR of Egyptian Arabic

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8435-8439

  El Desoky Mousa, Amr ^a   Kuo, Hong Kwang Jeff ^b   Mangu, Lidia ^b   Soltau, Hagen ^b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

deep neural network; Egyptian Arabic; feature rich; language model; morpheme

Indexed keywords

DEEP NEURAL NETWORKS; EGYPTIANS; FEATURE-RICH; LANGUAGE MODEL; MORPHEME;

COMPUTATIONAL LINGUISTICS; CONTINUOUS SPEECH RECOGNITION; SIGNAL PROCESSING;

NEURAL NETWORKS;

EID: 84890497515     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639311     Document Type: Conference Paper

References (19)

1. G. Choueiter, D. Povey, S. Chen, and G. Zweig, "Morpheme-based language modeling for Arabic LVCSR," in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 1, Toulouse, France, May 2006, pp. 1053-1056.
2. M. Creutz, "Induction of the morphology of natural language: Unsupervised morpheme segmentation with application to automatic speech recognition," Ph.D. dissertation, Helsinki Univ. of Technology, Finland, 2006.
3. L. Lamel, A. Messaoudi, and J. Gauvain, "Investigating morphological decomposition for transcription of Arabic broadcast news and broadcast conversation data," in Interspeech, vol. 1, Brisbane, Australia, Sep. 2008, pp. 1429-1432.
4. N. Habash and O. Rambow, "Arabic diacritization through full morphological tagging," in Proc. Human Language Technology Conf. of the North American Chapter of the ACL, vol. Companion, Rochester, NY, USA, Apr. 2007, pp. 53-56.
5. A. El-Desoky, C. Gollan, D. Rybach, R. Schluter, and H. Ney, "Investigating the use of morphological decomposition and diacritization for improving Arabic LVCSR," in Interspeech, Brighton, UK, Sep. 2009, pp. 2679-2682.
6. G. Maltese, P. Bravetti, H. Crepy, B. Grainger, M. Herzog, and F. Palou, "Combining word-and class-based language models: A comparative study in several languages using automatic and manual word-clustering techniques," in Proc. European Conf. on Speech Communication and Technology, Aalborg, Denmark, Sep. 2001, pp. 21-24.
7. T. Matsuzaki, Y. Miyao, and J. Tsujii, "An efficient clustering algorithm for class-based language models," in Proc. Human Language Technology Conf. of the North American Chapter of the ACL, vol. 4, Edmonton, Canada, May 2003, pp. 119-126.
8. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," in Proc. Annual Meeting of the Association for Computational Linguistics, ser. ACL 96. Stroudsburg, PA, USA: Association for Computational Linguistics, 1996, pp. 310-318.
9. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin, "A neural probabilistic language model," Journal of Machine Learning Research, vol. 3, pp. 1137-1155, Mar. 2003.
10. H. Schwenk, "Continuous space language models," Computer Speech and Language, vol. 21, no. 3, pp. 492-518, Jul. 2007.
11. A. Mohamed, G. Dahl, and G. E. Hinton, "Deep belief networks for phone recognition," in NIPS Workshop on Deep Learning for Speech Recognition and Related Applications, Whistler, BC, Canada, 2009.
12. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop, Honolulu, Hawaii, USA, Dec. 2011, pp. 24-29.
13. E. Arisoy, T. Sainath, B. Kingsbury, and B. Ramabhadran, "Deep neural network language models," in NAACL-HLT 2012 Workshop: Will We Ever Really Replace the N-gram Model? On the Future of Language Modeling for HLT, Montreal, Canada, Jun. 2012, pp. 20-28.
14. A. Alexandrescu and K. Kirchhoff, "Factored neural language models," in Proc. Human Language Technology Conf. of the North American Chapter of the ACL, ser. NAACL-Short 06. Stroudsburg, PA, USA: Association for Computational Linguistics, 2006, pp. 1-4.
15. M. Shaik, A. El-Desoky, R. Schluter, and H. Ney, "Using Morpheme and Syllable Based Sub-words for Polish LVCSR," in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, Prague, Czech Republic, May 2011, pp. 4680-4683.
16. H. Schwenk and J. Gauvain, "Training neural network language models on very large corpora," in Proc. of the Conf. on Human Language Technology and Empirical Methods in Natural Language Processing, ser. HLT 05. Stroudsburg, PA, USA: Association for Computational Linguistics, 2005, pp. 201-208.
17. Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, Jan. 2009.
18. T. Sainath, B. Kingsbury, and B. Ramabhadran, "Improvements in using deep belief networks for large vocabulary continuous speech recognition," IBM, Speech and Language Algorithms Group, Tech. Rep., 2012.
19. N. Parihar and J. Picone, "DSR Front End LVCSR Evaluation -AU/384/02," Aurora Working Group, European Telecommunications Standards Institute, France, Tech. Rep., Dec. 2002.