Efficient training of large neural networks for language modeling

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn 4, Issue , 2004, Pages 3059-3064

  Schwenk, Holger ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

LANGUAGE MODELING; LANGUAGE MODELS (LM); LATTICE RESCORING; SPEECH RECOGNIZERS;

DATA REDUCTION; ERROR ANALYSIS; INTERPOLATION; MATHEMATICAL MODELS; PROBABILITY DENSITY FUNCTION; PROBLEM SOLVING; SPEECH RECOGNITION;

NEURAL NETWORKS;

EID: 10944267136     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2004.1381158     Document Type: Conference Paper

References (14)

1. S. F. Chen and J. T. Goodman, "An empirical study of smoothing techniques for language modeling," Computer Speech & Language, vol. 13, no. 4, pp. 359-394, 1999.
2. Y. Bengio and R. Ducharme, "A neural probabilistic language model," in Advances in Neural Information Processing Systems, vol. 13. Morgan Kaufmann, 2001.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model," Journal of Machine Learning Research, vol. 3, no. 2, pp. 1137-1155, 2003.
4. H. Schwenk and J.-L. Gauvain, "Connectionist language modeling for large vocabulary continuous speech recognition," in International Conference on Acoustics, Speech, and Signal Processing, 2002, pp. I: 765-768.
5. _, "Using Continuous Space Language Models for Conversational Speech Recognition," in ISCA & IEEE Workshop on Spontaneous Speech Processing and Recognition, Tokyo, April 2003.
6. A. Emami, P. Xu, and F. Jelinek, "Using a Connectionist model in a syntactical based language model," in International Conference on Acoustics, Speech, and Signal Processing, 2003, pp. I:272-375.
7. A. Lee, J. Fiscus, J. Garofolo, M. Przybocki, A. Martin, G. Sanders, and D. Pallett, "Spring speech-to-text transcription evaluation results," in Rich Transcription Workshop, Boston, May 19 2003.
8. R. Iyer and M. Ostendorf, "Relevance weighting for combining multi-domain data for n-gram language modeling," Computer Speech & Language, vol. 13, no. 3, pp. 267-282, 1999.
9. J.-L. Gauvain, L. Lamel, H. Schwenk, G. Adda, L. Chen, and F. Lefèvre, "Conversational telephone speech recognition," in International Conference on Acoustics, Speech, and Signal Processing, 2003, pp. I:212-215.
10. A. Stolcke, "SRILM - an extensible language modeling toolkit," in International Conference on Speech and Language Processing, 2002, pp. II: 901-904.
11. J. Bilmes, K. Asanovic, C.-W. Chin, and J. Demmel, "Using phipac to speed error back-propagation learning," in International Conference on Acoustics, Speech, and Signal Processing, 1997, pp. V:4153-4156.
12. Intel's MKL, "Intel math kernel library, http://www.intel.com/ software/products/mkl/."
13. ATLAS, "Automatically tuned linear algebra software, http://www.netlib.org/atlas."
14. Y. Bengio and J.-S. Sénécal, "Quick training of probabilistic neural nets by importance sampling," in AISTATS Conference, 2003.