Improved neural network based language modelling and adaptation

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 1041-1044

  Park, J ^a   Liu, X ^a   Gales, M J F ^a   Woodland, P C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Language model adaptation; Neural network language model

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONTINUOUS SPEECH RECOGNITION; MODELING LANGUAGES; SPEECH COMMUNICATION; SPEECH PROCESSING;

ADAPTATION METHODS; CASCADED NETWORKS; DISCRIMINATIVE POWER; IMPROVE PERFORMANCE; LANGUAGE MODEL ADAPTATION; LANGUAGE MODELLING; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; NETWORK LANGUAGE; GENERALISATION; LANGUAGE MODEL; NETWORK-BASED; NEURAL NETWORK LANGUAGE MODEL; NEURAL-NETWORKS;

NEURAL NETWORKS; SPEECH COMMUNICATION;

EID: 79959850026     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. S.M. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer", IEEE Trans. Acoustics, Speech and Signal Processing, Vol. 35, No. 3. 1987.
2. P.F. Brown et al., "Class-based n-gram models of natural language", Computational Linguistic, Vol. 18, No. 4, 1992, pp. 467-479.
3. A. Paccanaro and G.E. Hinton, "Extracting distributed representations of concepts and relations from positive and negative propositions", In Proc. IJCNN2000.
4. D. Mrva and P.C. Woodland, "A PLSA-based language model for conversational telephone speech", In Proc. Interspeech2004.
5. T. Brants, "Test data likelihood for PLSA models", Information Retrieval, Vol. 8, No. 2, 2005, pp. 181-196. (Pubitemid 40526280)
6. Y. Bengio et al., "A neural probabilistic language model", Journal of Machine Learning Research, Vol. 3, No. 2, 2001, pp. 1137-1155.
7. H. Schwenk and J-L. Gauvain, "Training neural network language models on very large corpora", In Proc. HLT/EMNLP2005.
8. G. Saon et al., "The IBM 2008 GALE Arabic speech transcription system", In Proc. ICASSP2010.
9. A. Emami and L. Mangu, "Empirical study of neural network language models of Arabic speech recognition", In Proc. ASRU2007.
10. M. Afify et al., "Gaussian mixture language models for speech recognition", In Proc. ICASSP2007.
11. R. Sarikaya et al., "Tied-mixture language modeling", In Proc. HLT/NAACL2009.
12. H. Schwenk, "Continuous space language models", Computer Speech and Language, Vol. 21, 2007, pp. 492-518. (Pubitemid 46367510)
13. J. Park, F. Diehl, M.J.F. Gales, M. Tomalin and P.C. Woodland, "Training and adapting MLP features for Arabic speech recognition", In Proc. ICASSP2009.
14. M. Tomalin, F. Diehl, M.J.F. Gales, J. Park and P.C. Woodland, "Recent improvements to the Cambridge Arabic Speech-to-Text systems", In Proc. ICASSP2010.
15. X. Liu, M.J.F. Gales, J.L. Hieronymus and P.C. Woodland, "Language model combination and adaptation using weighted finite state transducers", in Proc. ICASSP2010.