Temporal kernel neural network language model

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8247-8251

  Shi, Yongzhe ^a   Zhang, Wei Qiang ^a   Cai, Meng ^a   Liu, Jia ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

language modeling; speech recognition; temporal kernel neural network

Indexed keywords

EXPONENTIAL KERNELS; LANGUAGE MODEL; LONG-TERM DEPENDENCIES; NETWORK LANGUAGE; STATISTICAL LANGUAGE MODELING; TEMPORAL KERNEL; VARIABLE LENGTH; WALL STREET JOURNAL;

NATURAL LANGUAGE PROCESSING SYSTEMS; RECURRENT NEURAL NETWORKS; SIGNAL PROCESSING; SPEECH RECOGNITION;

COMPUTATIONAL LINGUISTICS;

EID: 84890544019     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639273     Document Type: Conference Paper

References (14)

1. Yoshua Bengio, Rejean Ducharme, Pascal Vincent, and Christian Jauvin, "A neural probabilistic lan-guage model," Journal of Machine Learning Research (JMLR), pp. 1137-1155, 2003.
2. Andriy Mnih and Geoffrey Hinton, "Tree new graphical models for statistical langauge modelling," in Proc. of ICML, 2007, pp. 641-648.
3. Mikolov Tomas, Karafit Martin, Burget Lukas, Hanza Gernocky Jan, and Khudanpur Sanjeev, "Recur-rent neural network based language model," in Proc. of InterSpeech, 2010, vol. 2010, pp. 1045-1048.
4. Mikolov Tomas, Kombrink Stefan, Burget Lukas, Hanza Gernocky Jan, and Khudanpur Sanjeev, "Exten-sions of recurrent neural network language model," in Proc. of ICASSP, 2011.
5. Martin Sundermeyer, Ralf Schlter, and Hermann Ney, "LSTM neural networks for language modeling," in Proc. of InterSpeech, 2012.
6. Mikolov Tomas, Deoras Anoop, Kombrink Stefan, Bur-get Lukas, and Hanza Gernocky Jan, "Empirical evalu-ation and combination of advanced language modeling techniques," in Proc. of InterSpeech, 2011.
7. Tomas Mikolov, Statistical Language Models Based on Neural Netowrks, Ph.D. thesis, Brno University of Tech-nology (BUT), 2012, [Online] http://www.fit. vutbr.cz/imikolov/rnnlm/thesis.pdf.
8. Yoshua Bengio, Patrice Simard, and Paolo Frasconi, "Learning long-term dependencies with gradient de-scent is difficult," IEEE Transactions on Neural Net-works, vol. 5, no. 2, pp. 157-166, mar 1994.
9. Ilya Sutskever and Geoffrey E. Hinton, "Temporal-kernel recurrent neural networks," Neural Networks, vol. 23, pp. 239-243, 2010.
10. Bo-June(Paul)Hsu, "MIT Langauge Modeling Tookit," [Available] http://code.google.com/p/ mitlm.
11. Mikolov Tomas, Deoras Anoop, Kombrink Stefan, Bur-get Lukas, and Hanza Gernocky Jan, "Rnnlm -re-current neural network language modeling toolkit," in Proc. of ASRU, 2011, [Available] http://www.fit. vutbr.cz/imikolov/rnnlm/.
12. Keith Vertanen, "Baseline WSJ acoustic models for HTK and Sphinx: Training recipes and recognition ex-periments," Tech. Rep., 2006, [Available] http: //keithv.com/software/htk/us.
13. Steve Young, Gunnar Evermann, Mark Gales, Thomas Hain, Dan Kershaw, Xunying Liu, Gareth Moore, Julian Odell, Dave Ollason, Dan Povey, Valtcho Valtchev, and Phil Woodland, The HTK book, version 3.4.1, 2009.
14. "The CMU Pronouncing Dictionary Release 0.7a," 2007, [Available] http://www.speech.cs.cmu. edu/cgi-bin/cmudict.