Standalone training of context-dependent deep neural network acoustic models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 5597-5601

  Zhang, C ^a   Woodland, P C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; ITERATIVE METHODS; SPEECH RECOGNITION;

CONTEXT DEPENDENT; CONTEXT INDEPENDENT; DECISION TREE BASED STATE TYING; DEEP NEURAL NETWORKS; GAUSSIAN MIXTURE MODEL; HIDDEN MARKOV MODELS (HMMS); OUTPUT DISTRIBUTION; WALL STREET JOURNAL;

SIGNAL PROCESSING;

EID: 84905222971     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854674     Document Type: Conference Paper

References (22)

1. D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Volume 1: Foundations, MIT Press, Cambridge, MA, USA, Jul. 1986.
2. H. A. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer Academic Publishers, Norwell, MA, USA, 1993.
3. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks," in Proc. Interspeech'11, Florence, Italy, Sep. 2011, pp. 437-440.
4. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 30-42, Jan. 2012.
5. G. E. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kinsbury, "Deep neural networks for acoustic modeling in speech recognition," IEEE Signal Processing Magazine, pp. 2-17, Nov. 2012.
6. M. L. Seltzer, D. Yu, and Y.-Q. Wang, "An investigation of deep neural networks for noise robust speech recognition," in Proc. ICASSP'13, Vancouver, Canada, 2013, pp. 7398-7402.
7. S. Thomas, M. L. Seltzer, K. Church, and H. Hermansky, "Deep neural network features and semi-supervised training for low resource speech recognition," in Proc. ICASSP'13, Vancouver, Canada, 2013, pp. 6704-6708.
8. P. Bell, P. Swietojanski, and S. Renals, "Multi-level adaptive networks in tandem and hybrid ASR systems," in Proc. ICASSP'13, Vancouver, Canada, 2013, pp. 7947-7951.
9. K. M. Knill, M. J. F. Gales, S. P. Rath, P. C. Woodland, C. Zhang, and S.-X. Zhang, "Investigation of multilingual deep neural networks for spoken term detection," in Proc. ASRU'13, Olomouc, Czech Republic, 2013, pp. 138-143.
10. Y.-H. Yan, M. Fanty, and R. Cole, "Speech recognition using neural networks with forward-backward probability generated targets," in Proc. ICASSP'97, Munich, Germany, 1997, pp. 3241-3244.
11. S. J. Young, J. J. Odell, and P. C. Woodland, "Tree-based state tying for high accuracy acoustic modelling," in Proc. Human Language Technology Workshop, Plainsboro, NJ, USA, 1994, pp. 307-312.
12. P. C. Woodland, J. J. Odell, V. Valtchev, and S. J. Young, "Large vocabulary continuous speech recognition using HTK," in Proc. ICASSP'94, Adelaide, Australia, 1994, vol. 2, pp. 125-128.
13. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Oxford, UK, Nov. 1995.
14. S. J. Young, G. Evermann, M. J. F. Gales, T. Hain., D. Kershaw, X.-Y. Liu, G. Moore, J. J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, The HTK book (for HTK version 3.4), Cambridge University Engineering Department, Cambridge, UK, 2006.
15. E. Trentin and M. Gori, "Robust combination of neural networks and hidden Markov models for speech recognition," IEEE Transactions on Neural Networks, vol. 14, no. 6, pp. 1519-1531, Nov. 2003.
16. F. Seide, G. Li, X. Chen, and Y. Dong, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proc. ASRU'11, Waikoloa, HI, USA, 2011, pp. 24-29.
17. P. C. Woodland, C. J. Leggetter, J. J. Odell, V. Valtchev, and S. J. Young, "The 1994 HTK large vocabulary speech recognition system," in Proc. ICASSP'95, Detroit, MI, USA, 1995, vol. 1, pp. 73-76.
18. N. Kumar, Investigation of silicon-auditory models and generalization of linear discriminant analysis for improved speech recognition, Ph.D. thesis, John Hopkins University, Baltimore, MD, USA, 1997.
19. X.-Y. Liu, M. J. F. Gales, and P. C. Woodland, "Automatic complexity control for HLDA systems," in Proc. ICASSP'03, Hong Kong, Hong Kong, Apr. 2003, vol. 1, pp. 132-135.
20. D. Povey and P. C. Woodland, "Minimum phone error and I-smoothing for improved discriminative training," in Proc. ICASSP'02, Orlando, FL, USA, 2002, vol. 1, pp. 105-108.
21. D. Johnson, "QuickNet," www1.icsi.berkeley.edu/ speech/qn.html.
22. D. Povey, Discriminative Training for Large Vocabulary Speech Recognition, Ph.D. thesis, Cambridge University Engineering Department, Cambridge, UK, 2003.