Multi-basis adaptive neural network for rapid adaptation in speech recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4315-4319

  Wu, Chunyang ^a   Gales, Mark J F ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Adaptation; deep neural network; speech recognition

Indexed keywords

ACOUSTIC PROPERTIES; AUDIO SIGNAL PROCESSING; DEEP NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION;

ADAPTATION; ADAPTIVE NEURAL NETWORKS; AUTOMATIC SPEECH RECOGNITION SYSTEM; MULTI-LAYER PERCEPTION; NEURAL NETWORK CONFIGURATIONS; RESTRICTED CONNECTIVITY; SPEAKER INDEPENDENTS; UNSUPERVISED ADAPTATION;

SPEECH RECOGNITION;

EID: 84946054484     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178785     Document Type: Conference Paper

References (28)

1. George E Dahl, Dong Yu, Li Deng, and Alex Acero, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 30-42, 2012
2. Geoffrey Hinton et al., Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, 2012
3. Xie Chen, Adam Eversole, Gang Li, Dong Yu, and Frank Seide, Pipelined back-propagation for context-dependent deep neural networks., in INTERSPEECH, 2012
4. Yan Huang, Dong Yu, Chaojun Liu, and Yifan Gong, A comparative analytic study on the Gaussian mixture and context dependent deep neural network hidden markov models, Interspeech, 2014
5. Jean-Luc Gauvain and Chin-Hui Lee, Maximum a posteriori estimation for multivariate Gaussian mixture observations of markov chains, Speech and audio processing, ieee transactions on, vol. 2, no. 2, pp. 291-298, 1994
6. Christopher J Leggetter and Philip C Woodland, Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models, Computer Speech &Language, vol. 9, no. 2, pp. 171-185, 1995
7. Mark J.F.G., Maximum likelihood linear transformations for hmm-based speech recognition, Computer speech &language, vol. 12, no. 2, pp. 75-98, 1998
8. Jan Stadermann and Gerhard Rigoll, Two-stage speaker adaptation of hybrid tied-posterior acoustic models., in ICASSP (1), 2005, pp. 977-980
9. Xiao Li and Jeff Bilmes, Regularized adaptation of discriminative classifiers, in Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings. 2006 IEEE International Conference on. IEEE, 2006, vol. 1, pp. I-I
10. Dong Yu, Kaisheng Yao, Hang Su, Gang Li, and Frank Seide, Kl-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition, in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 7893-7897
11. Andrew Senior and Ignacio Lopez-Moreno, Improving dnn speaker independence with i-vector inputs, in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 225-229
12. George Saon, Hagen Soltau, David Nahamoo, and Michael Picheny, Speaker adaptation of neural network acoustic models using i-vectors, in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEEWorkshop on. IEEE, 2013, pp. 55-59
13. Jinyu Li, Jui-Ting Huang, and Yifan Gong, Factorized adaptation for deep neural network, in Proc. ICASSP, 2014
14. Ossama Abdel-Hamid and Hui Jiang, Fast speaker adaptation of hybrid nn/hmm model for speech recognition based on discriminative learning of speaker code, in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 7942-7946
15. Shaofei Xue, Ossama Abdel-Hamid, Hui Jiang, and Lirong Dai, Direct adaptation of hybrid dnn/hmm model for fast speaker adaptation in lvcsr based on speaker code, in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 6339-6343
16. Frank Seide, Gang Li, Xie Chen, and Dong Yu, Feature engineering in context-dependent deep neural networks for conversational speech transcription, in Automatic Speech Recognition and Understanding (ASRU), 2011 IEEE Workshop on. IEEE, 2011, pp. 24-29
17. Joao Neto, Luís Almeida, Mike Hochberg, Ciro Martins, Luís Nunes, Steve Renals, and Tony Robinson, Speaker-adaptation for hybrid hmm-ann continuous speech recognition system, 1995
18. Roberto Gemello, Franco Mana, Stefano Scanzio, Pietro Laface, and Renato De Mori, Linear hidden transformations for adaptation of hybrid ann/hmm models, Speech Communication, vol. 49, no. 10, pp. 827-835, 2007
19. Kaisheng Yao, Dong Yu, Frank Seide, Hang Su, Li Deng, and Yifan Gong, Adaptation of context-dependent deep neural networks for automatic speech recognition., in SLT, 2012, pp. 366-369
20. Bo Li and Khe Chai Sim, Comparison of discriminative input and output transformations for speaker adaptation in the hybrid nn/hmm systems., in INTERSPEECH, 2010, pp. 526-529
21. Sabato Marco Siniscalchi, Jinyu Li, and Chin-Hui Lee, Hermitian based hidden activation functions for adaptation of hybrid hmm/ann models., in INTERSPEECH, 2012
22. Tsubasa Ochiai, Shigeki Matsuda, Xugang Lu, Chiori Hori, and Shigeru Katagiri, Speaker adaptive training using deep neural networks, in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 6349-6353
23. Yajie Miao, Hao Zhang, and Florian Metze, Towards speaker adaptive training of deep neural network acoustic models, in Proc. Interspeech, 2014
24. Mark JF Gales, Cluster adaptive training of hidden markov models, Speech and Audio Processing, IEEE Transactions on, vol. 8, no. 4, pp. 417-428, 2000
25. Roland Kuhn, Patrick Nguyen, Jean-Claude Junqua, Lloyd Goldwasser, Nancy Niedzielski, Steven Fincke, Ken Field, and Matteo Contolini, Eigenvoices for speaker adaptation., in ICSLP, 1998, vol. 98, pp. 1774-1777
26. Forest Agostinelli, Michael R Anderson, and Honglak Lee, Adaptive multi-column deep neural networks with application to robust image denoising, in Advances in Neural Information Processing Systems, 2013, pp. 1493-1501
27. Nagendra Kumar and Andreas G Andreou, Investigation of silicon auditory models and generalization of linear discriminant analysis for improved speech recognition, Ph.D. thesis, Johns Hopkins University, 1997
28. Daniel Povey and Philip C Woodland, Minimum phone error and i-smoothing for improved discriminative training, in Acoustics, Speech, and Signal Processing (ICASSP), 2002 IEEE International Conference on. IEEE, 2002, vol. 1, pp. I-105