Differentiable pooling for unsupervised speaker adaptation

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4305-4309

  Swietojanski, Pawel ^a   Renals, Steve ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Deep Neural Networks; Differentiable pooling; LHUC; Speaker Adaptation; TED

Indexed keywords

DEEP NEURAL NETWORKS; SPEECH COMMUNICATION; SPEECH PROCESSING; SPEECH RECOGNITION;

DIFFERENTIABLE POOLING; LHUC; MODEL BASED NEURAL NETWORKS; SPEAKER ADAPTATION; SPEAKER ADAPTIVE TRAININGS; SPEAKER DEPENDENTS; SPEAKER INDEPENDENTS; UNSUPERVISED SPEAKER ADAPTATION;

AUDIO SIGNAL PROCESSING;

EID: 84946032695     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178783     Document Type: Conference Paper

References (41)

1. H Bourlard and N Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer Academic Publishers, 1994
2. S Renals, N Morgan, H Bourlard, M Cohen, and H Franco, "Connectionist probability estimators in HMM speech recognition" IEEE Trans Speech and Audio Processing, vol. 2, pp. 161-174, 1994
3. G Hinton, L Deng, D Yu, GE Dahl, A Mohamed, N Jaitly, A Senior, V Vanhoucke, P Nguyen, TN Sainath, and B Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups" Signal Processing Magazine,IEEE, vol. 29, no. 6, pp. 82-97, Nov 2012
4. J Neto, L Almeida, M Hochberg, C Martins, L Nunes, S Renals, and T Robinson, "Speaker adaptation for hybrid HMM-ANN continuous speech recognition system" in Proc Eurospeech, 1995, pp. 2171-2174
5. V Abrash, H Franco, A Sankar, and M Cohen, "Connectionist speaker normalization and adaptation" in Proc Eurospeech, 1995, pp. 21832186
6. F Seide, X Chen, and D Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription" in Proc IEEE ASRU, 2011
7. P Swietojanski, A Ghoshal, and S Renals, "Revisiting hybrid and GMM-HMM system combination techniques" in Proc IEEEICASSP, 2013
8. D Yu, K Yao, H Su, G Li, and F Seide, "KL-divergence regularized deep neural network adaptation for improved large vocabulary speech recognition." in Proc IEEE ICASSP, 2013, pp. 7893-7897
9. H Liao, "Speaker adaptation of context dependent deep neural networks." in In Proc. ICASSP. 2013, pp. 7947-7951, IEEE
10. MJF Gales, "Maximum likelihood linear transformations for HMM-based speech recognition" Computer Speech and Language, vol. 12, pp. 75-98, April 1998
11. P Bell, P Swietojanski, and S Renals, "Multi-level adaptive networks in tandem and hybrid ASR systems" in Proc IEEE ICASSP, 2013
12. N Dehak, PJ Kenny, R Dehak, P Dumouchel, and P Ouellet, "Front end factor analysis for speaker verification" IEEE Trans Audio, Speech and Language Processing, vol. 19, pp. 788-798, 2010
13. G Saon, H Soltau, D Nahamoo, and M Picheny, "Speaker adaptation of neural network acoustic models using i-vectors." in Proc IEEE ASRU, 2013, pp. 55-59
14. K Yao, D Yu, F Seide, H Su, L Deng, and Y Gong, "Adaptation of context-dependent deep neural networks for automatic speech recognition." in Proc IEEE SLT, 2012
15. SM Siniscalchi, J Li, and CH Lee, "Hermitian polynomial for speaker adaptation of connectionist speech recognition systems" IEEE Trans Audio, Speech,and Language Processing, vol. 21, pp. 2152-2161, 2013
16. JS Bridle and S Cox, "Recnorm: Simultaneous normalisation and classification applied to speech recognition" in Advances in Neural Information Processing Systems 3, 1990, pp. 234-240
17. O Abdel-Hamid and H Jiang, "Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code" in Proc IEEE ICASSP, 2013, pp. 4277-4280
18. J Xue, J Li, D Yu, M Seltzer, and Y Gong, "Singular value decomposition based low-footprint speaker adaptation and personalization for deep neural network" in Proc IEEE ICASSP, 2014
19. O Abdel-Hamid and H Jiang, "Rapid and effective speaker adaptation of convolutional neural network based models for speech recognition." in Proc. Interspeech. pp. 1248-1252, ISCA
20. P Swietojanski and S Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models" in Proc. IEEE SLT, 2014
21. K Fukushima and S Miyake, "Neocognitron: A new algoriothm for pattern recognition tolerant of deformations" Pattern Recognition, vol. 15, pp. 455-69, 1982
22. Y LeCun, B Boser, JS Denker, D Henderson, RE Howard, W Hub-bard, and LD Jackel, "Backpropagation applied to handwritten zip code recognition," Neural Computation, vol. 1, pp. 541-551, 1989
23. Y LeCun, L Bottou, Y Bengio, and P Haffner, "Gradient-based learning applied to document recognition" Proceedings of the IEEE, vol. 86, pp. 2278-2324, 1998
24. M Riesenhuber and T Poggio, "Hierarchical models of object recognition in cortex" Nature Neuroscience, vol. 2, pp. 1019-1025, 1999
25. MA Ranzato, FJ Huang, Y-L Boureau, and Y LeCun, "Unsuper-vised learning of invariant feature hierarchies with applications to object recognition" in IEEE CVPR, 2007
26. Y-L Boureau, J Ponce, and Y LeCun, "A theoretical analysis of feature pooling in visual recognition" in Proc ICML, 2010
27. IJ Goodfellow, D Warde-Farley, M Mirza, A Courville, and Y Bengio, "Maxout networks" arXiv:1302.4389, 2013
28. Y. Miao, F. Metze, and S. Rawat, "Deep maxout networks for low-resource speech recognition" in Proc. IEEE ASRU, 2013
29. M. Cai, Y. Shi, and J. Liu, "Deep maxout neural networks for speech recognition" in Proc. ASRU, Dec 2013, pp. 291-296
30. P Swietojanski, J Li, and J-T Huang, "Investigation of maxout networks for speech recognition" in Proc IEEE ICASSP, 2014
31. S Renals and P Swietojanski, "Neural networks for distant speech recognition" in Proc HSCMA, 2014
32. L Toth, "Convolutional deep maxout networks for phone recognition" in Proc Interspeech, 2014
33. M D Zeiler and R Fergus, "Differentiable pooling for hierarchical feature learning" CoRR, vol. abs/1207.0151, 2012
34. P Sermanet, S Chintala, and Y LeCun, "Convolutional neural networks applied to house numbers digit classification" CoRR, vol. abs/1204.3968, 2012
35. T N Sainath, B Kingsbury, A Mohamed, G E Dahl, G Saon, H Soltau, T Beran, A Y Aravkin, and B Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR," in In Proc. IEEE ASRU, 2013, pp. 315-320
36. X Zhang, J Trmal, D Povey, and S Khudanpur, "Improving deep neural network acoustic models using generalized maxout networks" in ICASSP,2014
37. Gulcehre K Cho, R Pascanu, and Y Bengio, "Learned-norm pooling for deep neural networks" CoRR, vol. abs/1311.1780, 2013
38. E Trentin, "Networks with trainable amplitude of activation functions" Neural Networs, vol. 14, pp. 471-W3, 2001
39. M Federico, M Cettolo, L Bentivogli, M Paul, and S StUker, "Overview of the IWSLT 2012 evaluation campaign" in Proc IWSLT, 2012
40. D Povey, A Ghoshal, G Boulianne, L Burget, O Glembek, N Goel, M Hannemann, P MotliCek, Y Qian, P Schwarz, J Silovsky, G Stem-mer, and K Vesely, "The Kaldi speech recognition toolkit" in Proc. IEEE ASRU, December 2011
41. IJ Goodfellow, D Warde-Farley, P Lamblin, V Dumoulin, M Mirza, R Pascanu, J Bergstra, F Bastien, and Y Bengio, "Pylearn2: a machine learning research library" arXivpreprintarXiv:1308.4214, 2013