Semi-supervised DNN training in meeting recognition

2014 IEEE Workshop on Spoken Language Technology, SLT 2014 - Proceedings

Volumn , Issue , 2014, Pages 141-146

  Zhang, Pengyuan ^a   Liu, Yulan ^b   Hain, Thomas ^b  

^a IACAS   (China)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Confidence selection; Deep neural networks; Semi supervised acoustic model training

Indexed keywords

SPEECH RECOGNITION;

ACOUSTIC MODEL TRAININGS; CONFIDENCE SCORE; CONFIDENCE SELECTION; DEEP NEURAL NETWORKS; DISCRIMINATIVE MODELS; MEETING RECOGNITION; SEMI-SUPERVISED TRAININGS; UNSUPERVISED TRAINING;

DATA REDUCTION;

EID: 84946687643     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2014.7078564     Document Type: Conference Paper

References (17)

1. Lori Lamel, Jean-Luc Gauvain, and Gilles Adda, "Lightly supervised and unsupervised acoustic model training, " Computer Speech and Language, vol. 1 6, no. 1, pp. 1 1 5-1 29, 2002.
2. Scott Novotney and Richard Schwartz, "Analysis of low-resource acoustic model self-training, " 2009.
3. Samuel Thomas, Michael L Seltzer, Kenneth Church, and Hynek Hermansky, "Deep neural network features and semi-supervised training for low resource speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 20 1 3, pp. 6704-6708.
4. H. Y. Chan and P. e. Woodland, "Improving broadcast news transcription by lightly supervised discriminative training, " in Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on, May 2004, vol. 1, pp. 1-737-40 vol. l.
5. L. Chen, L. Lamel, and J. Gauvain, "Lightly supervised acoustic model training using consensus networks, " in Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on, May 2004, vol. 1, pp. 1-1 89-92 voU.
6. M. Gibson and T. Hain, "Correctness-adjusted unsupervised discriminative acoustic model adaptation, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 10, pp. 2648-2656, Dec 20 12.
7. F. Grezl, M. Karafiat, S. Kontar, and J. Cernocky, "Probabilistic and bottle-neck features for LVCSR of meetings, " in Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, 2007, vol. 4, pp. IV-757-IV-760.
8. H. Larochelle, Y. Bengio, 1. Louradour, and P. Lamblin, "Exploring strategies for training deep neural networks, " J. Mach. Learn. Res, vol. 10, pp. 1-40, June 2009.
9. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks, " in INTERSPEECH, 20 1 1, pp. 437-440.
10. P. Swietojanski, A. Ghoshal, and S. Renals, "Hybrid acoustic models for distant and multichannel large vocabulary speech recognition, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on, Dec 20 1 3, pp. 285-290.
11. Yulan Liu, Pengyuan Zhang, and Thomas Hain, "Using neural network front-ends on far field multiple microphones based speech recognition, " in ICASSP2014-Speech and Language Processing (ICASSP2014-SLTC), Florence, Italy, May 20 14.
12. Scott Novotney, Richard Schwartz, and Jeff Ma, "Unsupervised acoustic and language model training with small amounts of labelled data, " in Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on. IEEE, 2009, pp. 4297-4300.
13. Karel Vesely, Mirko Hannemann, and Lukas Burget, "Semi-supervised training of deep neural networks, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 20 1 3, pp. 267-272.
14. Frantisek Grzl and Martin Karafit, "Semi-supervised bootstrapping approach for neural network feature extractor training., " in ASRV. 20 1 3, pp. 470-475, IEEE.
15. H. Liao, E. McDermott, and A. Senior, "Large scale deep neural network acoustic modeling with semisupervised training data for YouTube video transcription, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on, Dec 20 1 3, pp. 368-373.
16. J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, 1. Kadlec, V. Karaiskos, W. Kraaij, M. Kronenthal, G. Lathoud, M. Lincoln, A. Lisowska, I. McCowan, W. Post, D. Reidsma, and P. Wellner, "The AMI meeting corpus : A pre-announcement, " vol. 3869, pp. 28-39, 2006.
17. Adam Janin, Don B aron, Jane Edwards, Dan Ellis, David Gelbart, Nelson Morgan, B arbara Peskin, Thilo Pfau, Elizabeth Shriberg, Andreas Stolcke, and Chuck Wooters, "The ICSI meeting corpus, " 2003, pp. 364-367.