Neural networks for distant speech recognition

2014 4th Joint Workshop on Hands-Free Speech Communication and Microphone Arrays, HSCMA 2014

Volumn , Issue , 2014, Pages 172-176

  Renals, Steve ^a   Swietojanski, Pawel ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

AMI corpus; beam forming; convolutional neural networks; distant speech recognition; ICSI corpus; maxout networks; meetings; rectifier unit

Indexed keywords

MARKOV PROCESSES; MICROPHONES; NEURAL NETWORKS; REVERBERATION; SIGNAL PROCESSING;

AMI CORPUS; CONVOLUTIONAL NEURAL NETWORK; DISTANT SPEECH RECOGNITION; ICSI CORPUS; MEETINGS; RECTIFIER UNIT;

SPEECH RECOGNITION;

EID: 84904512262     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HSCMA.2014.6843274     Document Type: Conference Paper

References (50)

1. M W?olfel and J McDonough, Distant Speech Recognition, Wiley, 2009.
2. D Van Compernolle,WMa, F Xie, and M Van Diest, "Speech recognition in noisy environments with the aid of microphone arrays," Speech Commun., vol. 9, pp. 433-442, 1990.
3. JE Adcock, Y Gotoh, DJ Mashao, and HF Silverman, "Microphonearray speech recognition via incremental MAP training," in Proc IEEE ICASSP, 1996, pp. 897-900.
4. M Omologo, M Matassoni, P Svaizer, and D Giuliani, "Microphone array based speech recognition with different talker-array positions," in Proc IEEE ICASSP, 1997, pp. 227-230.
5. M Lincoln, I McCowan, J Vepa, and HK Maganti, "The multi-channel Wall Street Journal audio visual corpus (MC-WSJ-AV): Specification and initial experiments," in Proc IEEE ASRU, 2005.
6. E Zwyssig, F Faubel, S Renals, and M Lincoln, "Recognition of overlapping speech using digital MEMS microphone arrays," in Proc IEEE ICASSP, 2013.
7. T Yoshioka, A Sehr,MDelcroix, K Kinoshita, R Maas, T Nakatani, and WKellermann, "Making machines understand us in reverberant rooms: Robustness against reverberation for automatic speech recognition.," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 114-126, 2012.
8. K Kumatani, J McDonough, and B Raj, "Microphone array processing for distant speech recognition: From close-talking microphones to farfield sensors," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 127-140, 2012.
9. A Janin, D Baron, J Edwards, D Ellis, D Gelbart, N Morgan, B Peskin, T Pfau, E Shriberg, A Stolcke, and C Wooters, "The ICSI meeting corpus," in Proc IEEE ICASSP, 2003, pp. I364-I367.
10. J Carletta, "Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus," Language Resources & Evaluation, vol. 41, pp. 181-190, 2007.
11. A Stolcke, X Anguera, K Boakye, O Cetin, A Janin, M Magimai-Doss, C Wooters, and J Zheng, "The SRI-ICSI Spring 2007 meeting and lecture recognition system," in Multimodal Technologies for Perception of Humans, R Stiefelhagen, R Bowers, and J Fiscus, Eds., number 4625 in LNCS, pp. 373-389. Springer, 2008.
12. T Hain, L Burget, J Dines, PN Garner, F Grezl, AE Hannani, M Huijbregts, M Karafiat, M Lincoln, and V Wan, "Transcribing meetings with the AMIDA systems," IEEE Trans. Audio, Speech, & Language Process., vol. 20, pp. 486-498, 2012.
13. D Povey and PC Woodland, "Minimum phone error and I-smoothing for improved discriminative training," in Proc IEEE ICASSP, 2002, pp. 105-108.
14. T Anastasakos, J McDonough, R Schwartz, and J Makhoul, "A compact model for speaker-adaptive training," in Proc ICSLP, 1996, pp. 1137-1140.
15. F Gre?zl, M Karafia?t, S Konta?r, and J Ci ernocky?, "Probabilistic and bottle-neck features for LVCSR of meetings," in Proc IEEE ICASSP, 2007, vol. 4, pp. IV-757-IV-760.
16. ML Seltzer, "Bridging the gap: Towards a unified framework for handsfree speech recognition using microphone arrays," in Proc HSCMA, 2008.
17. M Seltzer, B Raj, and R Stern, "Likelihood-maximizing beamforming for robust hands-free speech recognition," IEEE Trans. Speech, & Audio Process., vol. 12, pp. 489-498, 2004.
18. M Seltzer and R Stern, "Subband likelihood-maximizing beamforming for speech recognition in reverberant environments," IEEE Trans. Audio, Speech, & Lang. Process., vol. 14, pp. 2109-2121, 2006.
19. D Marino and T Hain, "An analysis of automatic speech recognition with multiple microphones," in Proc Interspeech, 2011, pp. 1281-1284.
20. G Hinton, L Deng, D Yu, GE Dahl, A-R Mohamed, N Jaitly, A Senior, V Vanhoucke, P Nguyen, TN Sainath, and B Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012.
21. H Bourlard and N Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer, 1994.
22. S Renals, N Morgan, H Bourlard, M Cohen, and H Franco, "Connectionist probability estimators in HMM speech recognition," IEEE Trans Speech & Audio Process., vol. 2, pp. 161-174, 1994.
23. N Morgan and H Bourlard, "Neural networks for statistical recognition of continuous speech," Proc IEEE, vol. 83, pp. 742-772, 1995.
24. AJ Robinson, GD Cook, DPW Ellis, E Fosler-Lussier, SJ Renals, and DAGWilliams, "Connectionist speech recognition of broadcast news," Speech Commun., vol. 37, pp. 27-45, 2002.
25. TN Sainath, B Kingsbury, B Ramabhadran, P Fousek, P Novak, and A Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in Proc IEEE ASRU, 2011.
26. GE Dahl, D Yu, L Deng, and A Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition," IEEE Trans Audio, Speech & Lang. Process., vol. 20, pp. 30-42, 2012.
27. P Swietojanski, A Ghoshal, and S Renals, "Hybrid acoustic models for distant and multichannel large vocabulary speech recognition," in Proc IEEE ASRU, 2013.
28. J Li, D Yu, J-T Huang, and Y Gong, "Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM," in Proc IEEE SLT, 2012, pp. 131-136.
29. MD Zeiler, M Ranzato, R Monga, M Mao, K Yang, QV Le, P Nguyen, A Senior, V Vanhoucke, J Dean, and GE Hinton, "On rectified linear units for speech processing," in Proc IEEE ICASSP, 2013.
30. M Cai, Y Shi, and J Liu, "Deep maxout neural networks for speech recognition," in Proc ASRU, 2013.
31. Y Miao, F Metze, and S Rawat, "Deep maxout networks for lowresource speech recognition," in Proc. IEEE ASRU, 2013.
32. P Swietojanski, J Li, and J-T Huang, "Investigation of maxout networks for speech recognition," in Proc IEEE ICASSP, 2014.
33. Y LeCun and Y Bengio, "Convolutional networks for images, speech and time series," in The Handbook of Brain Theory and Neural Networks, pp. 255-258. MIT Press, 1995.
34. O Abdel-Hamid, A-R Mohamed, J Hui, and G Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition," in Proc IEEE ICASSP, 2012, pp. 4277-4280.
35. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc IEEE, vol. 86, pp. 2278-2324, 1998.
36. TN Sainath, B Kingsbury, A Mohamed, GE Dahl, G Saon, H Soltau, T Beran, AY Aravkin, and B Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR," in Proc IEEE ASRU, 2013.
37. KJ Lang, AH Waibel, and GE Hinton, "A time-delay neural network architecture for isolated word recognition," Neural Networks, vol. 3, pp. 23-43, 1990.
38. V Nair and G Hinton, "Rectified linear units improve restricted Boltzmann machines," in Proc ICML, 2010, pp. 131-136.
39. IJ Goodfellow, D Warde-Farley, M Mirza, A Courville, and Y Bengio, "Maxout networks," in Proc ICML, 2013.
40. P Swietojanski, A Ghoshal, and S Renals, "Convolutional neural networks for distant speech recognition," IEEE Signal Process. Letters, 2014, To appear.
41. JG Fiscus, J Ajot, N Radde, and C Laprun, "Multiple dimension Levenshtein edit distance calculations for evaluating ASR systems during simultaneous speech," in Proc LREC, 2006.
42. D Povey, A Ghoshal, G Boulianne, L Burget, O Glembek, N Goel, M Hannemann, P Motlicek, Y Qian, P Schwarz, J Silovsk?y, G Stemmer, and K Vesel?y, "The Kaldi speech recognition toolkit," in Proc IEEE ASRU, 2011.
43. IJ Goodfellow, D Warde-Farley, P Lamblin, V Dumoulin, M Mirza, R Pascanu, J Bergstra, F Bastien, and Y Bengio, "Pylearn2: a machine learning research library," arXiv:1308.4214, 2013.
44. X Glorot and Y Bengio, "Understanding the difficulty of training deep feedforward neural networks," in Proc AISTATS, 2010.
45. G Hinton, S Osindero, and Y Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, pp. 1527-1554, 2006.
46. H Lee, P Pham, Y Largman, and A Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," in Proc NIPS 22, 2009, pp. 1096-1104.
47. Y Bengio, P Lamblin, D Popovici, and H Larochelle, "Greedy layerwise training of deep networks," in Proc NIPS 19, 2007, pp. 153-160.
48. D Povey, D Kanevsky, B Kingsbury, B Ramabhadran, G Saon, and K Visweswariah, "Boosted MMI for model and feature-space discriminative training," in Proc IEEE ICASSP, 2008, pp. 4057-4060.
49. MJF Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Trans Speech and Audio Process., vol. 7, pp. 272-281, 1999.
50. X Anguera, C Wooters, and J Hernando, "Acoustic beamforming for speaker diarization of meetings," IEEE Trans. Audio, Speech, & Lang. Process., vol. 15, pp. 2011-2021, 2007.