Convolutional neural networks for distant speech recognition

IEEE Signal Processing Letters

Volumn 21, Issue 9, 2014, Pages 1120-1124

  Swietojanski, Pawel ^a   Ghoshal, Arnab ^a,b   Renals, Steve ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b APPLE INC   (United States)

Author keywords

AMI corpus; convolutional neural networks; deep neural networks; distant speech recognition; meetings

Indexed keywords

CONVOLUTION; MICROPHONES; NEURAL NETWORKS; SPEECH RECOGNITION;

AMI CORPUS; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; DISTANT SPEECH RECOGNITION; MEETINGS;

SPACE DIVISION MULTIPLE ACCESS;

EID: 84901999583     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2014.2325781     Document Type: Article

References (43)

1. M. Wölfel and J. McDonough, Distant Speech Recognition. Hoboken, NJ, USA: Wiley, 2009
2. A. Stolcke, "Making the most from multiple microphones in meeting recognition," in Proc. IEEE ICASSP, 2011
3. K. Kumatani, J. McDonough, and B. Raj, "Microphone array processing for distant speech recognition: From close-talking microphones to far-field sensors," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 127-140, 2012
4. T. Hain, L. Burget, J. Dines, P. N. Garner, F. Grezl, A. E. Hannani, M. Huijbregts, M. Karafiat, M. Lincoln, and V. Wan, "Transcribing meetings with the AMIDA systems," in IEEE Trans. Audio, Speech, Lang. Process., 2012, vol. 20, no. 2, pp. 486-498
5. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012
6. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach. Norwell, MA, USA: Kluwer, 1994
7. S. Renals, N. Morgan, H. Bourlard, M. Cohen, and H. Franco, "Connectionist probability estimators in HMM speech recognition," IEEE Trans. Speech Audio Process., vol. 2, no. 1, pp. 161-174, 1994
8. N. Morgan and H. Bourlard, "Neural networks for statistical recognition of continuous speech," in Proc. IEEE, 1995, vol. 83, no. 5, pp. 742-772
9. A. J. Robinson, G. D. Cook, D. PW. Ellis, E. Fosler-Lussier, S. J. Renals, and D. AG. Williams, "Connectionist speech recognition of broadcast news," Speech Commun., vol. 37, no. 1-2, pp. 27-45, 2002 (Pubitemid 34222536)
10. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in Proc. IEEE ASRU, 2011
11. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pretrained deep neural networks for large-vocabulary speech recognition," IEEE Trans. Audio, Speech Lang. Process., vol. 20, no. 1, pp. 30-42, 2012
12. H. Hermansky, D. PW. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in Proc. IEEE ICASSP, 2000, pp. 1635-1638
13. Q. Zhu, A. Stolcke, B. Y. Chen, and N. Morgan, "Using MLP features in SRI's conversational speech recognition system," in Proc. Eurospeech, 2005
14. F. Grézl, M. Karafiát, S. Kontár, and J. Ernocký, "Probabilistic and bottle-neck features for LVCSR of meetings," Proc. IEEE ICASSP, vol. 4, pp. IV-757-IV-760, 2007 (Pubitemid 47178482)
15. T. N. Sainath, B. Kingsbury, and B. Ramabhadran, "Auto-encoder bottleneck features using deep belief networks," in Proc. IEEE ICASSP, 2012
16. P. Swietojanski, A. Ghoshal, and S. Renals, "Hybrid acoustic models for distant and multichannel large vocabulary speech recognition," in Proc. IEEE ASRU, Dec. 2013
17. J. Li, D. Yu, J.-T. Huang, and Y. Gong, "Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM," in Proc. IEEE SLT, 2012, pp. 131-136
18. Y. LeCun and Y. Bengio, "Convolutional networks for images, speech and time series," in The Handbook of Brain Theory and Neural Networks. Cambridge, MA, USA: MIT Press, 1995, pp. 255-258
19. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, 1998
20. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, "Phoneme recognition using time-delay neural networks," IEEE Trans. Audio, Speech Lang. Process., vol. 37, no. 3, pp. 328-339, 1989 (Pubitemid 19065785)
21. K. J. Lang, A. H. Waibel, and G. E. Hinton, "A time-delay neural network architecture for isolated word recognition," Neural Netw., vol. 3, no. 1, pp. 23-43, 1990
22. T. Zeppenfeld, R. Houghton, and A. Waibel, "Improving the MS-TDNN for word spotting," Proc. IEEE ICASSP, vol. 2, pp. 475-478, 1993
23. S. Sukittanon, A. C. Surendran, J. C. Platt, and C. JC. Burges, "Convolutional networks for speech detection," in Proc. ICSLP, 2004
24. D. Palaz, R. Collobert, and M. Magimai-Doss, "Estimating phoneme class conditional probabilities from raw speech signal using convolutional neural networks," in Proc. Interspeech, 2013
25. O. Abdel-Hamid,A.-R. Mohamed, J. Hui, and G. Penn, "Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition.," in Proc. IEEE ICASSP, 2012, pp. 4277-4280
26. T. N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for LVCSR," in Proc. IEEE ICASSP, 2013
27. T. N. Sainath, B. Kingsbury, A. Mohamed, G. E. Dahl, G. Saon, H. Soltau, T. Beran, A. Y. Aravkin, and B. Ramabhadran, "Improvements to deep convolutional neural networks for LVCSR," in Proc. IEEE ASRU, 2013
28. J. Carletta, "Unleashing the killer corpus: Experiences in creating the multi-everything AMI Meeting Corpus," Lang. Res. Eval. J., vol. 41, no. 2, pp. 181-190, 2007
29. M. D. Richard and R. P. Lippmann, "Neural network classifiers estimate Bayesian a posteriori probabilities," Neural Comput., vol. 3, no. 4, pp. 461-483, 1991
30. M. A. Ranzato, F. J. Huang, Y.-L. Boureau, and Y. LeCun, "Unsupervised learning of invariant feature hierarchies with applications to object recognition," in IEEE CVPR, 2007
31. "NumPy Reference," Mar. 2014 [Online]. Available: http://docs. scipy. org/doc/numpy/numpy-ref-1. 8. 1. pdf, [Online; accessed 27-March-2014]
32. O. Abdel-Hamid, L. Deng, and D. Yu, "Exploring convolutional neural network structures and optimisation techniques for speech recognition," in Proc. Interspeech, 2013, ICSA
33. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition in cortex," Nature Neurosci., vol. 2, pp. 1019-1025, 1999 (Pubitemid 30599567)
34. J. G. Fiscus, J. Ajot, N. Radde, and C. Laprun, "Multiple dimension Levenshtein edit distance calculations for evaluating ASR systems during simultaneous speech," in Proc. LREC, 2006
35. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlíek, Y. Qian, P. Schwarz, J. Silovský, G. Stemmer, and K. Veselý, "The Kaldi speech recognition toolkit," in Proc. IEEE ASRU, Dec. 2011
36. I. J. Goodfellow, D. Warde-Farley, P. Lamblin,V. Dumoulin,M. Mirza, R. Pascanu, J. Bergstra, F. Bastien, and Y. Bengio, "Pylearn2: A machine learning research library," arXiv preprint arXiv:1308. 4214 2013
37. C. Cieri, D. Miller, and K. Walker, "From switchboard to fisher: Telephone collection protocols, their uses and yields," in Proc. Eurospeech, 2003
38. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," Comput. Speech Lang., vol. 13, no. 4, pp. 359-393, 1999
39. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "BoostedMMI for model and feature-space discriminative training," in Proc. IEEE ICASSP, 2008, pp. 4057-4060
40. MJF Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 272-281, 1999
41. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, pp. 1527-1554, 2006 (Pubitemid 44024729)
42. X. Anguera, C. Wooters, and J. Hernando, "Acoustic beamforming for speaker diarization of meetings," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2011-2021, 2007
43. H. Lee, P. Pham, Y. Largman, and A. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," Adv. Neural Inf. Process. Syst. 22, pp. 1096-1104, 2009.