Learning filter banks within a deep neural network framework

2013 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2013 - Proceedings

Volumn , Issue , 2013, Pages 297-302

  Sainath, Tara N ^a   Kingsbury, Brian ^a   Mohamed, Abdel Rahman ^b   Ramabhadran, Bhuvana ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BROADCAST NEWS; CROSS ENTROPY; DEEP NEURAL NETWORKS; LEARNING APPROACH; LEARNING FILTERS; MEL-FILTER BANKS; SPEECH PRODUCTION; WORD ERROR RATE;

SPEECH RECOGNITION;

FILTER BANKS;

EID: 84893688455     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2013.6707746     Document Type: Conference Paper

References (21)

1. T. N. Sainath, B. Ramabhadran, M. Picheny, D. Nahamoo, and D. Kanevsky, "Exemplar-Based Sparse Representation Features: From TIMIT to LVCSR, " 2011.
2. Y. LeCun, "Learning Invariant Feature Hierarchies, " in European Conference on Computer Vision (ECCV). 2012, vol. 7583 of Lecture Notes in Computer Science, pp. 496-505, Springer.
3. A. Mohamed, G. Hinton, and G. Penn, "Understanding how Deep Belief Networks Perform Acoustic Modelling, " in ICASSP, 2012.
4. T. N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A. Mohamed, "Making Deep Belief Networks Effective for Large Vocabulary Continuous Speech Recognition, " in Proc. ASRU, 2011.
5. Y. LeCun and Y. Bengio, "Convolutional Networks for Images, Speech, and Time-series, " in The Handbook of Brain Theory and Neural Networks. MIT Press, 1995.
6. T. N. Sainath, A. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep Convolutional Neural Networks for LVCSR, " in Proc. ICASSP, 2013.
7. S. Davis and P. Mermelstein, "Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Sentences, " IEEE Transacations on Acoustics, Speech and Signal Processing, vol. 28, no. 4, pp. 357 - 366, 1980. (Pubitemid 11464930)
8. L. Burget and H. Hěrmansk̀y, "Data Driven Design of Filter Bank for Speech Recognition, " in Text, Speech and Dialogue. Springer, 2001, pp. 299-304. (Pubitemid 33329242)
9. Y. Suh and H. Kim, "Data-Driven Filter-Bank-based Feature Extraction for Speech Recognition, " in Proc. SPECOM, 2004.
10. A. Biem, E. Mcdermott, and S. Katagiri, "A Discriminative Filter Bank Model For Speech Recognition, " in Proc. ICASSP, 1995.
11. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep Neural Networks for Acoustic Modeling in Speech Recognition, " IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
12. B. Kingsbury, "Lattice-Based Optimization of Sequence Classification Criteria for Neural-Network Acoustic Modeling, " in Proc. ICASSP, 2009.
13. Y. LeCun, L. Bottou, G. Orr, and K. Muller, "Efficient Backprop, " in Neural Networks: Tricks of the Trrade, G. Orr and Muller K., Eds. 1998, Springer.
14. H. Soltau, G. Saon, and B. Kingsbury, "The IBM Attila Speech Recognition Toolkit, " in Proc. SLT, 2010.
15. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn, "Applying Convolutional Neural Network Concepts to Hybrid NN-HMM Model for Speech Recognition, " in Proc. ICASSP, 2012.
16. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors, " Neurocomputing: foundations of research, pp. 696-699, 1988.
17. H. Hermansky and N. Morgan, "RASTA Processing of Speech, " IEEE Transactions on Speech and Audio Processing, vol. 2, no. 4, pp. 578 - 589, 1994.
18. L. Deng, O. Abdel-Hamid, and D. Yu, "A Deep Convolutional Neural Network using Heterogeneous Pooling for Trading Acoustic Invariance with Phonetic Confusion, " in Proc. ICASSP, 2013.
19. L. Lee and R. C. Rose, "Speaker Normalization using Efficient Frequency Warping Procedures, " in Proc. ICASSP, 1996.
20. G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Improving Neural Networks by Preventing Co- Adaptation of Feature Detectors, " The Computing Research Repository (CoRR), vol. 1207.0580, 2012.
21. J. Jean and Jin Wang, "Weight Smoothing to Improve Network Generalization, " Neural Networks, IEEE Transactions on, vol. 5, no. 5, pp. 752-763, 1994.