Phone classification by a hierarchy of invariant representation layers

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2346-2350

  Zhang, Chiyuan ^a   Voinea, Stephen ^a   Evangelopoulos, Georgios ^a,b   Rosasco, Lorenzo ^a,b   Poggio, Tomaso ^a,b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Auditory cortex; Convolutional network; Invariance; Phonetic classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPLEX NETWORKS; FEATURE EXTRACTION; INVARIANCE; SPEECH; SPEECH COMMUNICATION; TELEPHONE SETS;

AUDITORY CORTEX; CONVOLUTIONAL NETWORKS; EMPIRICAL - COMPARISONS; INVARIANT REPRESENTATION; PHONE CLASSIFICATIONS; PHONETIC CLASSIFICATION; SAMPLE COMPLEXITY; VOCAL TRACT LENGTHS;

SPEECH RECOGNITION;

EID: 84910037127     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. S. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 28, no. 4, pp. 357-366, Aug. 1980.
2. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech, " The Journal of the Acoustical Society of America, vol. 87, no. 4, pp. 1738-1752, 1990.
3. R. P. Lippmann, "Speech recognition by machines and humans, " Speech Communication, vol. 22, no. 1, pp. 1-15, Jul. 1997.
4. O. Scharenborg and M. P. Cooke, "Comparing human and machine recognition performance on a VCV corpus, " in ISCA Tutorial and Research Workshop (ITRW) on "Speech Analysis and Processing for Knowledge Discovery", Aalborg, Denmark, 2008.
5. N. Mesgarani, C. Cheung, K. Johnson, and E. F. Chang, "Phonetic feature encoding in human superior temporal gyrus, " Science, vol. 343, no. 6174, pp. 1006-1010, Jan. 2014.
6. T. O. Sharpee, C. A. Atencio, and C. E. Schreiner, "Hierarchical representations in the auditory cortex, " Curr. Opin. Neurobiol., vol. 21, no. 5, pp. 761-767, Jun. 2011.
7. R. Stern and N. Morgan, "Hearing is believing: Biologically inspired methods for robust automatic speech recognition, " IEEE Signal Process. Mag., vol. 29, no. 6, pp. 34-43, Nov. 2012.
8. G. Sivaram, S. K. Nemala, M. Elhilali, T. D. Tran, and H. Hermansky, "Sparse coding for speech recognition, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2010, pp. 4346-4349.
9. O. Vinyals and L. Deng, "Are sparse representations rich enough for acoustic modeling?" in Proc. INTERSPEECH 2012, 13th Annual Conf. of the ISCA, Portland, Oregon, 2012.
10. T. Sainath, D. Nahamoo, D. Kanevsky, B. Ramabhadran, and P. Shah, "A convex hull approach to sparse representations for exemplar-based speech recognition, " in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Dec. 2011.
11. M. Plumbley, T. Blumensath, L. Daudet, R. Gribonval, and M. Davies, "Sparse representations in audio and music: From coding to source separation, " Proceedings of the IEEE, vol. 98, no. 6, pp. 995-1005, June 2010.
12. H. Hermansky, D. P. W. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 3, 2000, pp. 1635-1638.
13. F. Grezl, M. Karafiat, S. Kontar, and J. Cernocky, "Probabilistic and bottle-neck features for LVCSR of meetings, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 4, Apr. 2007, pp. 757-760.
14. D. Yu and M. L. Seltzer, "Improved bottleneck features using pretrained deep neural networks, " in Proc. INTERSPEECH 2011, 12th Annual Conference of the ISCA, 2011, pp. 237-240.
15. J. Gehring, Y. Miao, F. Metze, and A. Waibel, "Extracting deep bottleneck features using stacked auto-encoders, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 2013, pp. 3377-3381.
16. F. Anselmi, J. Z. Leibo, L. Rosasco, J. Mutch, A. Tacchetti, and T. Poggio, "Unsupervised learning of invariant representations in hierarchical architectures, " CoRR, vol. abs/1311.4158, 2013.
17. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, " Journal of Physiology, vol. 160, no. 1, pp. 106-154, Jan. 1962.
18. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, N. L. Dahlgren, and V. Zue, "DARPA, TIMIT acousticphonetic continuous speech corpus, " National Institute of Standards and Technology, 1990.
19. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-R. Mohamed, N. Jaitly, A. Seniore, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, Nov. 2012.
20. A.-R. Mohamed, G. E. Dahl, and G. E. Hinton, "Acoustic modeling using deep belief networks, " IEEE Transactions on Audio, Speech & Language Processing, vol. 20, no. 1, pp. 14-22, 2012.
21. H. Lee, P. T. Pham, Y. Largman, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks, " in Advances in Neural Information Processing Systems (NIPS) 22, 2009, pp. 1096-1104.
22. O. Abdel-Hamid, A.-R. Mohamed, H. Jiang, and G. Penn, "Applying convolutional neural networks concepts to hybrid NNHMM model for speech recognition, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), March 2012, pp. 4277-4280.
23. A. Graves, A.-R. Mohamed, and G. E. Hinton, "Speech recognition with deep recurrent neural networks, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 6645-6649.
24. A. Graves, N. Jaitly, and A.-R. Mohamed, "Hybrid speech recognition with deep bidirectional LSTM, " in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Dec. 2013, pp. 273-278.
25. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription, " in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), 2011, pp. 24-29.
26. J. Anden and S. Mallat, "Deep scattering spectrum, " 2013, IEEE Trans. Signal Processing (submitted). [Online]. Available: Http://arxiv.org/abs/1304.6763.
27. N. Jaitly, P. Nguyen, A. Senior, and V. Vanhoucke, "Application of pretrained deep neural networks to large vocabulary speech recognition, " in Proc. INTERSPEECH 2012, 13th Annual Conf. of the ISCA, Portland, Oregon, 2012.
28. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Advances in Neural Information Processing Systems (NIPS) 25, 2012, pp. 1106-1114.
29. N. Jaitly and G. E. Hinton, "Vocal Tract Length Perturbation (VTLP) improves speech recognition, " in Proc. ICML Workshop on Deep Learning for Audio, Speech and Language, 2013.
30. R. K. Moore, "A comparison of the data requirements of automatic speech recognition systems and human listeners, " in Proc. EUROSPEECH, 8th European Conf. on Speech Communication and Technology, Geneva, Switzerland, 2003, pp. 2582-2584.
31. T. Lee and S. Soatto, "Video-based descriptors for object recognition, " Image and Vision Computing, vol. 29, no. 10, pp. 639-652, Sep. 2011.
32. Y. Kosmann-Schwarzbach, Groups and Symmetries, From Finite Groups to Lie Groups, ser. Universitext. Springer, 2010.
33. H. Cramer and H. Wold, "Some theorems on distribution functions, " Journal of the London Mathematical Society, vol. 1-11, no. 4, pp. 290-294, Oct. 1936.
34. E. Adelson and J. Bergen, "Spatiotemporal energy models for the perception of motion, " Journal of the Optical Society of America A, vol. 2, no. 2, pp. 284-299, Feb. 1985.
35. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition, " Nature Neurosience, vol. 2, no. 11, pp. 1019-1025, Nov. 2000.
36. R. E. Turner, T. C. Walters, J. J. M. Monaghan, and R. D. Patterson, "A statistical, formant-pattern model for segregating vowel type and vocal-tract length in developmental formant data, " J. Acoust. Soc. Am., vol. 125, no. 4, pp. 2374-2386, Apr. 2009.
37. E. Eide and H. Gish, "A parametric approach to vocal tract length normalization, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 1, May 1996, pp. 346-348.
38. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden Markov models, " IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 11, pp. 1641- 1648, Nov 1989.