Exploring hierarchical speech representations with a deep convolutional neural network

UKCI 2011 - Proceedings of the 11th UK Workshop on Computational Intelligence

Volumn , Issue , 2011, Pages 37-42

  Hau, Darren ^a   Chen, Ke ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMIMETICS; CONVOLUTION; CONVOLUTIONAL NEURAL NETWORKS; DEEP LEARNING; LEARNING ALGORITHMS; LEARNING SYSTEMS; NETWORK ARCHITECTURE; SPEECH; VISION;

BIOLOGICALLY INSPIRED MODELS; DEEP ARCHITECTURES; HIERARCHICAL FEATURES; HIERARCHICAL REPRESENTATION; LEVELS OF ABSTRACTION; RESTRICTED BOLTZMANN MACHINE; SPARSE DECOMPOSITION; SPEECH INFORMATION;

DEEP NEURAL NETWORKS;

EID: 85007207023     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. A.-r. Mohamed, G. E. Dahl, and G. E. Hinton, “Acoustic modeling using deep belief networks,” IEEE Transactions on Audio, Speech, and Language Processing, 2011 (in press).
2. G. E. Hinton, S. Osindero, and Y.-W. Teh, “A fast learning algorithm for deep belief nets,” Neural Computation, vol. 18, no. 7, pp. 1527–54, 2006.
3. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio, “Why does unsupervised pre-training help deep learning?” The Journal of Machine Learning Research, vol. 11, pp. 625–660, 2010.
4. G. E. Hinton and R. R. Salakhutdinov, “Reducing the dimensionality of data with neural networks,” Science, vol. 313, no. 5786, pp. 504–7, 2006.
5. R. Hadsell, A. Erkan, P. Sermanet, M. Scoffier, and U. Muller, “Deep belief net learning in a long-range vision system for autonomous off-road driving,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2008, pp. 628–633.
6. H. Lee, Y. Largman, P. Pham, and A. Y. Ng, “Unsupervised feature learning for audio classification using convolutional deep belief networks,” 2009.
7. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, “Greedy layer-wise training of deep networks,” in Advances in Neural Information Processing Systems (NIPS) 19, 2007, pp. 153–160.
8. H. Larochelle, Y. Bengio, J. Louradour, and P. Lambin, “Exploring strategies for training deep neural networks,” The Journal of Machine Learning Research, vol. 10, pp. 1–40, 2009.
9. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, “Extracting and composing robust features with denoising autoencoders,” in Proceedings of the 25th International Conference on Machine learning (ICML), 2008, pp. 1096–1103.
10. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, 1998.
11. K. Kavukcuoglu, M. Ranzato, and Y. LeCun, “Fast inference in sparse coding algorithms with applications to object recognition,” Computational and Biological Learning Lab, Courant Institute, New York University, Tech. Rep., 2008, CBLL-TR-2008-12-01.
12. K. Jarrett, K. Kavukcuoglu, M. A. Ranzato, and Y. LeCun, “What is the best multi-stage architecture for object recognition?” in Proceedings of the 12th International Conference on Computer Vision (ICCV), 2009, pp. 2146–2153.
13. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, N. L. Dahlgren, and V. Zue, TIMIT Acoustic-Phonetic Continuous Speech Corpus. Linguistic Data Consortium, Philadelphia, 1993.
14. B. A. Olshausen and D. Field, “Sparse coding with an overcomplete basis set: A strategy employed by v1?” Vision Research, vol. 37, no. 23, pp. 3311–3325, 1997.
15. C.-C. Chang and C.-J. Lin, “LIBSVM: A library for support vector machines,” ACM Transactions on Intelligent Systems and Technology, vol. 2, pp. 27:1–27:27, 2011.