Sparse auto-associative neural networks: Theory and application to speech recognition

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 2270-2273

  Sivaram, G S V S ^a   Ganapathy, Sriram ^a   Hermansky, Hynek ^a  

^a Johns Hopkins University   (United States)

Author keywords

Auto associative neural networks; Feature extraction; Phoneme recognition; Sparsity

Indexed keywords

COST FUNCTIONS; FEATURE EXTRACTION; SPEECH COMMUNICATION; SPEECH RECOGNITION;

AUTOASSOCIATIVE NEURAL NETWORKS; CEPSTRAL COEFFICIENTS; PERCEPTUAL LINEAR PREDICTIONS; PHONEME RECOGNITION; RECONSTRUCTION ERROR; SPARSE REGULARIZATIONS; SPARSITY; STATE OF THE ART; ERROR COST FUNCTION; FEATURES EXTRACTION; HIDDEN LAYERS; PHONEMES RECOGNITION; REGULARIZATION TERMS;

MULTILAYER NEURAL NETWORKS; SPEECH RECOGNITION;

EID: 79959833467     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Kramer, M.A., "Nonlinear principal component analysis using auto-associative neural networks", AIChE Journal, 37(2):233-243, 1991.
2. Yegnanarayana, B. and Kishore, S.P., "AANN: an alternative to GMM for pattern recognition", Neural Networks, 15(3):459-469, 2002. (Pubitemid 34518411)
3. Hoyer, P.O., "Non-negative matrix factorization with sparseness constraints", Journal of Machine Learning Research, 5:1457-1469, 2004.
4. Ranzato, M., Boureau, Y. and LeCun, Y., "Sparse Feature Learning for Deep Belief Networks", Advances in neural information processing systems (NIPS), 20:1185-1192, 2007.
5. Lee, H. and Ekanadham, C. and Ng, A., "Sparse deep belief net model for visual area V2", Advances in neural information processing systems (NIPS), 2007.
6. Bourlard, H. and Kamp, Y., "Auto-association by multilayer per-ceptrons and singular value decomposition", Biological cybernetics, 59(4-5):291-294, 1988.
7. Chen, B., Zhu, Q. and Morgan, N., "Learning long-term temporal features in LVCSR using neural networks", Eighth International Conference on Spoken Language Processing, 2004.
8. Grézl, F., Karafiát, M., Kontár, S. and Cernocky, J., "Probabilistic and bottle-neck features for LVCSR of meetings", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2007.
9. Sivaram, G.S.V.S., Nemala, S.K, Elhilali, M., Tran, T. and Hermansky, H., "Sparse Coding for Speech Recognition", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Dallas, Texas, 2010.
10. Hermansky, H., "Perceptual linear predictive (PLP) analysis of speech", Journal of the Acoustical Society of America, 87(4):1738-1752, 1990. (Pubitemid 20256470)
11. Bourlard, H. and Morgan, N., "Connectionist speech recognition: a hybrid approach", Neural computation, 1994.
12. Richard, M.D. and Lippmann, R.P., "Neural network classifiers estimate Bayesian a posteriori probabilities", Neural computation, 3(4):461-483, 1991.
13. Lee, K.F. and Hon H.W., "Speaker-independent phone recognition using hidden Markov models", IEEE Transactions on Acoustics, Speech and Signal Processing, 37(11):1641-1648, 1989.
14. Pinto, J., Yegnanarayana, B., Hermansky, H. and Doss, M.M., "Exploiting contextual information for improved phoneme recognition", Proc. of Interspeech, Antwerp, Belgium, 2007.