An auto-encoder based approach to unsupervised learning of subword units

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 7634-7638

  Badino, Leonardo ^a   Canevari, Claudia ^a   Fadiga, Luciano ^a   Metta, Giorgio ^a  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

autoencoders; deep learning; unsupervised acoustic modeling

Indexed keywords

SIGNAL PROCESSING;

ACOUSTIC MODEL; AMERICAN ENGLISH; AUTOENCODERS; CLASSIFICATION ACCURACY; DEEP LEARNING; QUERY CLASSIFICATION; SUB-WORD UNITS; WORD CLASSIFICATION;

LEARNING SYSTEMS;

EID: 84905227103     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6855085     Document Type: Conference Paper

References (17)

1. N. Morgan, J. Cohen, S. H. Krishnan Parthasarathi, S. Y. Chang, and S. Wegmann, "Outing unfortunate charactheristics of hmms, " in Final Report: OUCH Project.
2. Y. Bengio, "Learning deep architectures for AI, " Technical Report 1312, 2007.
3. A. Coates, H. Lee, and A. Y. Ng, "An analysis of singlelayer networks in unsupervised feature learning, " in AISTATS 14, 2011.
4. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " J. Mach. Learn. Res., vol. 11, pp. 3371-3408, 2010.
5. R. Jakobson, G. Fant, Halle, and Morris, Preliminaries to Speech Analysis: The Distinctive Features and their Correlates, Cambridge, Ma.; MIT Press, 1952.
6. M. Bacchiani and M. Ostendorf, "Joint lexicon, acoustic unit inventory and model design, " Speech Communication, vol. 29, pp. 99-114, 1999.
7. R. Singh, B. Raj, and M. Stern, "Automatic generation of subword units for speech recognition systems, " IEEE T-ASLP, vol. 10, no. 2, pp. 89-99, 2002.
8. A. Jansen and K. Church, "Towards unsupervised training of speaker independent acoustic models, " in Proceedings of INTERSPEECH, 2011, pp. 1693-1696.
9. A. Garcia and H. Gish, "Keyword spotting of arbitrary words using minimal speech resources, " in Proceedings of ICASSP, 2006.
10. C. Y. Lee and J. Glass, "A nonparametric bayesian approach to acoustic model discovery, " in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, 2012.
11. B. Varadarajan, S. Khudanpur, and E. Dupoux, "Unsupervised learning of acoustic sub-word units, " in Proceedings of ACL-08:HLT Short Papers, 2008.
12. D. Yu and M. L. Seltzer, "Improved bottleneck features using pretrained deep neural networks, " in Proceedings of INTERSPEECH, 2011.
13. H. Lee, Y. Largman, P. Pham, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks, " Advances in Neural Information Processing Systems (NIPS), vol. 22, 2009.
14. M. D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. V. Le, P. Nguyen, A. Senior, V. Vanhoucke, Dean. J., and G. Hinton, "On rectified linear units for speech processing, " in IEEE International Conference on Acoustic Speech and Signal Processing (ICASSP 2013) Vancouver, 2013.
15. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, 2006.
16. M. Grimaldi, B. Gili Fivela, F. Sigona, M. Tavella, Fitzpatrick P., L. Craighero, L. Fadiga, G. Sandini, and G. Metta, "New technologies for simultaneous acquisition of speech articulatory data: 3d articulograph, ultrasound and electroglottograph, " in Proceedings LangTech., Rome, Italy, 2008.
17. J. S. Garofolo, L. F. Lamel, W. M. Fisher, G. J. Fiscus, Dahlgreen N. L. Pallett, D. S., and V. Zue, "Timit acoustic-phonetic continuous speech corpus, " in Linguistic Data Consortium, Philadelphia, 1993.