Matrix updates for perceptron training of continuous density hidden Markov models

Proceedings of the 26th International Conference On Machine Learning, ICML 2009

Volumn , Issue , 2009, Pages 153-160

  Cheng, Chih Chieh ^a   Sha, Fei ^b   Saul, Lawrence K ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; CONTEXT INDEPENDENT; CONTINUOUS DENSITY HIDDEN MARKOV MODELS; CONVERGENCE RATES; COVARIANCE MATRICES; DISCRIMINATIVE TRAINING; GAUSSIAN EMISSION; MATRIX FACTORIZATIONS; MATRIX UPDATES; PARAMETER SPACES; PARAMETERIZED; PERCEPTRON; PHONE ERROR RATE; POSITIVE SEMIDEFINITE MATRICES; RAPID REDUCTION; SPEECH CORPORA; VITERBI;

COVARIANCE MATRIX; DATA STORAGE EQUIPMENT; HIDDEN MARKOV MODELS; LEARNING ALGORITHMS; ROBOT LEARNING; TELEPHONE SETS; VITERBI ALGORITHM;

SPEECH RECOGNITION;

EID: 71149085362     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Bahl, L. R., Brown, P. F., de Souza, P. V., & Mercer, R. L. (1986). Maximum mutual information estimation of hidden Markov model parameters for speech recognition. Proc. of International Conference of Acoustic, Speech and Signal Processing (ICASSP) (pp. 49-52). Tokyo.
2. Bottou, L., & Bousquet, O. (2008). The tradeoffs of large scale learning. In Advances in neural information processing systems, vol. 20, 161-168. MIT Press.
3. Bottou, L., & LeCun, Y. (2004). Large scale online learning. In Advances in neural information processing systems 16. Cambridge, MA: MIT Press.
4. Collins, M. (2002). Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. Proc. of Empirical Methods in Natural Language Processing (EMNLP 2002).
5. Freund, Y., & Schapire, R. E. (1999). Large margin classification using the perceptron algorithm. Machine Learning (pp. 277-296).
6. Gentile, C. (2002). A new approximate maximal margin classification algorithm. J. Mach. Learn. Res., 2, 213-242.
7. Huang, X., Acero, A., & Hon, H.-W. (2001). Spoken language processing. Prentice-Hall.
8. Jiang, H., Li, X., & Liu, C. (2006). Large margin hidden markov models for speech recognition. IEEE Trans. on Audio, Speech and Language Processing, 14, 1584-1595.
9. Juang, B.-H., & Katagiri, S. (1992). Discriminative learning for minimum error classification. IEEE Trans. Sig. Proc., 40, 3043-3054.
10. Lamel, L. F., Kassel, R. H., & Seneff, S. (1986). Speech database development: design and analysis of the acoustic-phonetic corpus. Proceedings of the DARPA Speech Recognition Workshop (pp. 100-109).
11. Lee, K. F., & Hon, H. W. (1988). Speaker-independent phone recognition using hidden markov models. IEEE Trans. on Acoustics, Speech, and Signal Processing, 37, 1641-1648.
12. Li, J., Yuan, M., & Lee, C. (2007). Approximate test risk bound minimization through soft margin estimation. IEEE Trans. on Speech, Audio and Language Processing, 15, 2392-2404.
13. Nádas, A. (1983). A decision-theoretic formulation of a training problem in speech recognition and a comparison of training by unconditional versus conditional maximum likelihood. IEEE Transactions on Acoustics, Speech and Signal Processing, 31, 814-817.
14. Rosenblatt, F (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65.
15. Sha, F., & Saul, L. K. (2009). Large margin training of continuous density hidden markov models. In J. Keshet and S. Bengio (Eds.), Automatic speech and speaker recognition: Large margin and kernel methods. Wiley-Blackwell.
16. Woodland, P. C., & Povey, D. (2000). Large scale discriminative training for speech recognition. Proc. of Automatic Speech Recognition (ASR 2000).
17. Yu, D., Deng, L., He, X., & Acero, A. (2007). Large-margin minimum classification error training for large-scale speech recognition tasks. Prof of International Conference on Acoustic, Speech and Signal Processing.