Large Margin Hidden Markov Models for Automatic Speech Recognition

NIPS 2006: Proceedings of the 19th International Conference on Neural Information Processing Systems

Volumn , Issue , 2006, Pages 1249-1256

  Sha, Fei ^a   Saul, Lawrence K ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVEX OPTIMIZATION; SPEECH RECOGNITION; SUPPORT VECTOR MACHINES; TRELLIS CODES;

ACOUSTIC FEATURE VECTORS; AUTOMATIC SPEECH RECOGNITION; CONTINUOUS DENSITY HIDDEN MARKOV MODELS; GAUSSIAN MIXTURE MODEL; HIDDEN-MARKOV MODELS; LARGE MARGINS; MARKOV NETWORKS; MAXIMUM MUTUAL INFORMATION; PARAMETERS ESTIMATION; SUPPORT VECTORS MACHINE;

HIDDEN MARKOV MODELS;

EID: 85078843680     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Y. Altun, I. Tsochantaridis, and T. Hofmann. Hidden markov support vector machines. In T. Fawcett and N. Mishra, editors, Proceedings of the Twentieth International Conference (ICML 2003), pages 3-10, Washington, DC, USA, 2003. AAAI Press.
2. D. P. Bertsekas. Nonlinear programming. Athena Scientific, 2nd edition, 1999.
3. P. S. Gopalakrishnan, D. Kanevsky, A. Nádas, and D. Nahamoo. An inequality for rational functions with applications to some statistical estimation problems. IEEE Trans. Info. Theory, 37(1):107-113, 1991.
4. B.-H. Juang and S. Katagiri. Discriminative learning for minimum error classification. IEEE Trans. Sig. Proc., 40(12):3043-3054, 1992.
5. S. Kapadia, V. Valtchev, and S. Young. MMI training for continuous phoneme recognition on the TIMIT database. In Proc. of ICASSP 93, volume 2, pages 491-494, Minneapolis, MN, 1993.
6. J. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional random fields: Probabilisitc models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning (ICML 2001), pages 282-289. Morgan Kaufmann, San Francisco, CA, 2001.
7. L. F. Lamel, R. H. Kassel, and S. Seneff. Speech database development: design and analsysis of the acoustic-phonetic corpus. In L. S. Baumann, editor, Proceedings of the DARPA Speech Recognition Workshop, pages 100-109, 1986.
8. Y. LeCun, L. Jackel, L. Bottou, A. Brunot, C. Cortes, J. Denker, H. Drucker, I. Guyon, U. Muller, E. Sackinger, P. Simard, and V. Vapnik. Comparison of learning algorithms for handwritten digit recognition. In F. Fogelman and P. Gallinari, editors, Proceedings of the International Conference on Artificial Neural Networks, pages 53-60, 1995.
9. K. F. Lee and H. W. Hon. Speaker-independent phone recognition using hidden Markov models. IEEE Transactions on Acoustics, Speech, and Signal Processing, 37(11):1641-1648, 1988.
10. X. Li, H. Jiang, and C. Liu. Large margin HMMs for speech recognition. In Proceedings of ICASSP 2005, pages 513-516, Philadelphia, 2005.
11. A. Nádas. A decision-theoretic formulation of a training problem in speech recognition and a comparison of training by unconditional versus conditional maximum likelihood. IEEE Transactions on Acoustics, Speech and Signal Processing, 31(4):814-817, 1983.
12. T. Robinson. An application of recurrent nets to phone probability estimation. IEEE Transactions on Neural Networks, 5(2):298-305, 1994.
13. J. L. Roux and E. McDermott. Optimization methods for discriminative training. In Proceedings of Nineth European Conference on Speech Communication and Technology (EuroSpeech 2005), pages 3341-3344, Lisbon, Portgual, 2005.
14. F. Sha. Large margin training of acoustic models for speech recognition. PhD thesis, University of Pennsylvania, 2007.
15. F. Sha and L. K. Saul. Large margin Gaussian mixture modeling for phonetic classification and recognition. In Proceedings of ICASSP 2006, pages 265-268, Toulouse, France, 2006.
16. F. Sha and L. K. Saul. Comparison of large margin training to other discriminative methods for phonetic recognition by hidden Markov models. In Proceedings of ICASSP 2007, Hawaii, 2007.
17. B. Taskar, C. Guestrin, and D. Koller. Max-margin markov networks. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems (NIPS 16). MIT Press, Cambridge, MA, 2004.
18. L. Vandenberghe and S. P. Boyd. Semidefinite programming. SIAM Review, 38(1):49-95, March 1996.
19. V. Vapnik. Statistical Learning Theory. Wiley, N.Y., 1998.
20. P. C. Woodland and D. Povey. Large scale discriminative training of hidden Markov models for speech recognition. Computer Speech and Language, 16:25-47, 2002.
21. S. J. Young. Acoustic modelling for large vocabulary continuous speech recognition. In K. Ponting, editor, Computational Models of Speech Pattern Processing, pages 18-39. Springer, 1999.