Discriminative models for speech recognition

2007 Information Theory and Applications Workshop, Conference Proceedings, ITA

Volumn , Issue , 2007, Pages 170-176

  Gales, M J F ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; CHARACTER RECOGNITION; CONTINUOUS SPEECH RECOGNITION; CYBERNETICS; FEATURE EXTRACTION; HIDDEN MARKOV MODELS; IMAGE SEGMENTATION; INFORMATION THEORY; MARKOV PROCESSES; PROBABILITY DISTRIBUTIONS; SPEECH; SPEECH ANALYSIS; STEREOPHONIC BROADCASTING;

ACOUSTIC MODELLING; AUTOMATIC SPEECH RECOGNITION SYSTEMS; CONDITIONAL RANDOM FIELDS; DECISION RULES; DISCRIMINATIVE MODELS; DISCRIMINATIVE TRAINING CRITERIA; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; MAXIMUM ENTROPY MARKOV MODELS; MAXIMUM MUTUAL INFORMATION; MAXIMUM-LIKELIHOOD CRITERION; MINIMUM PHONE ERROR; PERFORMANCE GAINS; TRANSITION PROBABILITIES;

SPEECH RECOGNITION;

EID: 48049097464     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ITA.2007.4357576     Document Type: Conference Paper

References (41)

1. M. J. F. Gales, D.Y. Kim, P. C. Woodland, H.Y. Chan, D. Mrva, R. Sinha, and S.E. Tranter, "Progress in the CU-HTK Broadcast News transcription system," IEEE Transactions Audio, Speech and Language Processing, 2006.
2. C J Leggetter and P C Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density HMMs," omputer Speech and Language, vol. 9, pp. 171-186, 1995.
3. T Anastasakos, J McDonough, R Schwartz, and J Makhoul, "A compact model for speaker-adaptive training," in Proceedings ICSLP, 1996, pp. 1137-1140.
4. M.J.F. Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Transactions on Speech and Audio Processing, vol. 7, no. 3, pp. 272-281, 1999.
5. L.A. Rabiner, "A tutorial on hidden Markov models and selective applications in speech recognition," in Proc. of the IEEE, February 1989, vol. 77, pp. 257-286.
6. P.S. Gopalakrishnan, D. Kanevsky, A. Nádas, and D. Nahamoo, "An inequality for rational functions with applications to some statistical estimation problems," IEEE Trans. Information Theory, 1991.
7. P. C. Woodland and D. Povey, "Large scale discriminative training of hidden Markov models for speech recognition," Computer Speech & Language, vol. 16, pp. 25-17, 2002.
8. D. Povey and P. C. Woodland, "Minimum phone error and I-smoothing for improved discriminative training," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Orlando, FL, May 2002.
9. D. Povey, Discriminative Training for Large Vocabulary Speech Recognition, PhD. thesis, Cambridge University, 2004.
10. R. Schlüter, B. Müller, F. Wessel, and H. Ney, "Interdependence of language models and discriminative training," in Proc. ASRU, 1999.
11. V. Valtchev, J. J. Odell, P. C. Woodland, and S. J. Young, "Lattice-based discriminative training for large vocabulary speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1996.
12. H-K Kuo and Y Gao, "Maximum entropy direct models for speech recognition," IEEE Transactions Audio Speech and Language Processing, 2006.
13. A. Gunawardana, M. Mahajan, A. Acero, and J.C. Platt, "Hidden conditional random fields for phone classification," in Interspeech, 2005.
14. M.I. Layton and M.J.F. Gales, "Augmented statistical models for speech recognition," in ICASSP, 2006.
15. N.D. Smith and MJ.F. Gales, "Speech recognition using SVMs," in Advances in Neural Information Processing Systems, 2001.
16. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society vol. 39, pp. 1-39, 1977.
17. P Brown, The Acoustic-Modelling Problem in Automatic Speech Recognition Ph.D. thesis, IBM TJ. Watson Research Center, 1987.
18. B Roark, M Saraclar, and M Collins, "Discriminative N-gram language modeling," Computer Speech and Language, 2007.
19. B.-H. Juang and S. Katagiri, 'Discriminative learning for minimum error classification," IEEE Transactions on Signal Processing 1992.
20. J Kaiser, B Horvat, and Z Kacic, "A novel loss function for the overall risk criterion based discriminative training of HMM models," in Proc. ICSLP, 2000.
21. W Byrne, "Minimum Bayes risk estimation and decoding in large vocabulary continuous speech recognition," EICE Special Issue on Statistical Modelling for Speech Recognition, 2006.
22. W Macherey, L Haferkamp, R Schlter, and H Ney, "Investigations on error minimizing training criteria for discriminative training in automatic speech recognition," in Proceedings Eurospeech, 2005.
23. H Jiang, X Li, and Liu X, "Large margin hidden markov models for speech recognition," IEEE Transactions Audio, Speech and Language Processing September 2006.
24. G. Saon, D. Povey, and G. Zweig, "CTS decoding improvements at IBM," in EARS STT workshop, St. Thomas, U.S. Virgin Islands, December 2003.
25. A. Stolcke, E. Brill, and M. Weintraub, "Explicit word error minimization in N-Best list rescoring," in Proc. Eur. Conf. Speech Commun. Technol., 1997.
26. L. Mangu, E. Brill, and A. Stolcke, "Finding consensus among words: Lattice-based word error minimization," in Proc. Eurospeech, 1999.
27. V. Goel and W. Byrne, "Task dependent loss functions in speech recognition: A* search over recognition lattices," in Proc. Eur. Conf. Speech Commun. Technol., 1999.
28. J. Lafferty A. McCallum, and F. Pereira, "Condition random fields: Probabilistic models for segmenting and labeling sequence data," in ICML, 2001, pp. 591-598.
29. J.A. Bilmes, "Buried Markov models: A graphical-modelling approach to automatic speech recognition," Computer Speech and Language, vol. 2-3, 2003.
30. K. Tsuda, T. Kin, and K. Asai, "Marginalized kernels for biological sequences," Bioinformatics, vol. 18, pp. S268-S275, 2002.
31. T. Jaakkola and D. Hausser, "Exploiting generative models in discimina-tive classifiers," in Advances in Neural Information Processing Systems 11, S.A. Solla and D.A. Cohn, Eds. 1999, pp. 487-493, MIT Press.
32. C. Saunders, J. Shawe-Taylor, and A. Vinokourov, "String kernels, fisher kernels and finite state automata," in Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer, Eds. 2003, pp. 633-640, MIT Press.
33. M. Layton and M.J.F. Gales, "Maximum margin training of generative kernels," Tech. Rep. CUED/F-INFENG/TR.484, Department of Engineering, University of Cambridge, June 2004.
34. V.N. Vapnik, Statistical learning theory, John Wiley & Sons, 1998.
35. V. Venkataramani, S. Chakrabartty, and W Byrne, "Support vector machines for segmental minimum Bayes risk decoding of continuous speech," in ASRU 2003, 2003.
36. M. J. F. Gales and M. I. Layton, "Training augmented models using svms," IEICE Special Issue on Statistical Modelling for Speech Recognition, 2006.
37. V. Wan and S. Renals, "Speaker verification using sequence discriminant support vector machines," IEEE Transactions Speech and Audio Processing, 2004.
38. C Longworth and M.J.F. Gales, "Discriminative adaptation for speaker verification," in Proceedings InterSpeech, September 2006.
39. N.D. Smith, Using Augmented Statistical Models and Score Spaces for Classification, PhD. thesis, University of Cambridge, September 2003.
40. S. J. Young, G. Evermann, M. J. F. Gales, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D Povey, V Valtchev, and P. C. Woodland, The HTK Book, version 3.4, Cambridge University Engineering Department, Cambridge, UK, 2006.
41. M Layton, Augmented Statistical Moedls for Classifying Sequence Data, Ph.D. thesis, Cambridge University, 2006.