Ginisupport vector machines for segmental minimum Bayes risk decoding of continuous speech

Computer Speech and Language

Volumn 21, Issue 3, 2007, Pages 423-442

  Venkataramani, Veera ^a   Chakrabartty, Shantanu ^b   Byrne, William ^c  

^a FAIR ISAAC CORPORATION   (United States)

^b Michigan State University   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; MATHEMATICAL MODELS; REGRESSION ANALYSIS; SPEECH CODING; SPEECH RECOGNITION;

BAYES RISK DECODING; POSTERIOR DISTRIBUTION; REGRESSION PROBLEMS; SUPPORT VECTOR MACHINES (SVM);

LEARNING SYSTEMS;

EID: 33847611644     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2006.08.002     Document Type: Article

References (46)

1. Blum A., and Langley P. Selection of relevant features and examples in machine learning. Artificial Intelligence 97 1-2 (1997) 245-271
2. Boser, B., Guyon, I., Vapnik, V., 1992. A training algorithm for optimal margin classifier. In: Proceedings of the 16th Conference on Computational Learning Theory, pp. 144-152.
3. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 2 (1998) 121-167
4. Byrne, W., 2006. Minimum Bayes risk estimation and decoding in large vocabulary continuous speech recognition. In: Proceedings of the Institute of Electronics, Information, and Communication Engineers, Japan - Special Section on Statistical Modeling for Speech Processing E89-D (3), March.
5. Chakrabartty, S., 2003. The giniSVM toolkit, Version 1.2. Available from: .
6. Chakrabartty, S., 2004. Design and implementation of ultra-low power pattern and sequence decoders. Ph.D. Thesis, The Johns Hopkins University.
7. Chakrabartty S., and Cauwenberghs G. Forward decoding kernel machines: a hybrid HMM/SVM approach to sequence recognition. Proceedings of the SVM'2002. Lecture Notes in Computer Science vol. 2388 (2002), MIT Press, Cambridge 278-292
8. Cortes C., and Vapnik V. Support-vector networks. Machine Learning 20 3 (1995) 273-297
9. Doumpiotis, V., 2005. Discriminative training for speaker adaptation and minimum Bayes risk estimation in large vocabulary speech recognition. Ph.D. Thesis, The Johns Hopkins University.
10. Doumpiotis, V., Tsakalidis, S., Byrne, W., 2003a. Discriminative training for segmental minimum Bayes risk decoding. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Hong Kong, pp. 136-139.
11. Doumpiotis V., Tsakalidis S., and Byrne W. Lattice segmentation and minimum Bayes risk discriminative training. Proceedings of the European Conference on Speech Communication and Technology (2003), Geneva 1985-1988
12. Fine, S., Navrátil, J., Gopinath, R., 2001. A hybrid GMM/SVM approach to speaker identification. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, UT, USA, pp. 417-420.
13. Fiscus, J., 1997. A post-processing system to yield reduced word error rates: recognizer output voting error reduction (ROVER). EEE Workshop on Speech Recognition & Understanding, pp. 347-354.
14. Ganapathiraju, A., Hamaker, J., Picone, J., 2000. Hybrid svm/hmm architectures for speech recognition. In: Proceedings of the International Conference on Spoken Language Processing, vol. 4, Beijing, China, pp. 504-507.
15. Goel V., and Byrne W. Minimum Bayes-risk automatic speech recognition. Computer Speech and Language 14 2 (2000) 115-135
16. Goel V., and Byrne W. Minimum Bayes-risk automatic speech recognition. In: Chou W., and Juang B.-H. (Eds). Pattern Recognition in Speech and Language Processing (2003), CRC Press 51-80 Chapter 3
17. Goel, V., Kumar, S., Byrne, W., 2001. Confidence based lattice segmentation and minimum Bayes-risk decoding. In: Proceedings of the European Conference on Speech Communication and Technology, Aalborg, Denmark, vol. 4, pp. 2569-2572.
18. Goel V., Kumar S., and Byrne W. Segmental minimum Bayes-risk decoding for automatic speech recognition. IEEE Transactions on Speech and Audio Processing 12 3 (2004) 287-333
19. Golowich, S.E., Sun, D.X., 1998. A support vector/hidden Markov model approach to phoneme recognition. In: ASA Proceedings of the Statistical Computing Section, pp. 125-130.
20. Hsu C.-W., and Lin C.-J. A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks 13 2 (2002) 415-422 March
21. Jaakkola T., and Haussler D. Exploiting generative models in discriminative classifiers. In: Kearns M.S., and Cohn D.A. (Eds). Advances in Neural Information Processing System (1998), MIT Press 487-493 S.A.S.
22. Jelinek, F., 1996. Speech recognition as code-breaking. Tech. Rep. Tech Report No. 5, CLSP, JHU, February.
23. Kumar, S., 2004. Minimum Bayes-risk techniques in automatic speech recognition and statistical machine translation. Ph.D. Thesis, The Johns Hopkins University.
24. Kumar, S., Byrne, W., 2002. Risk based lattice cutting for segmental minimum Bayes-risk decoding. In: Proceedings of the International Conference on Spoken Language Processing, Denver, CO, USA, pp. 373-376.
25. Lafferty, J., McCallum, A., Pereira, F., 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning, pp. 282-289.
26. Legetter C.J., and Woodland P.C. Maximum likelihood linear regression for speaker adaptation of continuous density hmms. Computer, Speech and Language 9 (1995) 171-186
27. Mangu, L., Padmanabhan, M., 2001. Error corrective mechanisms for speech recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, UT, USA, vol. 1, pp. 29-32.
28. Mangu L., Brill E., and Stolcke A. Finding consensus in speech recognition: word error minimization and other applications of confusion networks. Computer Speech and Language 14 4 (2000) 373-400
29. Mohri, M., Pereira, F., Riley, M., 2001. AT&T General-purpose Finite-State Machine Software Tools. Available from: .
30. Noel, M., 1997. Alphadigits. CSLU, OGI, Available from: .
31. Normandin, Y., 1995. Optimal splitting of HMM gaussian mixture components with mmie training. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 15, pp. 449-452.
32. Normandin Y. Maximum mutual information estimation of hidden Markov models. Automatic Speech and Speaker Recognition - Advanced Topics (1996), Kluwer, Boston, MA 57-82
33. Salomon, J., King, S., Osburne, M., 2002. Framewise phone classification using support vector machines. In: Proceedings of the International Conference on Spoken Language Processing, Denver, CO, USA, pp. 2645-2648.
34. Smith, N.D., 2003. Using augmented statistical models and score spaces for classification. Ph.D. Thesis, Christ's College.
35. Smith, N., Gales, M., 2002a. Speech recognition using svms. In: Advances in Neural Information Processing Systems, vol. 14, pp. 1197-1204.
36. Smith, N.D., Gales, M.J.F., April 2002b. Using SVMs to classify variable length speech patterns. Tech. Rep. CUED/F-INFENG/TR412, Cambridge University, Engineering Department.
37. Smith, N., Niranjan, M., 2000. Data-dependent kernels in svm classification of speech patterns. In: Proceedings of the International Conference on Spoken Language Processing, Beijing, China, pp. 297-300.
38. Smith, N.D., Gales, M.J.F., Niranjan, M., April 2001. Data-dependent kernels in SVM classification of speech patterns. Tech. Rep. CUED/F-INFENG/TR387, Cambridge University, Engineering Department.
39. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer-Verlag, Inc., New York
40. Venkataramani, V., 2005. Code breaking for automatic speech recognition. Ph.D. Thesis, The Johns Hopkins University.
41. Venkataramani, V., Byrne, W., 2003. Support vector machines for segmental minimum Bayes risk decoding of continuous speech. IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 13-18.
42. Venkataramani, V., Byrne, W., 2005. Lattice segmentation and support vector machines for large vocabulary continuous speech recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 817-820.
43. Wessel, F., Macherey, K., Schlueter, R., 1998. Using word probabilities as confidence measures. In: Proceedings of the ICASSP, Seattle, WA, USA, pp. 225-228.
44. Weston, J., Watkins, C., May 1999. Support vector machines for multi-class pattern recognition. In: Proceedings of the 7th European Symposium on Artificial Neural Networks, Bruges, Belgium, pp. 219-224.
45. Woodland, P.C., Povey, D., 2000. Large scale discriminative training for speech recognition. In: Proceedings of the ITW ASR, ISCA, pp. 7-16.
46. Young, S., Evermann, G., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P., July 2000. The HTK Book, Version 3.0.