A sequential pattern classifier based on hidden Markov kernel machine and its application to phoneme classification

IEEE Journal on Selected Topics in Signal Processing

Volumn 4, Issue 6, 2010, Pages 974-984

  Kubo, Yotaro ^a,b   Watanabe, Shinji ^b   Nakamura, Atsushi ^b   McDermott, Erik ^b,c   Kobayashi, Tetsunori ^a  

^a WASEDA UNIVERSITY   (Japan)

^b NTT Corporation   (Japan)

^c GOOGLE INC   (United States)

Author keywords

Discriminative training; hidden Markov models (HMMs); kernel methods; sequential pattern classifiers

Indexed keywords

DISCRIMINATIVE TRAINING; EMISSION PROBABILITIES; GAUSSIAN MIXTURE MODELS; GAUSSIANS; HIDDEN STATE; KERNEL METHODS; LOCAL OPTIMA; MARKOV KERNELS; MAXIMUM MUTUAL INFORMATION; MIXTURE MODEL; NONLINEAR CLASSIFICATION; OVERFITTING; PHONEME CLASSIFICATION; SEQUENTIAL DATA; SEQUENTIAL PATTERNS;

BLIND SOURCE SEPARATION; CLASSIFIERS; MAXIMUM LIKELIHOOD; OBJECT RECOGNITION; PROBABILITY; PROBABILITY DENSITY FUNCTION; SPEECH RECOGNITION; STEREOPHONIC BROADCASTING;

HIDDEN MARKOV MODELS;

EID: 78649262525     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2010.2076030     Document Type: Article

References (23)

1. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," J. Mach. Learn. Res., vol. 6, pp. 1453-1484, Oct. 2005.
2. A. Ganapathiraju, J. Hamaker, and J. Picone, "Applications of support vector machines to speech recognition," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2348-2355, Aug. 2004.
3. C. Joder, S. Essid, and G. Richard, "Alignment kernels for audio classification with application to music instrument recognition," in Proc. EUSIPCO'08, Lausanne, Switzerland, Sep. 2008.
4. H. Shimodaira, K. Noma, M. Nakai, and S. Sagayama, "Dynamic time-alignment kernel in support vector machine," Adv. Neural Inf. Process. Syst., vol. 2, pp. 921-928, 2002.
5. M. Cuturi, J. Vert, O. Birkenes, and T. Matsui, "A kernel for time series based on global alignments," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'07), Apr. 2007, vol. 2, pp. II-413-II-416.
6. B. Q. Huang, C. J. Du, Y. B. Zhang, and M.-T. Kechadi, "A hybrid HMM-SVM method for online handwriting symbol recognition," in Proc. Intell. Syst. Design Applicat. (ISDA'06), Shaodong, China, Nov. 2006, vol. 1, pp. 887-891.
7. A. Ganapathiraju, J. Hamaker, and J. Picone, "Hybrid SVM/HMM architectures for speech recognition," in Proc. 6th Int. Conf. Spoken Lang. Process. (ICSLP'00), Beijing, China, Nov. 2000, vol. 4, pp. 504-507.
8. P. C. Woodland, "Large scale discriminative training of hidden Markov models for speech recognition," Comput. Speech Lang., vol. 16, no. 1, pp. 25-47, Feb. 2002.
9. E. McDermott and S. Katagiri, "String-level MCE for continuous phoneme recognition," in Proc. 5th Eur. Conf. Speech Commun. Technol. (Eurospeech-97), Rhodes, Greece, Sep. 1997, pp. 123-126.
10. D. Povey and P. C. Woodland, "Minimum phone error and I-smoothing for improved discriminative training," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP '02), Orlando, FL, May 2002, pp. I-105-I-108.
11. F. Sha and L. K. Saul, "Large margin hidden markov models for automatic speech recognition," Adv. Neural Inf. Process. Syst., pp. 1249-1256, Feb. 2007.
12. H. Kashima, T. Ide, T. Kato, and M. Sugiyama, "Recent advances and trends in large-scale kernel methods," IEICE Trans. Inf. Syst., vol. E92-D, no. 7, pp. 1338-1353, 2009.
13. N. D. Freitas, Y. Wang, M. Mahdaviani, and D. Lang, "Fast krylov methods for n-body learning," Adv. Neural Inf. Process. Syst., vol. 18, pp. 251-268, 2006.
14. L. Bahl, P. Brown, P. de Souza, and R. L. Mercer, "Maximum mutual information estimation of hidden markov model parameters for speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'86), Apr. 1986, vol. 11, pp. 49-52.
15. A. Gunawardana, M. Mahajan, and A. Acero, "Hidden conditional random fields for phone classification," in Proc. European Conf. Speech Communication and Technology (Interspeech'05), Lisbon, Portugal, Oct. 2005, pp. 1117-1120.
16. S. Reiter, B. Schuller, and G. Rigoll, "Hidden conditional random fields for meeting segmentation," in Proc. IEEE Int. Conf. Multimedia Expo (ICME-2007), Jul. 2007, pp. 639-642.
17. T. Jebara, "Discriminative, generative and imitative learning," Ph.D. dissertation, Columbia Univ., New York, Feb. 2001.
18. A. Janin, D. P. W. Ellis, and N. Morgan, "Multi-stream speech recognition: Ready for prime time?," in Proc. 6th Eur. Conf. Speech Commun. Technol., Budapest, Hungary, Sep. 1999, pp. 591-594.
19. D. P. Lewis, "Combining kernels for classification," Ph.D. dissertation, Columnbia Univ., New York, Mar. 2008.
20. R. Schlüter, W. Macherey, B. Müller, and H. Ney, "Comparison of discriminative training criteria and optimization methods for speech recognition," Speech Commun., vol. 34, pp. 287-310, 2001.
21. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 11, pp. 1641-1648, Nov. 1989.
22. B. Schölkopf and A. J. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
23. J.-K. Chen and F. K. Soong, "An N-best candidates-based discriminative training for speech recognition applications," IEEE Trans. Speech Audio Process., vol. 2, no. 1, pp. 206-216, Jan. 1994