A support vector machine-based dynamic network for visual speech recognition applications

Eurasip Journal on Applied Signal Processing

Volumn 2002, Issue 11, 2002, Pages 1248-1259

  Gordan, Mihaela ^a   Kotropoulos, Constantine ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Mouth shape recognition; Phonemes; Support vector machines; Visemes; Visual speech recognition; Viterbi lattice

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; DECODING; FEATURE EXTRACTION; GESTURE RECOGNITION; VIDEO SIGNAL PROCESSING;

SUPPORT VECTOR MACHINES (SVM); VISUAL SPEECH RECOGNITION;

SPEECH RECOGNITION;

EID: 0036875002     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/S1110865702207039     Document Type: Article

References (31)

1. T. Chen, "Audiovisual speech processing," IEEE Signal Processing Magazine, vol. 18, no. 1, pp. 9-21, 2001.
2. T. Chen and R. R. Rao, "Audio-visual integration in multi-modal communication" Proceedings of the IEEE, vol. 86, no. 5, pp. 837-852,1998.
3. C. Benoît, T. Lallouache, T. Mohamadi, and C. Abry, "A set of French visemes for visual speech synthesis" in Talking Machines: Theories, Models, and Designs, G. Bailly and C. Benoît, Eds., pp. 485-504, Elsevier-North Holland, Amsterdam, 1992.
4. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, and D. Vergyri, "Large-vocabulary audio-visual speech recognition: a summary of the Johns Hopkins summer 2000 workshop," in Proc. IEEE Workshop Multimedia Signal Processing, pp. 619-624, Cannes, France, 2001.
5. C. Bregler and S. Omohundro, "Nonlinear manifold learning for visual speech recognition," in Proc. IEEE International Conf. on Computer Vision, pp. 494-499, Cambridge, Mass, USA, 1995.
6. J. Luettin and N. A. Thacker, "Speechreading using probabilistic models," Computer Vision and image Understanding, vol. 65, no. 2, pp. 163-178, 1997.
7. J. R. Movellan, "Visual speech recognition with stochastic networks," in Advances in Neural Information Processing Systems, G. Tesauro, D. Toruetzky, and T. Leen, Eds., vol. 7, pp. 851-858, MIT Press, Cambridge, Mass, USA, 1995.
8. J. R. Movellan, P. Mineiro, and R. J. Williams, "Partially observable SDE models for image sequence recognition tasks," in Advances in Neural Information Processing Systems, T. Leen, T. G. Dietterich, and V. Tresp, Eds., vol. 13, pp. 880-886, MIT Press, Cambridge, Mass, USA, 2001.
9. M. S. Gray, T. J. Sejnowski, and J. R. Movellan, "A comparison of image processing techniques for visual speech recognition applications," in Advances in Neural Information Processing Systems, T. Leen, T. G. Dietterich, and V. Tresp, Eds., vol. 13, pp. 939-945, MIT Press, Cambridge, Mass, USA, 2001.
10. Y. Li, S. Gong, and H. Liddell, "Support vector regression and classification based multiview face detection and recognition," in Proc. 4th IEEE Int. Conf. Automatic Face and Gesture Recognition, pp. 300-305, Grenoble, France, 2000.
11. T.-J. Terrillon, M. N. Shirazi, M. Sadek, H. Fukamachi, and S. Akamatsu, "Invariant face detection with support vector machines," in Proc. 15th Int. Conf. Pattern Recognition, vol. 4, pp. 210-217, Barcelona, Spain, 2000.
12. A. Tefas, C. Kotropoulos, and I. Pitas, "Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 23, no. 7, pp. 735-746, 2001.
13. C. Kotropoulos, N. Bassiou, T. Kosmidis, and I. Pitas, "Frontal face detection using support vector machines and back-propagation neural networks," in Proc. 2001 Scandinavian Conf. Image Analysis (SCIA '01), pp. 199-206, Bergen, Norway, 2001.
14. A. Fazekas, C. Kotropoulos, I. Buciu, and I. Pitas, "Support vector machines on the space of Walsh functions and their properties," in Proc. 2nd IEEE Int. Symp. Image and Signal Processing and Applications, pp. 43-48, Pula, Croatia, 2001.
15. I. Buciu, C. Kotropoulos, and I. Pitas, "Combining support vector machines for accurate face detection," in Proc. 2001 IEEE Int. Conf. Image Processing, vol. 1, pp. 1054-1057, Thessaloniki, Greece, October 2001.
16. A. Ganapathiraju, J. Hamaker, and J. Picone, "Hybrid SVM/HMM architectures for speech recognition," in Proc. Speech Transcription Workshop, College Park, Md, USA, 2000.
17. A. Rogozan, "Discriminative learning of visual data for audio-visual speech recognition," International Journal on Artificial Intelligence Tools, vol. 8, no. 1, pp. 43-52, 1999.
18. A. J. Goldschen, Continuous automatic speech recognition by lipreading, Ph.D. thesis, George Washington University, Washington, DC, USA, 1993.
19. A. J. Goldschen, O. N. Garcia, and E. D. Petajan, "Rationale for phoneme-viseme mapping and feature selection in visual speech recognition," in Speechreading by Humans and Machines: Models, Systems, and Applications, D. G. Stork and M. E. Hennecke, Eds., pp. 505-515, Springer-Verlag, Berlin, Germany, 1996.
20. J. R. Movellan and J. L McClelland, "The Morton-Massaro law of information integration: Implications for models of perception," Psychological Review, vol. 108, no. 1, pp. 113-148, 2001.
21. V. N. Vapnik, Statistical Learning Theory, John Wiley, New York, NY, USA, 1998.
22. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, Cambridge, UK, 2000.
23. S. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, The HTK Book, Entropie, Cambridge, UK, 1999, HTK version 2.2.
24. J. T.-Y. Kwok, "Moderating the outputs of support vector machine classifiers," IEEE Trans. Neural Networks, vol. 10, no. 5, pp. 1018-1031, 1999.
25. J. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Scholkopf, and D. Schuurmans, Eds., MIT Press, Cambridge, Mass, USA, 2000.
26. T. Hastie and R. Tibshirani, "Classification by pairwise coupling," The Annals of Statistics, vol. 26, no. 1, pp. 451-471, 1998.
27. J. R. Deller, J. G. Proakis, and J. H. L. Hansen, Discrete-Time Processing of Speech Signals, Prentice-Hall, Upper Saddle River, NJ, USA, 1993.
28. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition, Prentice-Hall, Englewood Cliffs, NJ, USA, 1993.
29. The Carnegie Mellon University Pronouncing Dictionary V. 0.6, http://www.speech.cs.cmu.edu/cgi-bin/cmudict.
30. T. Joachims, "Making large-scale SVM learning practical," in Advances in Kernel Methods-Support Vector Learning, B. Scoelkopf, C. Burges, and A. Smola, Eds., MIT Press, Cambridge, Mass, USA, 1999.
31. A. Papoulis, Probability, Random Variables, and Stochastic Processes, McGraw-Hill, New York, NY, USA, 3rd edition, 1991.