Visual speech recognition using motion features and hidden Markov models

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4673 LNCS, Issue , 2007, Pages 832-839

  Yau, Wai Chee ^a   Kumar, Dinesh Kant ^a   Weghorn, Hans ^b  

^a RMIT UNIVERSITY   (Australia)

^b BA University of Cooperative Education   (Germany)

Author keywords

Hidden Markov models; Visual speech recognition; Zernike moments

Indexed keywords

FEATURE EXTRACTION; IMAGE SEGMENTATION; MOTION ESTIMATION; SPEECH RECOGNITION;

VISUAL SPEECH RECOGNITION; ZERNIKE MOMENTS;

HIDDEN MARKOV MODELS;

EID: 38149103408     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74272-2_103     Document Type: Conference Paper

References (14)

1. Arjunan, S.P., Kumar, D.K., Yau, W.C., Weghorn, H.: Unspoken Vowel Recognition Using Facial Electromyogram. IEEE EMBC, New York (2006)
2. Bobick, A.F., Davis, J.W.: The Recognition of Human Movement Using Temporal Templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 257-267 (2001)
3. Foo, S.W., Dong, L.: Recognition of Visual Speech Elements Using Hidden Markov Models. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 607-614. Springer, Heidelberg (2002)
4. Goldschen, A.J., Garcia, O.N., Petajan, E.: Continuous Optical Automatic Speech Recognition by Lipreading.presented at In: 28th Annual Asilomar Conf on Signal Systems and Computer (1994)
5. Hazen, T.J.: Visual Model Structures and Synchrony Constraints for Audio-Visual Speech Recognition. IEEE Transactions on Audio, Speech and Language Processing 14(3), 1082-1089 (2006)
6. Kaynak, M.N., Qi, Z., Cheok, A.D., Sengupta, K., Chung, K.C.: Audio-visual modeling for bimodal speech recognition. IEEE Transactions on Systems, Man and Cybernetics 34, 564-570 (2001)
7. Khontazad, A., Hong, Y.H.: Invariant Image Recognition by Zernike Moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 489-497 (1990)
8. Liang, L., Liu, X., Zhao, Y., Pi, X., Nefian, A.V.: Speaker Independent Audio-Visual Continuous Speech Recognition. In: IEEE Int. Conf. on Multimedia and Expo (2002)
9. Petajan, E.D.: Automatic Lip-reading to Enhance Speech Recognition. In: GLOBECOM'84 (1984)
10. Potamianos, G., Neti, C., Gravier, G., Senior, A.W.: Recent Advances in Automatic Recognition of Audio-Visual Speech. Proc. of IEEE 91 (2003)
11. Potamianos, G., Neti, C., Huang, J., Connell, J.H., Chu, S., Libai, V., Marcheret, E., Haas, N., Jiang, J.: Towards Practical Deployment of Audio-Visual Speech Recognition. In: ICASSP, IEEE (2004)
12. Rabiner, L.R.: A tutorial on HMM and selected applications in speech recognition. Proc. IEEE 77(2-2), 257-286 (1989)
13. Teh, C.H., Chin, R.T.: On Image Analysis by the Methods of Moments. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 496-513 (1988)
14. Yau, W.C., Kumar, D.K., Arjunan, S.P.: Visual Speech Recognition Method Using Translation, Scale and Rotation Invariant Features. In: IEEE International Conference on Advanced Video and Signal based Surveillance, Sydney, Australia (2006)