Visual recognition of speech consonants using facial movement features

Integrated Computer-Aided Engineering

Volumn 14, Issue 1, 2007, Pages 49-61

  Yau, Wai Chee ^a   Kumar, Dinesh Kant ^a   Arjunan, Sridhar Poosapadi ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; FACE RECOGNITION; FEATURE EXTRACTION; FEEDFORWARD NEURAL NETWORKS; IMAGE SEGMENTATION; LEARNING ALGORITHMS; WAVELET TRANSFORMS;

FACIAL MOVEMENT; PHONEMES; STATIONARY WAVELET TRANSFORM (SWT); VISUAL SPEECH MODELS; ZERNIKE MOMENT;

SPEECH RECOGNITION;

EID: 33847061696     PISSN: 10692509     EISSN: None     Source Type: Journal    
DOI: 10.3233/ica-2007-14105     Document Type: Conference Paper

References (33)

1. S.P. Arjunan, D.K. Kumar, W.C. Yau and H. Weghorn, Unspoken Vowel Recognition Using Facial Electromyogram, in: IEEE EMBC, New York, 2006.
2. C.M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Birmingham, 1995, 473.
3. A.F. Bobick and J.W. Davis, The Recognition of Human Movement Using Temporal Templates, IEEE Transactions on Puttern Analysis and Machine Intelligence 23 (2001), 257-267.
4. T. Chen, Audiovisual Speech Processing, IEEE Signal Processing Magazine 18 (2001), 9-21.
5. P. Dikshit and R.W. Schubert, Electroglottograph as an additional source of information in isolated word recognition, in: Fourteenth Southern Biomedical Engineering Conference, 1995.
6. A. Freeman and M. Skapura, Neural Networks: Algorithms, Applications and Programming Techniques, Addison-Wesley, 1991.
7. M. Gordon, C. Kotropoulos and I. Pitas, Application of Support Vector Machines Classifiers to Visual Speech Recognition, 2002 International Conference on Image Processing. 2002. 3 (2002) III-129-III-132.
8. K.Y. Haung, Neural Network for Robust Recognition of Seismic Patterns, in: IIJCNN '01 International Joint Conference on Neural Networks, Vol. 4, IEEE, 2001, 2930-2935.
9. T.J. Hazen, Visual Model Structures and Synchrony Constraints for Audio-Visual Speech Recognition, IEEE Transactions on Speech and Audio Processing (2006).
10. T.J. Hazen, K. Saenko, C.H. La and J.R. Glass, A segment-based audio-visual speech recognizer: Data collection, development and initial experiments, in: International Conference on Multimodal Interfaces, State College, Pennsylvania, 2004, 235-242.
11. M.-K. Hu, Visual Pattern Recognition by Moment Invariants, IEEE Transactions on Information Theory 8 (1962), 179-187.
12. H. Kaplan, S.J. Bally and C. Garretson, Speechreading: A Way to Improve Understanding, Gallaudet University Press, Washington, 1999.
13. A. Khontazad and Y.H. Hon, Invariant Image Recognition by Zernike Moments, IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990), 489-497.
14. A. Khontazad and Y.H. Hong, Rotation invariant image recognition using features selected via a systematic method, Pattern Recognition 23 (1990), 1089-1101.
15. A.D. Kulkarni, Artificial Neural Networks for Image Understanding, Van Nostrand Reinhold, New York, 1994, 204.
16. S. Kumar, D.K. Kumar and A. Sharma, Sensitivity analysis of hand movement classification technique, using motion tem plates, in: IEEE Workshop on Machine Learning for Signal Processing, 2004, 491-498.
17. S. Kumar, D.K. Kumar, A. Sharma and N. McLachlan, Classification of Hand Movements Using Motion Templates and Geometrical Based Moments, in: 2004 International Conference on Intelligent Sensing and Information Processing, 2004, 299-304.
18. L. Liang, X. Liu, Y. Zhao, X. Pi and A.V. Nefian, Speaker independent audio-visual continuous speech recognition, in: IEEE International Conference on Multimedia and Expo, 2002. ICME '02., Vol. 2, IEEE, 2002, 25-28.
19. R.P. Lippmann, Speech Recognition by machines and humans, Speech Communication 22 (1997).
20. S. Mallat, A Wavelet Tour of Signal Processing, Academic Press, 1998, 637.
21. 1. Matthews, T.F. Cootes, J.A. Bangham, S. Cox and R. Harvey, Extraction of Visual Features for Lipreading, it IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (2002), 198-213.
22. H. McGurk and J. MacDonald, Hearing Lips and Seeing Voices, Nature 264 (1976), 746-748.
23. E.D. Petajan, Automatic lip-reading to enhance speech recognition, in: GLOBECOM '84 : IEEE Global Telecommunication Conference, IEEE, 1984, 265-272.
24. G. Potamianos, C. Neti, G. Gravier, A. Garg and A.W. Senior, Recent Advances in the Automatic Recognition of Audiovisual Speech, Proceedings of the IEEE 91 (2003), 1306-1324.
25. G. Potamianos, C. Neti, J. Huang, J.H. Connell, S. Chu, V. Libal, E. Marcheret, N. Haas and J. Jiang, Towards Practical Deployment of Audio-Visual Speech Recognition, in: Proceed ings of IEEE International Conference on Acoustics, Speech, and Signal Processing 2004, Vol. 3, IEEE, 2004, iii-777-780.
26. B.D. Ripley, Pattern Recognition and Neural Networks, Cambridge University Press, 1996, 390.
27. K. Saenko, K. Livescu, M. Siracusa, K. Wilson, J. Glass and T. Darrell, Visual Speech Recognition with Loosely Synchronized Feature Streams, in: ICCV, Beijing, October 2005.
28. E.P. Siraoncelli, W.T. Freeman, E.H. Adelson and D.J. Heeger, Shiftable Multiscale Transform, IEEE Transactions on Information Theory 38 (1992), 587-607.
29. A. Soquet, M. Saerens and V. Lecuit, Complementary Cues for Speech Recognition, in: 14th International Congress of Phonetic Sciences (ICPhS), San Francisco, 1999.
30. M.R. Teague, Image Analysis via the General Theory of Moments, Journal of the Optical Society of America 70 (1980), 920-930.
31. C.-H. Teh and R.T. Chin, On Image Analysis by the Methods of Moments, IEEE Transactions on Pattern Analysis and Machine Intelligence 10 (1988), 496-513.
32. W.C. Yau, D.K. Kumar, S.P. Arjunan and S. Kumar, Visual Speech Recognition Using Image Moments and Multiresolution Wavelet Images, in: International Conference on Computer Graphics, Imaging and Visualisation (CGIV'06), Sydney, Australia, 2006, 194-199.
33. W.C. Yau, D.K. Kumar, S.P. Arjunan and S. Kumar, Visual Speech Recognition Using Wavelet Transform and Moment Based Features, in: International Conference on Informatics in Control, Automation and Robotics (ICINCO), Setubal, Portugal, 2006.