Automatic visual feature extraction for Mandarin audio-visual speech recognition

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2009, Pages 2936-2940

  Pao, Tsang Long ^a   Liao, Wen Yuan ^a   Wu, Tsan Nung ^a   Lin, Ching Yi ^a  

^a TATUNG UNIVERSITY   (Taiwan)

Author keywords

Audio speech feature; Audio visual speech recognition; Visual speech feature; WD KNN classifier

Indexed keywords

AUDIO VISUAL SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION; EDGE INFORMATION; K-NN CLASSIFIER; RECOGNITION ACCURACY; RECOGNITION ENGINES; RECOGNITION PERFORMANCE; RECOGNITION SYSTEMS; RESEARCH AREAS; SPEECH FEATURES; VISUAL FEATURE; VISUAL FEATURE EXTRACTION; VISUAL INFORMATION; VISUAL SPEECH; VISUAL SPEECH FEATURES;

AUDIO SYSTEMS; CLASSIFIERS; CYBERNETICS; FEATURE EXTRACTION; SPEECH ANALYSIS; VISUAL COMMUNICATION;

SPEECH RECOGNITION;

EID: 74849097139     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2009.5346011     Document Type: Conference Paper

References (16)

1. L.G. Bahler, J.E. Porter and A.L. Higgins, "Improved voice identification using a nearest-neighbor distance measure," Proc. Acoustics, Speech, and Signal Processing, Vol. 1, Issue:19-22, pp. 321-323, Apr. 1994.
2. T. Chen, "Audio-visual speech processing," IEEE Signal Processing Magazine, Jan. 2001.
3. C. C. Chibelushi, F. Deravi, and J. S. D. Mason, "A review of speech-based bimodal recognition," IEEE Trans. Multimedia, vol. 4, pp. 23-37, Feb. 2002.
4. D. DeCarlo and D. Metaxas, "Optical Flow Constraints on Deformable Models with Applications to Face Tracking," Int'l J. Computer Vision, vol. 38, no. 2, pp. 99-127, 2000.
5. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," in IEEE Trans. Multimedia, vol. 2, pp. 141-151, Sept. 2000.
6. Tsang-Long Pao, Yu-Te Chen and Jun-Heng Yeh, "Comparison of classification methods for detecting emotion from Mandarin speech," IEICE Transactions on Information and Systems, Vol. E91-D, No. 4, pp. 1074-1081, Apr. 2008.
7. M.I. Faraj and J. Bigun, "Person Verification by Lip-Motion," Proc. Conf. Computer Vision and Pattern Recognition Workshop (CVPRW '06), pp. 37-45, 2006.
8. M.I. Faraj and J. Bigun, "Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition", IEEE Trans. Computers, , vol. 56, no. 9, pp.1169-1175, Sep. 2007.
9. M. Heckmann, F. Berthommier and K. Kroschel, "Noise Adaptive Stream Weighting in Audio-Visual Speech Recognition," EURASIP Journal on Applied Signal processing, 2002:11, pp.1260-1273, 2002.
10. M. N. Kaynak, Q. Zhi, etc, "Analysis of Lip Geometric Features for Audio-Visual Speech Recognition," IEEE Transaction on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 34, pp. 564-570, July 2004.
11. I. Matthews, T. F. Cootes, J. A. Bangham, S. Cox, and R. Harvey, "Extraction of visual features for lipreading," IEEE Trans. pattern analysis and machine intelligence, vol. 24, pp. 198-213, 2002.
12. E. D. Petajan, N. M. Brooke, B. J. Bischoff, and D. A. Boddoff, "Experiments in automatic visual speech recognition," in Proc. 7th FASE Symp., Book 4, pp. 1163-1170, 1988.
13. G. Poamianos, etc,"Recent Advances in the Automatic Recognition of Audiovisual Speech" Proceeding of the IEEE, vol. 91, no. 9, Sep. 2003.
14. L. Sigal, S. Sclaroff and V. Athitsos, "Skin Color-Based Video Segmentation under Time-Varying Illumination", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, Issue: 7, pp. 862-877, July 2004.
15. M. Soriano, B. Martinkauppi, S. Huovinen and M. Laaksonen, "Skin detection in video under changing illumination conditions", Proceedings of 15th International Conference on Pattern Recognition, Vol. 1, pp. 839-842, 3-7 Sept, 2000.
16. M. Valsta and M. Pantic, "Fully Automatic Facial Action Unit Detection and Temporal Analysis", Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), pp. 149-149.