Effective lip localization and tracking for achieving multimodal speech recognition

IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems

Volumn , Issue , 2008, Pages 90-93

  Wei, Chuan Ooi ^a,b   Jeon, Changwon ^a,b   Kim, Kihyeon ^a,b   Han, David K ^a,b   Ko, Hanseok ^a,b  

^a Korea University   (South Korea)

^b UNITED STATES NAVAL ACADEMY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLOR SPACE; COLOR SPACE TRANSFORMATION; HIGH FLEXIBILITY; HUMAN COMPUTER INTERFACES; HYBRID APPROACH; INTENSITY INFORMATION; LEAST SQUARE FITTING METHOD; LIP LOCALIZATION; LIP MODEL; LIP MOTIONS; LIP SEGMENTATION; LOCALIZATION AND TRACKING; MEASUREMENT CONDITIONS; MULTI-MODAL SPEECH RECOGNITION; NOISY ENVIRONMENT; PCA METHOD; SIX DEGREES OF FREEDOM; VISUAL FEATURE; VISUAL MODALITIES;

COLOR; INTELLIGENT SYSTEMS; INTERFACES (COMPUTER); SPEECH INTELLIGIBILITY;

SPEECH RECOGNITION;

EID: 67650530502     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MFI.2008.4648114     Document Type: Conference Paper

References (9)

1. G.Potamianos, C.Neti, G.Gravier, A.Garg, and A.W.Senior, "Recent advances in the automatic recognition of audio-visual speech," Invited, IEEE Proc, vol.91, pp. 1306-1326, 2003.
2. Lewis.T.W, Powers.D.M., "Lip Feature Extraction Using Red Exclusion," Proc. Selected papers from Pan-Sydney Workshop on Visual Information Processing, pp.61-67, 2000.
3. R.L.Hsu, M.Abdel, A.K.Jain, "Face Detection in Color Images," IEEE Trans. on Pattern Analysis & Machine Intelligence, 2002.
4. S.Igawa, A.Ogihara, A.Shintani, and S.Takamatsu, "Speech recognition based on fusion of visual and auditory information using full-frame color image," ZEZCE Trans. Fundumentals, 1996.
5. A.Hulbert and T.Poggio, "Synthesizing a Color Algorithm From Examples", Science, vol.239, pp. 482-485, 1998.
6. Chan, M.T., "Automatic lip model extraction for constrained contour-based tracking," ICIP, pp. 848-851 1999. (Pubitemid 30550362)
7. N.Otsu, "A threshold selection method from gray-level histograms,"IEEE Trans. on Systems Man Cybernet , pp. 62-66, 1979. (Pubitemid 9413341)
8. Wang, S.L, Lau,W.H, Leung,S.H, " A new real-time lip contour extraction algorithm," ICASSP, pp. 217-220, 2003.
9. Terrillon,T.C, Shirazi,M.N, Fukamachi.H, "Comparative performance of different chrominance skin chrominance models and chrominance spaces for the automatic detection of human faces in color images," Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition, pp. 54-61, 2000.