Automatic lip contour extraction from color images

Pattern Recognition

Volumn 37, Issue 12, 2004, Pages 2375-2387

  Wang, S L ^a   Lau, W H ^a   Leung, S H ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Geometric constraints; Lip contour extraction; Lip modeling; Lip segmentation; Point driven optimization

Indexed keywords

COLOR IMAGE PROCESSING; FEATURE EXTRACTION; FUNCTIONS; IMAGE SEGMENTATION; MATHEMATICAL MODELS; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS); SET THEORY;

GEOMETRIC CONSTRAINTS; LIP CONTOUR EXTRACTION; LIP MODELING; LIP SEGMENTATION; POINT-DRIVEN OPTIMIZATION;

SPEECH RECOGNITION;

EID: 12344336635     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(04)00196-7     Document Type: Article

References (24)

1. N.P. Erber Interaction of audition and vision in the recognition of oral speech stimuli J. Speech Hearing Res. 12 1969 423 425
2. T.A. Faruquie, A. Majumdar, N. Rajput, and L.V. Subramaniam Large vocabulary audio-visual speech recognition using active shape models Proceedings of IEEE International Conference on Pattern Recognition, Vol. 3 Barcelona, Spain September 2000 106 109
3. Y. Zhang, S. Levinson, and T. Huang Speaker independent audio-visual speech recognition Proceedings of IEEE International Conference on Multimedia and Expo, Vol. 2 New York, USA July 2000 1073 1076
4. X. Zhang, R.M. Merserratt, and M.A. Clements Audio-visual speech recognition by Speech reading IEEE 14th International Conference on Digital Signal Processing, Vol. 2 Thera, Greece July 2002 1069 1072
5. E.D. Petajan Automatic Lipreading to enhance speech recognition Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 1985 40 47
6. C.C. Chibelushi, F. Deravi, and J.S.D. Mason A review of speech-based bimodal recognition IEEE Trans. Multimedia 4 2002 23 37
7. C. Bregler, and Y. Konig Eigenlips for robust speech recognition Proceedings of IEEE International Conference on Acoustic Speech and Signal Processing, Adelaide 1994 669 672
8. T. Wark, S. Sridharan, and V. Chandran An approach to statistical lip modelling for speaker identification via chromatic feature extraction Proceedings of Fourteenth International Conference on Pattern Recognition, Vol. 1 Brisbane, Australia August 1998 123 125
9. A. Blake, and M. Isard Active Contours 1998 Springer Berlin
10. G.I. Chiou, and J.N. Hwang Lipreading from color video IEEE Trans. Image Processing 6 1997 1192 1195
11. C. Xu, and J.L. Prince Snakes shapes and gradient vector flow IEEE Trans. Image Processing 7 1998 359 369
12. T. Coianiz, L. Torresani, B. Caprile, 2D deformable models for visual speech analysis, IEEE Trans. Speech Audio Processing (1996) 391-398.
13. M.E. Hennecke, K.V. Prasad, and D.G. Stork Using deformable templates to infer visual speech dynamics Proceedings of the 28th Asilomar Conference on Signals, October 1994 Systems and Computers, Vol. 1, Pacific Grove, CA, USA 1994 578 582
14. A.W.C. Liew, S.H. Leung, and W.H. Lau Lip contour extraction from color images using a deformable model Pattern Recognition 35 2002 2949 2962
15. A. Caplier Lip detection and tracking Proceedings of 11th International Conference on Image Analysis and Processing September 2001 Palermo Italy 8 13
16. T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham Active shape models-their training and application Comput. Vision Image Understanding 61 1995 38 59
17. J. Luettin, N.A. Thacker, and S.W. Beet Visual speech recognition using active shape models and hidden Markov models IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 2 Atlanta, USA, 1996 1996 817 820
18. Y. Tian, T. Kanade, and J.F. Cohn Robust lip tracking by combining shape, color and motion Proceedings of Fourth Asian Conference on Computer Vision Taipei January 2000 1040 1045
19. N. Eveno, A. Caplier, and P.Y. Coulon New color transformation for lips segmentation Proceedings of IEEE Fourth Workshop on Multimedia Signal Processing Cannes, France October 2001 3 8
20. S.L. Wang, S.H. Leung, and W.H. Lau Lip segmentation by fuzzy clustering incorporating with shape function Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 1 Orlando May 2002 1077 1080
21. CIE, Colorimetry, CIE Pub. No. 15.2, Bureau Central de la CIE, Vienna, Austria, 1986
22. R.W.G. Hunt, Measuring Color, 2nd Edition, Ellis Horwood Series in Applied Science and Industrial Technology, Ellis Horwood, Chichester, UK, 1991.
23. A.W.C. Liew, S.H. Leung, and W.H. Lau Segmentation of color lip images by spatial fuzzy clustering IEEE Trans. Fuzzy Syst. 11 2003 542 549
24. K.L. Sum, W.H. Lau, S.H. Leung, A.W.C. Liew, and K.W. Tse A new optimization procedure for extracting the point-based lip contour using active shape model Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 3 Salt Lake City, USA May 2001 1485 1488