Robust lip region segmentation for lip images with complex background

Pattern Recognition

Volumn 40, Issue 12, 2007, Pages 3481-3491

  Wang, Shi Lin ^a   Lau, Wing Hong ^b   Liew, Alan Wee Chung ^c   Leung, Shu Hung ^b  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^c GRIFFITH UNIVERSITY   (Australia)

Author keywords

Fuzzy clustering; Lip image; Lip segmentation; Spatial penalty term

Indexed keywords

CLUSTERING ALGORITHMS; FUZZY CLUSTERING; GRAPHIC METHODS; HUMAN COMPUTER INTERACTION; PROBLEM SOLVING;

LIP IMAGES; MUSTACHES; SKIN REGION;

IMAGE SEGMENTATION;

EID: 34547657826     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.03.016     Document Type: Article

References (27)

1. Erber N.P. Interaction of audition and vision in the recognition of oral speech stimuli. J. Speech Hear. Res. 12 (1969) 423-425
2. M.T. Chan, HMM-based audio-visual speech recognition integrating geometric and appearance-based visual features, IEEE Fourth Workshop on Multimedia Signal Processing, Cannes, France, October 2001, pp. 9-14.
3. M.N. Kaynak, Q. Zhi, A.D. Cheok, K. Sengupta, K.C. Chung, Audio-visual modeling for bimodal speech recognition, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, October 2001, Tucson, AZ, USA, vol. 1, pp. 181-186.
4. Y. Zhang, S. Levinson, T. Huang, Speaker independent audio-visual speech recognition, Proceedings of IEEE International Conference on Multimedia and Expo, July 2000, New York, USA, vol. 2, pp. 1073-1076.
5. G. Rabi, S. Lu, Visual speech recognition by recurrent neural networks, Electrical and Computer Engineering, 1997, Engineering Innovation: Voyage of Discovery, Canadian Conference, May 1997, St. Johns, Newfoundland, Canada, vol. 1, pp. 55-58.
6. E.D. Petajan, Automatic lipreading to enhance speech recognition, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1985, pp. 40-47.
7. C. Bregler, H. Hild, S. Manke, A. Waibel, Improving connected letter recognition by lipreading, Proceedings of IEEE International Conference on Acoustics, Speech, Signal Processing, 1993, pp. 557-560.
8. M.E. Hennecke, K.V. Prasad, D.G. Stork, Using deformable templates to infer visual speech dynamics, 1994 Conference Record of the Twenty-Eighth Asilomar Conference on Signals, Systems and Computers, October 1994, Pacific Grove, CA, USA, vol. 1, pp. 578-582.
9. A. Caplier, Lip Detection and Tracking, Proceedings of 11th International Conference on Image Analysis and Processing, September 2001, Palermo, Italy, pp. 8-13.
10. T. Wark, S. Sridharan, V. Chandran, An approach to statistical lip modelling for speaker identification via chromatic feature extraction, Proceedings of Fourteenth International Conference on Pattern Recognition, August 1998, Brisbane, Australia, vol. 1, pp. 123-125.
11. N. Eveno, A. Caplier, P.Y. Coulon, New color transformation for lips segmentation, Proceedings of IEEE Fourth Workshop on Multimedia Signal Processing, October 2001, Cannes, France, pp. 3-8.
12. M. Lievin, F. Luthon, Lip features automatic extraction, Proceedings of IEEE International Conference on Image Processing, March 1999, Chicago, IL, USA, vol. 3, pp. 168-172.
13. X. Zhang, R.M. Mersereau, Lip feature extraction towards an automatic speechreading system, Proceedings of IEEE International Conference on Image Processing, September 2000, Vancouver, BC, Canada, vol. 3, pp. 226-229.
14. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum Press, New York
15. T.A. Runkler, J.C. Bezdek, Image segmentation using fuzzy clustering with fractal features, Proceedings of the Sixth IEEE International Conference, July 1997, Barcelona, Spain, vol. 3, pp. 1393-1398.
16. Tolias Y.A., and Panas S.M. On applying spatial constraints in fuzzy image clustering using a fuzzy rule-based system. IEEE Signal Process. Lett. 5 (1998) 245-247
17. Leung S.H., Wang S.L., and Lau W.H. Lip image segmentation using fuzzy clustering incorporating an elliptic shape function. IEEE Trans. Image Process. 13 1 (2004) 51-62
18. Liew A.W.C., Leung S.H., and Lau W.H. Segmentation of color lip images by spatial fuzzy clustering. IEEE Trans. Fuzzy Syst. 11 4 (2003) 542-549
19. Bezdek J.C. A convergence theorem for the fuzzy ISODATA clustering algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 2 (1980) 1-8
20. Liew A.W.C., Leung S.H., and Lau W.H. Lip contour extraction from color images using a deformable model. Pattern Recognition 35 (2002) 2949-2962
21. CIE, Colorimetry, CIE Pub. No. 15.2, Bureau Central de la CIE, Vienna, Austria, 1986.
22. Sharma G., Vrhel M.J., and Trussell H.J. Color imaging for multimedia. Proc. IEEE 86 (1998) 1088-1108
23. R.W.G. Hunt, Measuring Color, second ed., Ellis is Horwood Series in Applied Science and Industrial Technology, Ellis Horwood, Chichester, UK, 1991.
24. Liew A.W.C., Leung S.H., and Lau W.H. Segmentation of color lip images by spatial fuzzy clustering. IEEE Trans. Fuzzy Syst. 11 4 (2003) 542-549
25. A.M. Martinez, R. Benavente, The AR face database (online), CVC Technical Report #24, June 1998.
26. Lee S.U., Chung S.Y., and Park R.H. A comparative performance study of several global thresholding techniques for segmentation. Comput. Vision Graphics Image Process. 52 (1990) 171-190
27. Maulik U., and Bandyopadhyay S. Performance evaluation of some clustering algorithms and validity indices. IEEE Trans. Pattern Anal. Mach. Learn. 24 12 (2002) 1650-1654