A new Lip-reading approch for human computer interaction

ICEIS 2007 - 9th International Conference on Enterprise Information Systems, Proceedings

Volumn HCI, Issue , 2007, Pages 27-36

  Werda, Salah ^a   Mahdi, Walid ^a   Ben Hamadou, Abdelmajid ^a  

^a Faculty of Economics and Management of Sfax   (Tunisia)

Author keywords

Human machine interaction; Lip reading system; Spatial temporal tracking; Visual information

Indexed keywords

ASSISTIVE TECHNOLOGY; ELDERLY PEOPLE; FACIAL MOVEMENTS; HEARING IMPAIRED; HUMAN-MACHINE INTERACTION; LIP LOCALIZATION; LIP MOVEMENTS; LIP-READING SYSTEM; NATURAL CONDITIONS; NEW APPROACHES; SPATIAL-TEMPORAL TRACKING; VISEMES; VISUAL INFORMATION;

AUDITION; COMMUNICATION SYSTEMS; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; INFORMATION SYSTEMS; MAN MACHINE SYSTEMS; VISUAL COMMUNICATION;

MULTIMEDIA SYSTEMS;

EID: 67650249278     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Petajan, E. D., Bischoff, B., Bodoff, D., and Brooke, N. M., "An improved automatic lipreading system to enhance speech recognition" CHI 88, pp. 19-25, 1988.
2. Philippe Daubias, Modèles a posteriori de la forme et de l'apparence des lèvres pour la reconnaissance automatique de la parole audiovisuelle. Thèse à l'Université de Maine France 05-12-2002.
3. Roland Goecke, A Stereo Vision Lip Tracking Algorithm and Subsequent Statistical Analyses of the Audio-Video Correlation in Australian English. Thesis Research School of Information Sciences and Engineering. The Australian National University Canberra, Australia, January 2004.
4. McGurck et John Mcdonald. Hearing lips and seeing voice. Nature, 264 : 746-748, Decb 1976.
5. Iain Matthews, J. Andrew Bangham, and Stephen J. Cox. Audiovisual speech recognition using multiscale nonlinear image decomposition. Proc . 4th ICSLP, volume!, page 38-41, Philadelphia, PA, USA, Octob 1996.
6. Uwe Meier, Rainer Stiefelhagen, Jie Yang et Alex Waibe. Towards unrestricted lip reading. Proc 2nd International conference on multimodal Interfaces (ICM), Hong-kong, Jan 1999.
7. Prasad, K., Stork, D., and Wolff, G., "Preprocessing video images for neural learning of lipreading," Technical Report CRC-TR-9326, Ricoh California Research Center, September 1993.
8. Rao, R., and Mersereau, R., "On merging hidden Markov models with deformable templates," ICIP 95, Washington D.C., 1995.
9. Patrice Delmas, Extraction des contours des lèvres d'un visage parlant par contours actif (Application à la communication multimodale). Thèse à I'Institut National de polytechnique de Grenoble, 12-04-2000.
10. Gerasimos Potamianos, Hans Peter Graft et eric Gosatto. An Image transform approach For HM based automatic lipreading. Proc, ICIP, Volume III, pages 173-177, Chicago, IL, USA Octb 1998.
11. Iain Matthews, J. Andrew Bangham, and Stephen J. Cox. A comparaison of active shape models and scale decomposition based features for visual speech recognition. LNCS, 1407 514-528, 1998.
12. N.Eveno, "Segmentation des lèvres par un modèle déformable analytique", Thèse de doctorat de l'INPG, Grenoble, Novembre 2003.
13. N. Eveno, A. Caplier, and P-Y Coulon, "Accurate and Quasi-Automatic Lip Tracking", IEEE Transaction on circuits and video technology, Mai 2004.
14. Miyawaki T, Ishihashi I, Kishino F. Region separation in color images using color information. Tech Rep IEICE 1989;IE89-50.
15. Nakata Y, Ando M. Lipreading Method Using Color Extraction Method and Eigenspace Technique Systems and Computers in Japan, Vol. 35, No. 3, 2004
16. X. Zhang, Russell M. Mersereau, M. Clements and C. Charles Broun. Visual Speech feature extractionfor improved speech recognition. In Proc. ICASSP, Volume II, pages 1993-1996, Orlondo,FL, USA, May 13-17 2002.
17. S. Werda, W. Mahdi and A. Benhamadou, "A Spatial-Temporal technique of Viseme Extraction: Application in Speech Recognition ", SITIS 05, IEEE,
18. S. Werda, W. Mahdi, M. Tmar and A. Benhamadou, "ALiFE: Automatic Lip Feature Extraction: A New Approach for Speech Recognition Application ", the 2nd IEEE International Conference on Information & Communication Technologies: From Theory to Applications - ICTTA '06 - Damascus, Syria. 2006.
19. S. Werda, W. Mahdi, and A. Benhamadou, "LipLocalization and Viseme Classification for Visual Speech Recognition", International Journal of Computing & Information Sciences. Vol.4, No.1, October 2006.
20. N. B. Karayiannis and M. M.Randolph-Gips. Non-euclidean c-means clustering algorithms. Intelligent Data Analysis-An International Journal, 7(5):405-425, 2003.
21. CM Bishop, Neural Networks for Pattern Recognition, Oxford: Oxford University Press, 1995.