Visual speech features representation for automatic lip-reading

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn II, Issue , 2005, Pages

  Sagheer, Alaa ^a   Tsuruta, Naoyuki ^b   Taniguchi, Rin Ichiro ^a   Maeda, Sakashi ^b  

^a KYUSHU UNIVERSITY   (Japan)

^b FUKUOKA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

FACE RECOGNITION; IMAGE COMMUNICATION SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; SPEECH SYNTHESIS; VISUAL COMMUNICATION;

HYPERCOLUMN MODEL (HCM); LIP MARKERS; LIP READING; VISUAL SPEECH FEATURE;

FEATURE EXTRACTION;

EID: 33646795002     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2005.1415521     Document Type: Conference Paper

References (12)

1. E. D. Petajan, "Automatic lip-reading to enhance speech recognition," IEEE Global Telecommunications Conf: 265-272, 1984.
2. K. Mase and A. Pentland, "Automatic lip-reading by optical flow analysis," Systems and Computers in Japan, 22 (6): 67-75, 1991.
3. N. Tsuruta, H. luchi, A. Sagheer, T. Tobely, "Self-Organizing Feature Maps for HMM Based Lip-reading," The 7th Int. conf. on Knowledge-Based Intelligent Information & Engineering Sys, KES03, 2: 162-168, 2003.
4. A.J. Goldschen, O.N. Garcia, and E. Petajan," Continuous optical automatic speech recognition by lip-reading," the 28th Annual Asilomar conf. on Signal Systems, and Computer, 1:572-577, 1994.
5. N. Tsuruta, R. Taniguchi, M. Amamiya," Hypercolumn Model: A Combination Model Hierarchical Self-Organizing Maps and Neocognitron for Image Recognition," Systems and Computers in Japan, 31 (2): 49-61, 2000.
6. M. Heckmann, K. Kroschel, C. Savariaux, F. Berthommier, "DCT-Based Video Features For Audio-Visual Speech Recognition," Proc. Of Inter. Conf. on Spoken Language Processing, ICSLP: 1925-1928, 2002.
7. G. Potamianos, H. P. Graf, and E. Cosatto, "An Image Transform Approach for HMM Based Automatic Lip Reading," Int. Conf. on Image Processing, 3: 173-177, 1998.
8. K. Fukushima, "Neocognitron," Biol Cyberetics, 36 (4): 193-202, 1980.
9. J. Lampinen, E. Oja, "Clustering Properties of Hierarchical Self Organizing Maps," Journal of Math. Imaging and Vision, 2, 1992.
10. L.R. Rabiner, "A tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," IEEE, 77(2): 257-286, Feb. 1989.
11. HMM Tool Kit, [Online] Available: http://htk.eng.cam.ac.uk
12. I. Matthews, T. Cootes, A. Bangham, S. Cox and R. Harvey, "Extraction of Visual Features for Lip-Reading," IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(2), 2002.