Improving Visual Features for Lip-reading

Auditory-Visual Speech Processing 2010, AVSP 2010

Volumn , Issue , 2010, Pages

  Lan, Yuxuan ^a   Theobald, Barry John ^a   Harvey, Richard ^a   Ong, Eng Jon ^b   Bowden, Richard ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

feature comparison; feature extraction; lip reading; speaker variability

Indexed keywords

FEATURE EXTRACTION; SPEECH RECOGNITION;

AUTOMATIC SPEECH RECOGNITION SYSTEM; FEATURE COMPARISON; FEATURES EXTRACTION; LIP READING; SPEAKER DEPENDENTS; SPEAKER VARIABILITY; TEST SETS; TRAINING SETS; VISUAL FEATURE; VISUAL MODALITIES;

SPEECH PROCESSING;

EID: 85133306817     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. S. Cox, R. Harvey, Y. Lan, J. Newman, and B. Theobald, “The callenge of multispeaker lip-reading,” in International Conference on Auditory-Visual Speech Processing 2008, 2008, pp. 179-184.
2. G. Potamianos, C. Neti, J. Luettin, and I. Matthews, “Audio-visual automatic speech recognition: An overview,” in Issues in Visual and Audio-visual Speech Processing. MIT Press, 2004.
3. W. Fisher, G. Doddington, and K. Goudie-Marshall, “The DARPA speech recognition research database: specifications and status.” in In Proceedings of the DARPA Speech Recognition Workshop., 1986.
4. N. Eveno, A. Caplier, and P. Coulon, “Automatic and accurate lip tracking,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 5, pp. 706-715, 2004.
5. Y. Lan, R. Harvey, B. Theobald, E.-J. Ong, and R. Bowden, “Comparing visual features for lipreading,” in Proc. of International Conference on Auditory-visual Speech Processing, 2009, pp. 102-106.
6. T. Cootes, G. Edwards, and C. Taylor, “Active appearance models,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
7. E. Ong, Y. Lan, B. Theobald, H. R., and R. Bowden, “Robust facial feature tracking using selected multi-resolution linear predictors,” in In Proceedings of the International Conference Computer Vision (ICCV), 2009.
8. J. W. Sammon, “A nonlinear mapping for data structure analysis,” IEEE Transactions on Computers, vol. 18, pp. 401-409, 1969.
9. J. Newman and S. Cox, “Automatic visual-only language identification: A preliminary study.” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 2009, pp. 4345-4348.
10. L. Rabiner and B.-H. Juang, Fundamentals of speech recognition. Prentice-Hall, Inc., 1993.
11. I. Matthews, T. F. Cootes, J. Bangham, S. Cox, and R. Harvey, “Extraction of visual features for lipreading,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 198-213, February 2002.
12. J. Luettin and N. Thacker, “Speechreading using probabilistic models,” Computer Vision and Image Understanding, vol. 65, no. 2, pp. 163-178, 1997.
13. S. Young, G. Evenmann, D. Kershaw, G. Moore, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, The HTK Book (version 3.2.1), 2002.
14. C. G. Fisher, “Confusions among visually perceived consonantsnants,” Journal of Speech and Hearing Research, vol. 11, pp. 796-804, 1968.