Viseme definitions comparison for visual-only speech recognition

European Signal Processing Conference

Volumn , Issue , 2011, Pages 2109-2113

  Cappelletta, Luca ^a   Harte, Naomi ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO AND VISUAL CUES; AUDIO VISUAL SPEECH RECOGNITION; RECOGNITION RATES; SPEECH RECOGNITION SYSTEMS; VISEMES; VISUAL FEATURE;

SIGNAL PROCESSING;

SPEECH RECOGNITION;

EID: 84862215808     PISSN: 22195491     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. G. Potamianos et al., "Recent advances in the autormatic recognition of audio-visual speech," Proceeding of the IEEE, vol. 91, no. 9, 2003.
2. W. C. Yau et al., "Visual Speech Recognition Using Motion Features and HiddenMarkovModels," in CAIP 2007, S.-V. B. Heidelberg, Ed., 2007.
3. P. Tsang-Long et al., "Automatic visual feature extraction for Mandarin audio-visual speech recognition," in Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on, 2009, pp. 2936-2940.
4. S. Alizadeh et al., "Lip feature extraction and reduction for hmm-based visual speech recognition systems," in Signal Processing, 2008. ICSP 2008. 9th International Conference on, 2008, pp. 561-564.
5. Y. Lan et al., "Comparing visual features for lipreading," in International Conference on Auditory-Visual Speech Processing, 2009, pp. 102-106.
6. J. Luettin et al., "Visual speech recognition using active shape models and hidden markov models," 1996.
7. E. Patterson et al., "CUAVE: a new audio-visual database for multimodal human-computer interface research," in Acoustics, Speech, and Signal Processing, 2002. Proceedings. (ICASSP '02). IEEE International Conference on, vol. 2, 2002, pp. 2017-2020.
8. T. Chen, "Audiovisual speech processing," Signal Processing Magazine, IEEE, vol. 18, no. 1, pp. 9-21, 2001.
9. K. Messer et al., "XM2VTSDB: The Extended M2VTS Database," in Second International Conference on Audio and Video-based Biometric Person Authentication, 1999.
10. M. Cooke et al., "An audio-visual corpus for speech perception and automatic speech recognition," The Journal of the Acoustical Society of America, vol. 120, no. 5, pp. 2421-2424, 2006.
11. N. Fox, B. O'Mullane, and R. Reilly, "The Realistic Multi-Modal VALID database and Visual Speaker Identification Comparison Experiments," in AVBPA, New York, 2005.
12. C. Sanderson, Biometric Person Recognition: Face, Speech and Fusion. VDM-Verlag, 2008.
13. I. Matthews et al., "A comparison of model and transformbased visual features for audio-visual LVCSR," in Multimedia and Expo, 2001. ICME 2001. IEEE International Conference on, 2001, pp. 825-828.
14. T. J. Hazen et al., "A segment-based audio-visual speech recognizer: data collection, development, and initial experiments," in Proceedings of the 6th international conference on Multimodal interfaces. State College, PA, USA: ACM, 2004, pp. 235-242.
15. K. Saenko, "Articulary features for robust visual speech recognition," Master Thesis, Massachussetts Institute of Technology, 2004.
16. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, D. Vergyri, S. Sison, A. Mashari, and J. Zhou, "Audio-visual speech recognition," Tech. Rep., Oct. 12 2000.
17. E. Bozkurt, E. Qigdem Eroglu, E. Erzin, T. Erdem, and M. Ozkan, "Comparison of phoneme and viseme based acoustic units for speech driven realistic lip animation," in 3DTV Conference, 2007, 2007, pp. 1-4.
18. I. S. Pandzic and R. Forchheimer, MPEG-4 Facial Animation: The Standard, Implementation and Applications. New York, NY, USA: John Wiley & Sons, Inc., 2003.
19. A. Goldschen, O. Garcia, and E. Petajan, "Continuous optical automatic speech recognition by lipreading," vol. 1, pp. 572-577 vol.1, oct-2 nov 1994.
20. J. Jeffers and M. Barley, Speechreading (Lipreading). Charles C Thomas Pub Ltd, 1971.
21. T. Ezzat and T. Poggio, "Miketalk: a talking facial display based on morphing visemes," in Computer Animation 98. Proceedings, 1998, pp. 96-102.
22. L. Cappelletta and N. Harte, "Nostril detection for robust mouth tracking," in Irish Signals and Systems Conference, Cork, 2010, pp. 239 - 244.
23. D. Shiell, L. Terry, P. Aleksic, and A. K. Katsaggelos, "Audiovisual and visual-only speech and speaker recognitio: Issue about theory, system design and implementation," in Visual Speech Recognition: Lip Segmentation and Mapping, 2008, pp. 1-38.
24. C. Bregler and Y. Konig, "Eigenlips for robust speech recognition," in Acoustics, Speech, and Signal Processing, 1994. ICASSP-94., 1994 IEEE International Conference on, vol. ii, 1994, pp. II/669-II/672 vol.2.
25. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artificial Intellicenge, 1980.
26. J. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker: Description of the algorithm," 2002.
27. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proceedings of Imaging Understanding Workshop, 1981.