In Pursuit of Visemes

Auditory-Visual Speech Processing 2010, AVSP 2010

Volumn , Issue , 2010, Pages

  Hilder, Sarah ^a   Theobald, Barry John ^a   Harvey, Richard ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

Visemes; visual speech encoding

Indexed keywords

SIGNAL ENCODING; SPEECH PROCESSING;

ACTIVE APPEARANCE MODELS; CLUSTERINGS; MODELING FEATURES; OBJECTIVE METHODS; SALIENT POINTS; SPEECH ENCODING; TEMPORAL BEHAVIOR; VISEMES; VISUAL SPEECH; VISUAL SPEECH ENCODING;

COST FUNCTIONS;

EID: 85133376420     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. C. G. Fisher, “Confusions among visually perceived consonants,” Journal of Speech, Language, and Hearing Research, vol. 11, pp. 796-804, December 1968.
2. T. Chen and R. R. Rao, “Audio-visual integration in multimodal communication,” in Proceedings of the IEEE, 1998, pp. 837-852.
3. E. T. Auer and L. E. Bernstein, “Speechreading and the structure of the lexicon: Computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness,” Journal of the Acoustical Society of America, vol. 102, pp. 3704-3710, Dec. 1997.
4. S. P. Eberhardt, L. E. Bernstein, and M. H. Goldstein, “Speechreading sentences with single-channel vibrotactile presentation of voice fundamental frequency,” Journal of the Acoustical Society of America, vol. 88, no. 3, pp. 1274-1285, 1990.
5. T. Ezzat and T. Poggio, “Visual speech synthesis by morphing visemes,” International Journal of Computer Vision, vol. 38, no. 1, pp. 45-57, 2000.
6. S. A. Lesner and P. B. Kricos, “Visual vowel and diphthong perception across speakers,” Journal of the Academy of Rehabilitative Audiology, vol. 14, pp. 252-258, 1981.
7. A. A. Montgomery and P. L. Jackson, “Physical characteristics of the lips underlying vowel lipreading performance,” Journal of the Acoustical Society of America, vol. 73, no. 6, pp. 2134-2144, 1983.
8. J. Jiang, A. Alwan, L. E. Bernstein, E. T. Auer, and P. A. Jr. Keating, “Similarity structure in perceptual and physical measures for visual consonants across talkers,” in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, 2002, pp. 441-444.
9. J. S. Perkell and M. L. Matthies, “Temporal measures of anticipatory labial coarticulation for the vowel/u/: Within- and cross-subject variability,” Journal of the Acoustical Society of America, vol. 91, no. 5, pp. 2911-2925, 1992.
10. A. Turkmani, “Visual analysis of viseme dynamics,” Ph.D. dissertation, University of Surrey, 2008.
11. R. D. Kent and F. D. Minifie, “Coarticulation in recent speech production models,” Journal of Phonetics, vol. 5, no. 2, pp. 115-133, April 1977.
12. A. J. Goldschen, O. N. Garcia, and E. Petajan, “Continuous optical automatic speech recognition by lipreading,” in Proceedings of the 28th Asilomar Conference on Signals, Systems, and Computers, 1994, pp. 572-577.
13. C. Ding and X. He, “Cluster merging and splitting in hierarchical clustering algorithms,” in Proceedings of the Second IEEE International Conference on Data Mining, 2002, pp. 139-146.
14. J. Luettin, “Visual speech and speaker recognition,” Ph.D. dissertation, University of Sheffield, 1997.
15. E. Owens and B. Blazek, “Visemes observed by hearing-impaired and normal-hearing adult viewers,” Journal of Speech and Hearing Research, vol. 28, pp. 381-393, 1985.
16. A. P. Benguerel and M. K. Pichora-Fuller, “Coarticulation effects in lipreading,” JSHR, vol. 25, pp. 600-607, 1982.
17. P. L. Jackson, “The theoretical minimal unit for visual speech perception: Visemes and coarticulation,” Volta Review, vol. 90, no. 5, pp. 99-115, September 1988.
18. S. L. Mattys, L. E. Bernstein, and E. T. Auer, “Stimulus-based lexical distinctiveness as a general word-recognition mechanism,” Perception and Psychophysics, vol. 64, no. 4, pp. 667-679, 2002.
19. M. M. Cohen and D. W. Massaro, “Modeling coarticulation in synthetic visual speech,” in Models and Techniques in Computer Animation. Springer-Verlag, 1993, pp. 139-156.
20. A. Löfqvist, Speech as audible gestures. Kluwer Academic Publishers, 1990.
21. J. Melenchón, J. Simó, G. Cobo, and E. Martínez, “Objective viseme extraction and audiovisual uncertainty: estimation limits between auditory and visual modes,” in International conference on auditory-visual speech processing, 2007.
22. B. Theobald, S. Fagel, G. Bailly, and F. Elsei, “Lips2008: Visual speech synthesis challenge,” in Interspeech, 2008, pp. 2310-2313.
23. T. Cootes, G. Edwards, and C. Taylor, “Active appearance models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
24. I. Matthews and S. Baker, “Active appearance models revisited,” International Journal of Computer Vision, vol. 60, no. 2, pp. 135-164, November 2004.
25. K. Wang and T. Gasser, “Alignment of curves by dynamic time warping,” The annals of statistics, vol. 25, no. 3, pp. 1251-1276, June 1997.
26. G. Karypis, “Cluto - a clustering toolkit,” University of Minnesota, Department of Computer Science, Minneapolis, Tech. Rep., April 2002.
27. P. J. Rousseeuw, “Silhouettes: a graphical aid to the interpretation and validation of cluster analysis,” Journal of Computational and Applied Mathematics, vol. 20, pp. 53-65, 1986.
28. J. C. Dunn, “Well-separated clusters and optimal fuzzy partitions,” Cybernetics and Systems, vol. 4, pp. 95-104, 1974.
29. D. L. Davies and D. W. Bouldin, “A cluster separation measure,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, pp. 224-227, 1979.
30. B. Walden, R. Prosek, and A. Montgomery, “Effects of training on the visual recognition of consonants,” Journal of Speech and Hearing Research, vol. 20, pp. 130-145, 1977.