Dynamic units of visual speech

Computer Animation 2012 - ACM SIGGRAPH / Eurographics Symposium Proceedings, SCA 2012

Volumn , Issue , 2012, Pages 275-284

  Taylor, Sarah L ^a   Mahler, Moshe ^b   Theobald, Barry John ^a   Matthews, Iain ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b DISNEY RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMATION; INTERACTIVE COMPUTER GRAPHICS;

FINITE SET; SPEECH ANIMATION; SUBJECTIVE EVALUATIONS; VISEMES; VISUAL SPEECH;

SPEECH;

EID: 84988955843     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. BREGLER C., COVELL M., SLANEY M.: Video rewrite: Driving visual speech with audio. In Proceedings of SIGGRAPH (1997), pp. 353-360.
2. BRAND M.: Voice puppetry. In Proceedings of SIGGRAPH (Los Angeles, California, 1999), pp. 21-28.
3. CHUANG E., BREGLER C.: Mood swings: Expressive speech animation. ACM Trans. on Graphics 24, 2 (2005), 331-347.
4. CHANG Y., EZZAT T.: Transferable videorealistic speech animation. In ACM SIGGRAPH/ Eurographics Symposium on Computer Animation (Los Angeles, July 2005), pp. 29-31.
5. COOTES T., EDWARDS G., TAYLOR C.: Active appearance models. IEEE PAMI 23, 6 (June 2001), 681-685.
6. CAO Y., FALOUTSOS P. KOHLER E., PIGHIN F.: Realtime speech motion synthesis from recorded motions. In Eurographics Symposium on Computer Animation (2004), pp. 347-355.
7. COSATTO E., GRAF H.: Photo-realistic talking-heads from image samples. IEEE Transactions on Multimedia 2, 3 (2000), 152-163.
8. CAPPELLETTA L., HARTE N.: Viseme definitions comparison for visual-only speech recognition. In Proceedings of the European Signal Processing Conference (2011).
9. COHEN M., MASSARO D.: Modeling coarticualtion in synthetic visual speech. In Models and Techniques in Computer Animation, Thalmann N., D T., (Eds.). Springer-Verlag, 1994, pp. 141-155.
10. CAMPBELL W., STURIM D., REYNOLDS D.: Support vector machines using GMM supervectors for speaker verification. Signal Processing Letters 13, 5 (2006), 308-311.
11. CAO Y., TIEN W., FALOUTSOS P., PIGHIN F.: Expressive speech-driven facial animation. ACM Transaction on Graphics 24, 4 (2005), 1283-1302.
12. ENGLEBIENNE G., COOTES T., RATTRAY M.: A probabilistic model for generating realistic speech movements from speech. In Proceedings of Advances in Neural Information Processing Systems (2007).
13. EZZAT T., GEIGER G., POGGIO T.: Trainable videorealistic speech animation. In Proceedings of SIGGRAPH (2002), pp. 388-398.
14. EZZAT T., POGGIO T.: Miketalk: A talking facial display based on morphing visemes. In Proceedings of the Computer Animation Conference (1998), pp. 96-103.
15. FISHER C.: Confusions among visually perceived consonants. Journal of Speech and Hearing Research 11 (1968), 796-804.
16. HOWARD L., MIRGHAFORI N.: Word-conditioned HMM supervectors for speaker recognition. In INTERSPEECH- 2007 (2007), pp. 746-749.
17. HAZEN T., SAENKO K., LA C., GLASS J.: A segment-based audio-visual speech recognizer: Data collection, development, and initial experiments. In Proceedings of the International Conference on Multimodal Interfaces (2004).
18. HILDER S., THEOBALD B., HARVEY R.: In pursuit of visemes. In Proceedings of the International Conference on Auditory-Visual Speech Processing (2010), pp. 154-159.
19. JAIN A., MURTY M., FLYNN P.: Data clustering: a review. ACM Computing Surveys 31, 3 (1999), 264-323.
20. KARYPIS G.: CLUTO - A Clustering Toolkit. Tech. rep., University of Minnesota, Department of Computer Science, Minneapolis, April 2002.
21. KEOGH E., RATANAMAHATANA C. A.: Exact indexing of dynamic time warping. Knowledge and Information Systems 7 (2005), 358-386.
22. MASSARO D.: Perceiving Talking Faces. The MIT Press, 1998.
23. MATTHEWS I., BAKER S.: Active appearance models revisited. International Journal of Computer Vision 60, 2 (2004), 135-164.
24. MA J., COLE R., PELLOM B., WARD W., WISE B.: Accurate visible speech synthesis based on concatenating variable length motion capture data. IEEE Transactions on Visualization and Compuer Graphics 12, 2 (2006), 266-276.
25. MONTGOMERY A., JACKSON P.: Physical characteristics of the lips underlying vowel lipreading performance. Journal of the Acoustical Society of America 73, 6 (1983), 2134-2144.
26. MATTHEYSES W., LATACZ L., VERHELST W.: Automatic viseme clustering for audiovisual speech synthesis. In Proceedings of Interspeech (2011).
27. NOH J., NEUMANN U.: Expression cloning. In ACM SIGGRAPH (2001), pp. 277-288.
28. OWENS E., BLAZEK B.: Visemes observed by the hearing-impaired and normal-hearing adult viewers. Journal of Speech and Hearing Research 28 (1986), 381-393.
29. PARKE F. I., WATERS K.: Computer facial animation. A. K. Peters, Ltd., Natick, MA, USA, 1996.
30. SUMBY W., POLLACK I.: Visual contribution to speech intelligibility in noise. Journal of Speech and Hearing Research 26, 2 (March 1954), 212-215.
31. SUMMERFIELD Q.: Lipreading and audio-visual speech perception. Phil. Trans. of the Roy. Soc. Series B: Biological Sciences 335, 1273 (1992), 71-78.
32. THEOBALD B. J., MATTHEWS I., SPIES J. R., BRICK T. R., COHN J. F., BOKER S. M., MANGINI M.: Mapping and manipulating facial expression. Language and Speech 52, 2/3 (2009), 369-386.
33. VLASIC D., BRAND M., PFISTER H., POPOVIC J.: Face transfer with multilinear models. ACM Transactions on Graphics 24, 3 (2005), 426-433.
34. WANG Z., CAI L., HAZHOU A.: A dynamic viseme model for personalizing a talking head. In International Conference on Signal Processing (2002), pp. 1015-1018.
35. WILLIAMS L.: Performance driven facial animation. Computer Graphics 24, 2 (1990), 235-242.
36. WITHHELD: Relating objective and subjective performance measures for AAM-based visual speech synthesis. IEEE Trans. on Audio, Speech and Language Processing (accepted for publication), 2012.
37. WAMPLER K., SASAKI D., ZHANG L., POPOVIĆ Z.: Dynamic, expressive speech animation from a single mesh. In Eurographics Symposium on Computer Animation (2007), pp. 53-62.
38. XIANG CHAI J., XIAO J., HODGINS J.: Vision-based control of 3D facial animation. In Eurographics Symposium on Computer Animation (2003), pp. 193-206.
39. YOUNG S. J., EVERMANN G., GALES M. J. F., HAIN T., KERSHAW D., MOORE G., ODELL J., OLLASON D., POVEY D., VALTCHEV V., WOODLAND P. C.: The HTK Book, version 3.4, 2006.